Multi-view structure-from-motion for hybrid camera scenarios

Date

2012-08-01

Author

BAŞTANLAR, YALIN
Temizel, Alptekin
Yardimci, Y.
Sturm, P.

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

151
views

0
downloads

We describe a pipeline for structure-from-motion (SfM) with mixed camera types, namely omnidirectional and perspective cameras. For the steps of this pipeline, we propose new approaches or adapt the existing perspective camera methods to make the pipeline effective and automatic. We model our cameras of different types with the sphere camera model. To match feature points, we describe a preprocessing algorithm which significantly increases scale invariant feature transform (SIFT) matching performance for hybrid image pairs. With this approach, automatic point matching between omnidirectional and perspective images is achieved. We robustly estimate the hybrid fundamental matrix with the obtained point correspondences. We introduce the normalization matrices for lifted coordinates so that normalization and denormalization can be performed linearly for omnidirectional images. We evaluate the alternatives of estimating camera poses in hybrid pairs. A weighting strategy is proposed for iterative linear triangulation which improves the structure estimation accuracy. Following the addition of multiple perspective and omnidirectional images to the structure, we perform sparse bundle adjustment on the estimated structure by adapting it to use the sphere camera model. Demonstrations of the end-to-end multi-view SfM pipeline with the real images of mixed camera types are presented.

Subject Keywords

Omnidirectional cameras, Feature matching, Hybrid camera systems, Epipolar geometry, Multi-view, Structure-from-motion

URI

https://hdl.handle.net/11511/31121

Journal

IMAGE AND VISION COMPUTING

DOI

https://doi.org/10.1016/j.imavis.2012.06.001

Collections

Graduate School of Informatics, Article

Suggestions

OpenMETU
Core

Effective structure-from-motion for hybrid camera systems Baştanlar, Yalın; Temizel, Alptekin; Yardımcı, Yasemin; STURM, Peter (2010-08-26) We describe a pipeline for structure-from-motion with mixed camera types, namely omni directional and perspective cameras. The steps of the pipeline can be summarized as calibration, point matching, pose estimation, triangulation and bundle adjustment. For these steps, we either propose improved methods or modify existing perspective camera methods to make the pipeline more effective and automatic when employed for hybrid camera systems.
Metric scale and 6dof pose estimation using a color camera and distance sensors Ölmez, Burhan; Tuncer, Temel Engin; Department of Electrical and Electronics Engineering (2021-2-26) Monocular color cameras are widely used for 6DoF pose estimation and sparse creation of 3D point cloud of the environment over decades with SfM, VO, and V-SLAM algorithms. In this thesis, a novel algorithm is presented to estimate the metric scale information of a monocular visual odometry algorithm using a distance sensor. This method uses a state-of-the-art visual odometry algorithm Semi-Direct Visual Odometry (SVO) [1] for obtaining sparse 3D point cloud and then matches these points with the measurement...
Opti-acoustic stereo imaging Saç, Hakan; Leblebicioğlu, Mehmet Kemal; Salor Durna, Özgül; Department of Electrical and Electronics Engineering (2012) In this thesis, opti-acoustic stereo imaging, which is the deployment of two-dimensional (2D) high frequency imaging sonar with the electro-optical camera in calibrated stereo configuration, is studied. Optical cameras give detailed images in clear waters. However, in dark or turbid waters, information coming from electro-optical sensor is insufficient for accurate scene perception. Imaging sonars, also known as acoustic cameras, can provide enhanced target details under these scenarios. To illustrate these...
MULTI-RESOLUTION MOTION ESTIMATION FOR MOTION COMPENSATED FRAME INTERPOLATION Guenyel, Bertan; Alatan, Abdullah Aydın (2010-09-29) A multi-resolution motion estimation scheme is proposed for tracking of the true 2D motion in video sequences for motion compensated image interpolation. The proposed algorithm utilizes frames with different resolutions and adaptive block dimensions for efficient representation of motion. Firstly, motion vectors for each block are assigned as a result of predictive search in each pass. Then, the outlier motion vectors are detected and corrected at the end of each pass. Simulation results with respect to dif...
Multi Camera Visual Surveillance for Motion Detection Occlusion Handling Tracking and Event Recognition Akman, Oytun; Alatan, Abdullah Aydın; Çiloğlu, Tolga (null; 2008-10-05) This paper presents novel approaches for background modeling, occlusion handling and event recognition by using multi-camera configurations that can be used to overcome the limitations of the single camera configurations. The main novelty in proposed background modeling approach is building multivariate Gaussians background model for each pixel of the reference camera by utilizing homography-related positions. Also, occlusion handling is achieved by generation of the top-view via trifocal tensors, as a resu...

Citation Formats

Y. BAŞTANLAR, A. Temizel, Y. Yardimci, and P. Sturm, “Multi-view structure-from-motion for hybrid camera scenarios,” IMAGE AND VISION COMPUTING, pp. 557–572, 2012, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/31121.