Prioritized sequential 3D reconstruction in video sequences with multiple motions

2006-10-11
Imre, Evren
Knorr, Sebastian
Alatan, Abdullah Aydın
Sikora, Thomas
in this study, an algorithm is proposed to solve the multi-frame structure from motion (MFSfM) problem for monocular video sequences in dynamic scenes. The algorithm uses the epipolar criterion to segment the features belonging to independently moving objects. Once the features are segmented, corresponding objects are reconstructed individually by using a sequential algorithm, which is also capable of prioritizing the frame pairs with respect to their reliability and information content, thus achieving a fast and accurate reconstruction through efficient processing of the available data. A tracker is utilized to increase the baseline distance between views and to improve the F-matrix estimation, which is beneficial to both the segmentation and the 3D structure estimation processes. The experimental results demonstrate that our approach has the potential to effectively deal with the multi-body MFSfM problem in a generic video sequence.

Suggestions

Prioritized sequential 3D reconstruction in video sequences of dynamic scenes degrees
Imre, Evren; Alatan, Abdullah Aydın; Knorr, Sebastian; Sikora, Thomas (2006-04-19)
In this study, an algorithm is proposed to solve the multiframe structure from motion (MFSfM) problem for monocular video sequences in dynamic scenes. The algorithm uses the epipolar criterion to segment the features belonging to the independently moving objects. Once the features are segmented, the corresponding objects are reconstructed individually by using a sequential algorithm, which is also capable prioritizing the frame pairs with respect to their reliability and information content, thus achieving ...
Motion estimation using complex discrete wavelet transform
Sarı, Hüseyin; Severcan, Mete; Department of Electrical and Electronics Engineering (2003)
The estimation of optical flow has become a vital research field in image sequence analysis especially in past two decades, which found applications in many fields such as stereo optics, video compression, robotics and computer vision. In this thesis, the complex wavelet based algorithm for the estimation of optical flow developed by Magarey and Kingsbury is implemented and investigated. The algorithm is based on a complex version of the discrete wavelet transform (CDWT), which analyzes an image through blo...
Alignment of uncalibrated images for multi-view classification
Arık, Sercan Ömer; Vural, Elif; Frossard, Pascal (2011-12-29)
Efficient solutions for the classification of multi-view images can be built on graph-based algorithms when little information is known about the scene or cameras. Such methods typically require a pairwise similarity measure between images, where a common choice is the Euclidean distance. However, the accuracy of the Euclidean distance as a similarity measure is restricted to cases where images are captured from nearby viewpoints. In settings with large transformations and viewpoint changes, alignment of im...
Superpixel based image sequence representation and motion estimation
İnce, Kutalmış Gökalp; Alatan, Abdullah Aydın; Demirekler, Mübeccel; Department of Electrical and Electronics Engineering (2017)
In this study a superpixel based representation of image sequences is proposed. For superpixel extraction, a novel gradient ascent approach, in which spatial and spectral statistics are utilized to obtain an optimal Bayesian classifier for pixel to superpixel label assignment, is proposed. Utilization of the spectral and spatial statistics reduce the dependency on user selected global parameters, while increasing the robustness and adaptability. Proposed Local Adaptive Superpixels (LASP) approach exploits he...
Shape : representation, description, similarity and recognition
Arıca, Nafiz; Yarman Vural, Fatoş Tunay; Department of Computer Engineering (2003)
In this thesis, we study the shape analysis problem and propose new methods for shape description, similarity and recognition. Firstly, we introduce a new shape descriptor in a two-step method. In the first step, the 2-D shape information is mapped into a set of 1-D functions. The mapping is based on the beams, which are originated from a boundary point, connecting that point with the rest of the points on the boundary. At each point, the angle between a pair of beams is taken as a random variable to define...
Citation Formats
E. Imre, S. Knorr, A. A. Alatan, and T. Sikora, “Prioritized sequential 3D reconstruction in video sequences with multiple motions,” 2006, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/40986.