Efficient calibration of a multi-camera measurement system using a target with known dynamics

Download
2008
Aykın, Murat Deniz
Multi camera measurement systems are widely used to extract information about the 3D configuration or “state” of one or more real world objects. Camera calibration is the process of pre-determining all the remaining optical and geometric parameters of the measurement system which are either static or slowly varying. For a single camera, this consist of the internal parameters of the camera device optics and construction while for a multiple camera system, it also includes the geometric positioning of the individual cameras, namely “external” parameters. The calibration is a necessary step before any actual state measurements can be made from the system. In this thesis, such a multi-camera state measurement system and in particular the problem of procedurally effective and high performance calibration of such a system is considered. This thesis presents a novel calibration algorithm which uses the known dynamics of a ballistically thrown target object and employs the Extended Kalman Filter (EKF) to calibrate the multi-camera system. The state-space representation of the target state is augmented with the unknown calibration parameters which are assumed to be static or slowly varying with respect to the state. This results in a “super-state” vector. The EKF algorithm is used to recursively estimate this super-state hence resulting in the estimates of the static camera parameters. It is demonstrated by both simulation studies as well as actual experiments that when the ballistic path of the target is processed by the improved versions of the EKF algorithm, the camera calibration parameter estimates asymptotically converge to their actual values. Since the image frames of the target trajectory can be acquired first and then processed off-line, subsequent improvements of the EKF algorithm include repeated and bidirectional versions where the same calibration images are repeatedly used. Repeated EKF (R-EKF) provides convergence with a limited number of image frames when the initial target state is accurately provided while its bidirectional version (RB-EKF) improves calibration accuracy by also estimating the initial target state. The primary contribution of the approach is that it provides a fast calibration procedure where there is no need for any standard or custom made calibration target plates covering the majority of camera field-of-view. Also, human assistance is minimized since all frame data is processed automatically and assistance is limited to making the target throws. The speed of convergence and accuracy of the results promise a field-applicable calibration procedure.

Suggestions

An FPGA implementation of real-time electro-optic & IR image fusion
Çölova, İbrahim Melih; Akar, Gözde; Department of Electrical and Electronics Engineering (2010)
In this thesis, a modified 2D Discrete Cosine Transform based electro-optic and IR image fusion algorithm is proposed and implemented on an FPGA platform. The platform is a custom FPGA board which uses ALTERA Stratix III family FPGA. The algorithm is also compared with state of the art image fusion algorithms by means of an image fusion software application GUI developed in Matlab®. The proposed algorithm principally takes corresponding 4x4 pixel blocks of two images to be fused and transforms them by means...
3d geometric hashing using transform invariant features
Eskizara, Ömer; Ulusoy, İlkay; Department of Electrical and Electronics Engineering (2009)
3D object recognition is performed by using geometric hashing where transformation and scale invariant 3D surface features are utilized. 3D features are extracted from object surfaces after a scale space search where size of each feature is also estimated. Scale space is constructed based on orientation invariant surface curvature values which classify each surface point's shape. Extracted features are grouped into triplets and orientation invariant descriptors are defined for each triplet. Each pose of eac...
Traffic sign recognition for unmanned vehicle control
Havur, Mehmet Bülent; Bulut, Mehmet Mete; Department of Electrical and Electronics Engineering (2006)
In this thesis, video frames acquired by a camera in a moving car are processed for detection of candidates of triangular, rectangular and circular traffic/road signs based on mainly shape information by performing contour analysis. Color information is utilized as an auxiliary method to improve detection. Then recognition based on template matching is realized on detected traffic/road sign candidates. Detection and recognition results of traffic/road signs in video frames taken in different time intervals ...
3d object recognition by geometric hashing for robotics applications
Hozatlı, Aykut; Ulusoy, İlkay; Department of Electrical and Electronics Engineering (2009)
The main aim of 3D Object recognition is to recognize objects under translation and rotation. Geometric Hashing is one of the methods which represents a rotation and translation invariant approach and provides indexing of structural features of the objects in an efficient way. In this thesis, Geometric Hashing is used to store the geometric relationship between discriminative surface properties which are based on surface curvature. In this thesis surface is represented by shape index and splash where shape ...
Fast intra/inter mode decision for a real-time H.264 streaming system
Alay, Özgü; Akar, Gözde; Department of Electrical and Electronics Engineering (2006)
Video compression is a key technology used in several multimedia applications. Improvements in the compression techniques together with the increasing speed and optimized architecture of the new family processors enable us to use this technology more in real time systems. H.264 (also known as MPEG-4 Part 10 or AVC - Advanced Video Coding), is the latest video coding standard which is noted for achieving very high data compression. While H.264 is superior to its predecessors, it has a very high computational...
Citation Formats
M. D. Aykın, “Efficient calibration of a multi-camera measurement system using a target with known dynamics,” M.S. - Master of Science, Middle East Technical University, 2008.