Efficient calibration of a multi-camera measurement system using a target with known dynamics

Aykın, Murat Deniz
Multi camera measurement systems are widely used to extract information about the 3D configuration or “state” of one or more real world objects. Camera calibration is the process of pre-determining all the remaining optical and geometric parameters of the measurement system which are either static or slowly varying. For a single camera, this consist of the internal parameters of the camera device optics and construction while for a multiple camera system, it also includes the geometric positioning of the individual cameras, namely “external” parameters. The calibration is a necessary step before any actual state measurements can be made from the system. In this thesis, such a multi-camera state measurement system and in particular the problem of procedurally effective and high performance calibration of such a system is considered. This thesis presents a novel calibration algorithm which uses the known dynamics of a ballistically thrown target object and employs the Extended Kalman Filter (EKF) to calibrate the multi-camera system. The state-space representation of the target state is augmented with the unknown calibration parameters which are assumed to be static or slowly varying with respect to the state. This results in a “super-state” vector. The EKF algorithm is used to recursively estimate this super-state hence resulting in the estimates of the static camera parameters. It is demonstrated by both simulation studies as well as actual experiments that when the ballistic path of the target is processed by the improved versions of the EKF algorithm, the camera calibration parameter estimates asymptotically converge to their actual values. Since the image frames of the target trajectory can be acquired first and then processed off-line, subsequent improvements of the EKF algorithm include repeated and bidirectional versions where the same calibration images are repeatedly used. Repeated EKF (R-EKF) provides convergence with a limited number of image frames when the initial target state is accurately provided while its bidirectional version (RB-EKF) improves calibration accuracy by also estimating the initial target state. The primary contribution of the approach is that it provides a fast calibration procedure where there is no need for any standard or custom made calibration target plates covering the majority of camera field-of-view. Also, human assistance is minimized since all frame data is processed automatically and assistance is limited to making the target throws. The speed of convergence and accuracy of the results promise a field-applicable calibration procedure.


Video stabilization: digital and mechanical approaches
Bayrak, Serhat; Ulusoy, İlkay; Department of Electrical and Electronics Engineering (2008)
General video stabilization techniques which are digital, mechanical and optical are discussed. Under the concept of video stabilization, various digital motion estimation and motion correction algorithms are implemented. For motion estimation, in addition to digital approach, a mechanical approach is implemented also. Then all implemented motion estimation and motion correction algorithms are compared with respect to their computational times and accuracies over various videos. For small amount of jitter, ...
An FPGA implementation of real-time electro-optic & IR image fusion
Çölova, İbrahim Melih; Akar, Gözde; Department of Electrical and Electronics Engineering (2010)
In this thesis, a modified 2D Discrete Cosine Transform based electro-optic and IR image fusion algorithm is proposed and implemented on an FPGA platform. The platform is a custom FPGA board which uses ALTERA Stratix III family FPGA. The algorithm is also compared with state of the art image fusion algorithms by means of an image fusion software application GUI developed in Matlab®. The proposed algorithm principally takes corresponding 4x4 pixel blocks of two images to be fused and transforms them by means...
Automatic eye tracking and intermediate view reconstruction for 3D imaging systems
Bediz, Yusuf; Akar, Gözde; Department of Electrical and Electronics Engineering (2006)
In recent years, the utilization of 3D display systems became popular in many application areas. One of the most important issues in the utilization of these systems is to render the correct view to the observer based on his/her position. In this thesis, we propose and implement a single user view rendering system for autostereoscopic/stereoscopic displays. The system can easily be installed on a standard PC together with an autostereoscopic display or stereoscopic glasses (shutter, polarized, pulfrich, and...
Frequency invariant beamforming and its application to wideband direction of arrival estimation
Babataş, Eren; Candan, Çağatay; Department of Electrical and Electronics Engineering (2008)
In this thesis the direction of arrival estimation of wideband signals using frequency invariant beamforming method is examined. The difficulty with the direction of arrival estimation of wideband signals is that it is not possible to obtain a single covariance matrix valid for the whole frequency spectrum of the signal. There are various methods proposed in the literature to overcome this difficulty. The common aim of all the methods is to obtain a composite covariance matrix for the overall band of the si...
3d geometric hashing using transform invariant features
Eskizara, Ömer; Ulusoy, İlkay; Department of Electrical and Electronics Engineering (2009)
3D object recognition is performed by using geometric hashing where transformation and scale invariant 3D surface features are utilized. 3D features are extracted from object surfaces after a scale space search where size of each feature is also estimated. Scale space is constructed based on orientation invariant surface curvature values which classify each surface point's shape. Extracted features are grouped into triplets and orientation invariant descriptors are defined for each triplet. Each pose of eac...
Citation Formats
M. D. Aykın, “Efficient calibration of a multi-camera measurement system using a target with known dynamics,” M.S. - Master of Science, Middle East Technical University, 2008.