Kalman filter based fusion of camera and inertial sensor measurements for body state estimation

Aslan Aydemir, Gökçen
The focus of the present thesis is on the joint use of cameras and inertial sensors, a recent area of active research. Within our scope, the performance of body state estimation is investigated with isolated inertial sensors, isolated cameras and finally with a fusion of two types of sensors within a Kalman Filtering framework. The study consists of both simulation and real hardware experiments. The body state estimation problem is restricted to a single axis rotation where we estimate turn angle and turn rate. This experimental setup provides a simple but effective means of assessing the benefits of the fusion process. Additionally, a sensitivity analysis is carried out in our simulation experiments to explore the sensitivity of the estimation performance to varying levels of calibration errors. It is shown by experiments that state estimation is more robust to calibration errors when the sensors are used jointly. For the fusion of sensors, the Indirect Kalman Filter is considered as well as the Direct Form Kalman Filter. This comparative study allows us to assess the contribution of an accurate system dynamical model to the final state estimates. Our simulation and real hardware experiments effectively show that the fusion of the sensors eliminate the unbounded error growth characteristic of inertial sensors while final state estimation outperforms the use of cameras alone. Overall we can v demonstrate that the Kalman based fusion result in bounded error, high performance estimation of body state. The results are promising and suggest that these benefits can be extended to body state estimation for multiple degrees of freedom.


Sensorless vector control of induction motor based on flux and speed estimation
Ertuğrul, Barış Tuğrul; Ersak, Aydın; Department of Electrical and Electronics Engineering (2008)
The main focus of the study is the implementation of techniques regarding flux estimation and rotor speed estimation by the use of sensorless closed-loop observers. Within this framework, the information about the mathematical representation of the induction motor, pulse width modulation technique and flux oriented vector control techniques together with speed adaptive flux estimation a kind of sensorless closed loop estimation technique- and Kalman filters is given. With the comparison of sensorless closed...
Parameter extraction and image enhancement for catadioptric omnidirectional cameras
Baştanlar, Yalın; Çetin, Yasemin; Department of Information Systems (2005)
In this thesis, catadioptric omnidirectional imaging systems are analyzed in detail. Omnidirectional image (ODI) formation characteristics of different camera-mirror configurations are examined and geometrical relations for panoramic and perspective image generation with common mirror types are summarized. A method is developed to determine the unknown parameters of a hyperboloidal-mirrored system using the world coordinates of a set of points and their corresponding image points on the ODI. A linear relati...
Kalman filtering based approach for light flicker evaluation of power systems
Kose, N.; Salor, O.; Leblebicioğlu, Mehmet Kemal (Institution of Engineering and Technology (IET), 2011-01-01)
In this study, a Kalman filtering based approach is proposed to measure the light flicker of the electricity transmission systems. Analytical expressions of the instantaneous light flicker sensation are used to obtain a flicker estimation method based on the International Electrotechnical Commission (IEC) flickermeter. In the proposed method, the frequency domain components of the voltage waveform are obtained by Kalman filtering and these components are used to obtain the light flicker. The method is teste...
Sensitivity and error analysis of a differential rectification method for CCD frame cameras and pushbroom scanners
Bettemir, Önder Halis; Karslıoğlu, Mahmut Onur; Department of Civil Engineering (2006)
In this thesis, sensitivity and error analysis of a differential rectification method were performed by using digital images taken by a frame camera onboard BILSAT and pushbroom scanner on ASTER. Three methods were implemented for Sensitivity and Uncertainty analysis: Monte Carlo, covariance analysis and FAST (Fourier Amplitude Sensitivity Test). A parameter estimation procedure was carried out on the basis of so called Mixed Model extended by some suitable additional regularization parameters to stabilize ...
Visual detection and tracking of moving objects
Ergezer, Hamza; Leblebicioğlu, Mehmet Kemal; Department of Electrical and Electronics Engineering (2007)
In this study, primary steps of a visual surveillance system are presented: moving object detection and tracking of these moving objects. Background subtraction has been performed to detect the moving objects in the video, which has been taken from a static camera. Four methods, frame differencing, running (moving) average, eigenbackground subtraction and mixture of Gaussians, have been used in the background subtraction process. After background subtraction, using some additional operations, such as morpho...
Citation Formats
G. Aslan Aydemir, “Kalman filter based fusion of camera and inertial sensor measurements for body state estimation,” M.S. - Master of Science, Middle East Technical University, 2009.