3D hand tracking in video sequences

Download
2005
Tokatlı, Aykut
The use of hand gestures provides an attractive alternative to cumbersome interface devices such as keyboard, mouse, joystick, etc. Hand tracking has a great potential as a tool for better human-computer interaction by means of communication in a more natural and articulate way. This has motivated a very active research area concerned with computer vision-based analysis and interpretation of hand gestures and hand tracking. In this study, a real-time hand tracking system is developed. Mainly, it is image-based hand tracking and based on 2D image information. For separation and identification of finger parts, coloured markers are used. In order to obtain 3D tracking, a stereo vision approach is used where third dimension is obtained by depth information. In order to see results in 3D, a 3D hand model is developed and Java 3D is used as the 3D environment. Tracking is tested on two different types of camera: a cheap USB web camera and Sony FCB-IX47AP camera, connected to the Matrox Meteor frame grabber with a standard Intel Pentium based personal computer. Coding is done by Borland C++ Builder 6.0 and Intel Image Processing and Open Source Computer Vision (OpenCV) library are used as well. For both camera types, tracking is found to be robust and efficient where hand tracking at ~8 fps could be achieved. Although the current progress is encouraging, further theoretical as well as computational advances are needed for this highly complex task of hand tracking.

Suggestions

Hardware implementation of an active feature tracker for surveillance applications
Solmaz, Berkan; Akar, Gözde; Department of Electrical and Electronics Engineering (2008)
The integration of image sensors and high performance processors into embedded systems enabled the development of intelligent vision systems. In this thesis, we developed an active autonomous system to be used for surveillance applications. The proposed system detects a single moving object in the field of view automatically and tracks it in a wide area by controlling the pan-tilt-zoom features of the camera. The system can also go to an alarm state to warn the user. The processing unit of the system is a T...
Design and implementation of a fixed point digital active noise controller headphone
Erkan, Fatih; Çiloğlu, Tolga; Department of Electrical and Electronics Engineering (2009)
In this thesis, the design and implementation of a Portable Feedback Active Noise Controller Headphone System, which is based on Texas Instruments TMS320VC5416PGE120 Fixed Point DSP, is described. Problems resulted from fixed-point implementation of LMS algorithm and delays existing in digital ANC implementation are determined. Effective solutions to overcome the aforementioned problems are proposed based on the literature survey. Design of the DSP based control card is explained and crucial points about an...
Hand gesture recognition system
Gingir, Emrah; Bulut, Mehmet Mete; Akar, Gözde; Department of Electrical and Electronics Engineering (2010)
This thesis study presents a hand gesture recognition system, which replaces input devices like keyboard and mouse with static and dynamic hand gestures, for interactive computer applications. Despite the increase in the attention of such systems there are still certain limitations in literature. Most applications require different constraints like having distinct lightning conditions, usage of a specific camera, making the user wear a multi-colored glove or need lots of training data. The system mentioned ...
Modelling and noise analysis of closed-loop capacitive sigma-delta mems accelerometer
Boğa, Biter; Külah, Haluk; Department of Electrical and Electronics Engineering (2009)
This thesis presents a detailed SIMULINK model for a conventional capacitive Σ-Δ accelerometer system consisting of a MEMS accelerometer, closed-loop readout electronics, and signal processing units (e.g. decimation filters). By using this model, it is possible to estimate the performance of the full accelerometer system including individual noise components, operation range, open loop sensitivity, scale factor, etc. The developed model has been verified through test results using a capacitive MEMS accelero...
Collaborative mobile target imaging in ultra-wideband wireless radar sensor networks
Arık, Muharrem; Akan, Özgür Barış; Department of Electrical and Electronics Engineering (2008)
Wireless sensor networks (WSN) have thus far been used for detection and tracking of static and mobile targets for surveillance and security applications. However, detection and tracking do not suffice for a complete satisfaction of these applications and an accurate target classification. To address this need, among various target classification methods, imaging of target yields the most valuable information. Nevertheless, imaging of mobile targets moving over an area requires networked and collaborative d...
Citation Formats
A. Tokatlı, “3D hand tracking in video sequences,” M.S. - Master of Science, Middle East Technical University, 2005.