Object tracking system with seamless object handover between stationary and moving camera modes

Download
2012
Emeksiz, Deniz
As the number of surveillance cameras and mobile platforms with cameras increases, automated detection and tracking of objects on these systems gain importance. There are various tracking methods designed for stationary or moving cameras. For stationary cameras, correspondence based tracking methods along with background subtraction have various advantages such as enabling detection of object entry and exit in a scene. They also provide robust tracking when the camera is static. However, they fail when the camera is moving. Conversely, histogram based methods such as mean shift enables object tracking on moving camera cases. Though, with mean shift object’s entry and exit cannot be detected automatically which means a new object’s manual initialization is required. In this thesis, we propose a dual-mode object tracking system which combines the benefits of correspondence based tracking and mean shift tracking. For each frame, a reliability measure based on background update rate is calculated. Interquartile Range is used for finding outliers on this measure and camera movement is detected. If the camera is stationary, correspondence based tracking is used and when camera is moving, the system switches to the mean shift tracking mode until the reliability of correspondence based tracking is sufficient according to the reliability measure. The results demonstrate that, in stationary camera mode, new objects can be detected automatically by correspondence based tracking along with background subtraction. When the camera starts to move, generation of false objects by correspondence based tracking is prevented by switching to mean shift tracking mode and handing over the correct bounding boxes with a seamless operation which enables continuous tracking.

Suggestions

A continuous object tracking system with stationary and moving camera modes
Emeksiz, Deniz; Temizel, Alptekin (2012-09-27)
Automatic detection and tracking of objects get more important with the increasing number of surveillance cameras and mobile platforms having cameras. Tracking systems are either designed with stationary camera or designed to work in moving camera. When the camera is stationary, correspondence based tracking with background subtraction has a number of benefits such as enabling automatic detection of new objects in the scene and better tracking accuracy. On the other hand, mean shift is a histogram-based tra...
Mean-Shift Tracking for Surveillance Applications Using Thermal and Visible Band Data Fusion
Beyan, Cigdem; Temizel, Alptekin (2011-04-28)
Separate tracking of objects such as people and the luggages they carry is important for video surveillance applications as it would allow making higher level inferences and timely detection of potential threats. However, this is a challenging problem and in the literature, people and objects they carry are tracked as a single object. In this study, we propose using thermal imagery in addition to the visible band imagery for tracking in indoor applications (such as airports, metro or railway stations). We u...
Evaluation of deep learning based multiple object trackers
Moured, Omar; Akar, Gözde; Department of Electrical and Electronics Engineering (2020-9)
Multiple object tracking (MOT) is a significant problem in the computer vision community due to its applications, including but not limited to, surveillance and emerging autonomous vehicles. The difficulties of this problem lie in several challenges, such as frequent occlusion, interaction, intra-class variations, in-and-out objects, etc. Recently, deep learning MOT methods confront these challenges effectively. State-of-the-art deep learning (DL) trackers pipeline consists of two stages, i.e., appearance h...
Object tracking for surveillance applications using thermal and visible band video data fusion
Beyan, Çiğdem; Temizel, Alptekin; Department of Information Systems (2010)
Individual tracking of objects in the video such as people and the luggages they carry is important for surveillance applications as it would enable deduction of higher level information and timely detection of potential threats. However, this is a challenging problem and many studies in the literature track people and the belongings as a single object. In this thesis, we propose using thermal band video data in addition to the visible band video data for tracking people and their belongings separately for ...
Visual detection and tracking of moving objects
Ergezer, Hamza; Leblebicioğlu, Mehmet Kemal (2007-06-13)
In this paper, primary steps of a visual surveillance system are presented: moving object detection and tracking of these moving objects. Running average method has been used to detect the moving objects in the video, which is taken from a static camera. Tracking of foreground objects has been realized by using a Kalman filter. After background subtraction, morphological operators are used to remove noises detected as foreground. Active contour models (snakes) are the segmentation tools for the extracted fo...
Citation Formats
D. Emeksiz, “Object tracking system with seamless object handover between stationary and moving camera modes,” M.S. - Master of Science, Middle East Technical University, 2012.