Semantic Annotation of Surveillance Videos for Abnormal Crowd Behaviour Search and Analysis

2017-09-01
Sah, Melike
Direkoglu, Cem
Monitoring videos captured by surveillance cameras is a very difficult and time consuming task. There is a need for automated analysis using computer vision methods in order to recognize abnormal human behaviors and assist authorities. On the other hand, crowd (group of people) behavior analysis is a new direction of research, which can be utilized for automatic detection of panic in crowds. Once, videos are processed using computer vision technologies, another problem is how this data is indexed for search and analysis, since cameras continuously capture videos resulting vast amounts of data. Oftentimes various techniques are used for indexing, storage and access of video surveillance information, which makes global analysis and search on this data very difficult. In this paper, we introduce a novel semantic metadata model based on multimedia standards to extract and annotate globally inter-operable data about abnormal crowd behaviors from surveillance videos. We demonstrate on UMN and PETS2009 datasets that generated semantic annotations enable detailed searching and analysis of abnormal crowd behaviors with complex queries.

Suggestions

A novel framework and concept-based semantic search Interface for abnormal crowd behaviour analysis in surveillance videos
Hatirnaz, Eren; Sah, Melike; Direkoglu, Cem (Springer Science and Business Media LLC, 2020-02-20)
Monitoring continuously captured surveillance videos is a challenging and time consuming task. To assist this issue, a new framework is introduced that applies anomaly detection, semantic annotation and provides a concept-based search interface. In particular, novel optical flow based features are used for abnormal crowd behaviour detection. Then, processed surveillance videos are annotated using a new semantic metadata model based on multimedia standards using Semantic Web technologies. In this way, global...
Mean-Shift Tracking for Surveillance Applications Using Thermal and Visible Band Data Fusion
Beyan, Cigdem; Temizel, Alptekin (2011-04-28)
Separate tracking of objects such as people and the luggages they carry is important for video surveillance applications as it would allow making higher level inferences and timely detection of potential threats. However, this is a challenging problem and in the literature, people and objects they carry are tracked as a single object. In this study, we propose using thermal imagery in addition to the visible band imagery for tracking in indoor applications (such as airports, metro or railway stations). We u...
Object tracking system with seamless object handover between stationary and moving camera modes
Emeksiz, Deniz; Temizel, Alptekin; Department of Information Systems (2012)
As the number of surveillance cameras and mobile platforms with cameras increases, automated detection and tracking of objects on these systems gain importance. There are various tracking methods designed for stationary or moving cameras. For stationary cameras, correspondence based tracking methods along with background subtraction have various advantages such as enabling detection of object entry and exit in a scene. They also provide robust tracking when the camera is static. However, they fail when the ...
Analysis and comparison of the contrast enhancement techniques for infrared images
Turan, Arif Ergün; Akar, Gözde; Department of Electrical and Electronics Engineering (2012)
Today, infrared cameras are used especially for target tracking and surveillance operations. However, they have a high dynamic range output, and the standard display devices cannot handle them. In order to show them on common devices, the dynamic range is cropped. Thus, the contrast of the image is reduced. This is called as the High Dynamic Range (HDR) Compression. Although several algorithms have been proposed for preserving details during the HDR compression process, it cannot be used to enhance the loca...
A Reliable and Reversible Image Privacy Protection Based on False Colors
ÇİFTÇİ, Serdar; Akyüz, Ahmet Oğuz; Ebrahimi, Touradj (2018-01-01)
Protection of visual privacy has become an indispensable component of video surveillance systems due to pervasive use of video cameras for surveillance purposes. In this paper, we propose two fully reversible privacy protection schemes implemented within the JPEG architecture. In both schemes, privacy protection is accomplished by using false colors with the first scheme being adaptable to other privacy protection filters while the second is false color-specific. Both schemes support either a lossless mode ...
Citation Formats
M. Sah and C. Direkoglu, “Semantic Annotation of Surveillance Videos for Abnormal Crowd Behaviour Search and Analysis,” 2017, p. 0, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/65652.