SVAS: Surveillance Video Analysis System

Date

2017-12-15

Author

Kardas, Karani
Çiçekli, Fehime Nihan

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

178
views

0
downloads

This paper introduces a Surveillance Video Analysis System, called SVAS, for surveillance domain, in which the semantic rules and the definition of event models can be learned or defined by the user for automatic detection and inference of complex video events. In the scope of SVAS, an event model method named Interval-Based Spatio-Temporal Model (IBSTM) is proposed. SVAS can learn action models and event models without any predefined threshold values and generates understandable and manageable IBSTM event models. Hybrid machine learning methods are proposed and used. A set of feature models named Threshold Model, which reflects the spatio-temporal motion analysis of an event, is kept as the first model. As the second model, Bag of Actions (BoA) model is used in order to reduce the search space in the detection phase. Markov Logic Network (MLN) model, which provides understandable and manageable logic predicates for users, is kept as the third model. SVAS has high performance event detection capability due to its interval-based hierarchical manner. It determines related candidate intervals for each main model of IBSTM and uses the related main model when needed rather than using all models as a whole. The main contribution of this study is to fill the semantic gap between humans and video computer systems such that, on the one hand it decreases human intervention through its learning capabilities, but on the other hand it also enables human intervention when necessary through its manageable event model method. The study achieves all of them in the most efficient way through its machine learning methods. The proposed system is applied to different event datasets from CAVIAR, BEHAVE and our synthetic datasets. The experimental results show that our approach improves the event recognition performance and precision as compared to the current state-of-the-art approaches.

Subject Keywords

Event detection, Markov logic networks, Video surveillance, Event model learning, Event inference

URI

https://hdl.handle.net/11511/62570

Journal

EXPERT SYSTEMS WITH APPLICATIONS

DOI

https://doi.org/10.1016/j.eswa.2017.07.051

Collections

Department of Computer Engineering, Article

Suggestions

OpenMETU
Core

A FRAMEWORK FOR DETECTING COMPLEX EVENTS IN SURVEILLANCE VIDEOS Onal, Itir; Kardas, Karani; Rezaeitabar, Yousef; Bayram, Ulya; Bal, Murat; Ulusoy, İlkay; Cicekli, Nihan Kesim (2013-07-19) This paper presents a framework for detecting complex events in surveillance videos. Moving objects in the foreground are detected in the object detection component of the system. Whether these foregrounds are human or not is decided in the object recognition component. Then each detected object is tracked and labeled in the object tracking component, in which true labeling of objects in the occlusion situation is also provided. The extracted information is fed to the event detection component. Rule based e...
LEARNING COMPLEX EVENT MODELS USING MARKOV LOGIC NETWORKS Kardas, Karani; Ulusoy, İlkay; Cicekli, Nihan Kesim (2013-07-19) An event model learning framework is proposed for indoor and outdoor surveillance applications in order to decrease human intervention in the modeling process. The resulting framework makes event detection and recognition flexible, domain and scene independent. A set of predicate types is introduced which define basic spatio-temporal relations and interactions between objects and people in the videos. A set of policies to choose the appropriate predicates is proposed for the event learning process. First, t...
Hierarchical multitasking control of discrete event systems: Computation of projections and maximal permissiveness Schmidt, Klaus Verner; Cury, José E.r. (null; 2010-12-01) This paper extends previous results on the hierarchical and decentralized control of multitasking discrete event systems (MTDES). Colored observers, a generalization of the observer property, together with local control consistency, allow to derive sufficient conditions for synthesizing modular and hierarchical control that are both strongly nonblocking (SNB) and maximally permissive. A polynomial procedure to verify if a projection fulfills the above properties is proposed and in the case they fail for a g...
DENSITY ESTIMATION IN CROWD VIDEOS Gunduz, Ayse Elvan; Taşkaya Temizel, Tuğba; Temizel, Alptekin (2014-04-25) In crowd surveillance systems, it is important to select the proper analysis algorithm considering the properties of the video content. The inappropriate algorithm selection may result in performance degradation and generation of false alarms. An important feature of crowd videos is the density of the crowd. While object detection and tracking based algorithms are feasible for low density crowds, holistic approaches are preferable for high density crowds. In this paper, we studied the problem of crowd densi...
Controller synthesis for an I/O-based hierarchical system architecture Perk, Sebastian; Moor, Thomas; Schmidt, Klaus Verner (2008-10-08) In our previous work, a framework for the hierarchical design of discrete event systems has been introduced that is based on a notion of inputs and outputs. I/O-plant models describe the interaction of each subsystem with the operator (or controller) and the environment. By alternation of subsystem composition and controller synthesis, a hierarchy of controllers is obtained that complements a hierarchy of environment models. An admissibility condition was presented that implies liveness while allowing for a...

Citation Formats

K. Kardas and F. N. Çiçekli, “SVAS: Surveillance Video Analysis System,” EXPERT SYSTEMS WITH APPLICATIONS, pp. 343–361, 2017, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/62570.