LEARNING COMPLEX EVENT MODELS USING MARKOV LOGIC NETWORKS

2013-07-19
Kardas, Karani
Ulusoy, İlkay
Cicekli, Nihan Kesim
An event model learning framework is proposed for indoor and outdoor surveillance applications in order to decrease human intervention in the modeling process. The resulting framework makes event detection and recognition flexible, domain and scene independent. A set of predicate types is introduced which define basic spatio-temporal relations and interactions between objects and people in the videos. A set of policies to choose the appropriate predicates is proposed for the event learning process. First, the video data is converted to a set of Markov Logic Network (MLN) predicates. Then, these policies, together with the discriminative weight learning algorithm, are used to infer the relevance of the predicates to the events being queried. Finally, the event model is generated. The proposed framework is applied to the generation of three different event models from CANTATA and our datasets. In particular, model generation for left object event is discussed in detail.
IEEE International Conference on Multimedia and Expo Workshops (ICMEW)

Suggestions

Multi-modal video event recognition based on association rules and decision fusion
Guder, Mennan; Çiçekli, Fehime Nihan (2018-02-01)
In this paper, we propose a multi-modal event recognition framework based on the integration of feature fusion, deep learning, scene classification and decision fusion. Frames, shots, and scenes are identified through the video decomposition process. Events are modeled utilizing features of and relations between the physical video parts. Event modeling is achieved through visual concept learning, scene segmentation and association rule mining. Visual concept learning is employed to reveal the semantic gap b...
Multimedia data modeling and semantic analysis by multimodal decision fusion
Güder, Mennan; Çiçekli, Fehime Nihan; Department of Computer Engineering (2015)
In this thesis, we propose a multi-modal event recognition framework based on the integration of event modeling, fusion, deep learning and, association rule mining. Event modeling is achieved through visual concept learning, scene segmentation and association rule mining. Visual concept learning is employed to reveal the semantic gap between the visual content and the textual descriptors of the events. Association rules are discovered by a specialized association rule mining algorithm where the proposed str...
A FRAMEWORK FOR DETECTING COMPLEX EVENTS IN SURVEILLANCE VIDEOS
Onal, Itir; Kardas, Karani; Rezaeitabar, Yousef; Bayram, Ulya; Bal, Murat; Ulusoy, İlkay; Cicekli, Nihan Kesim (2013-07-19)
This paper presents a framework for detecting complex events in surveillance videos. Moving objects in the foreground are detected in the object detection component of the system. Whether these foregrounds are human or not is decided in the object recognition component. Then each detected object is tracked and labeled in the object tracking component, in which true labeling of objects in the occlusion situation is also provided. The extracted information is fed to the event detection component. Rule based e...
Hierarchical multitasking control of discrete event systems: Computation of projections and maximal permissiveness
Schmidt, Klaus Verner; Cury, José E.r. (null; 2010-12-01)
This paper extends previous results on the hierarchical and decentralized control of multitasking discrete event systems (MTDES). Colored observers, a generalization of the observer property, together with local control consistency, allow to derive sufficient conditions for synthesizing modular and hierarchical control that are both strongly nonblocking (SNB) and maximally permissive. A polynomial procedure to verify if a projection fulfills the above properties is proposed and in the case they fail for a g...
Supervisory control and formal methods for distributed systems
İnan, Kemal (1992-08-28)
A brief introductory exposure for logical discrete event system models is presented. Based on a specific version of this model tailored to supervisory control, some of the mainstream supervisory control problems are formulated in a unified framework. Formal methods used in software engineering has certain computational and structural similarities to supervisory control and unlike the latter, is closely connected to realistic and widespread practical applications. Formal specification, verification, impleme...
Citation Formats
K. Kardas, İ. Ulusoy, and N. K. Cicekli, “LEARNING COMPLEX EVENT MODELS USING MARKOV LOGIC NETWORKS,” presented at the IEEE International Conference on Multimedia and Expo Workshops (ICMEW), San Jose, CA, 2013, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/53113.