Low-level motion activity features for semantic characterization of video

2000-01-01
Peker, KA
Alatan, Abdullah Aydın
Akansu, AN
Efficient methods of content characterization for the browsing, retrieval or filtering of vast amount of digital video content has become a necessity. Still, there is a gap between the computationally available measures of content characteristics and the semantic interpretations of these characteristics. We want to establish connections between motion activity characteristics of video segments and the semantic characterization of them. For this purpose, two simple descriptors for motion activity of a video content is used to infer high-level semantic features of video in certain contexts. One of these descriptors, monotonous activity, is defined as the average block-based motion vector magnitude. The second descriptor, non-monotonous activity, is an approximation to the average temporal derivative of motion vectors. Simulation results for browsing and retrieval applications show that by using the two measures together, object motions that occur close to the camera can be distinguished from distant ones. Also by using the two descriptors together, we are able to differentiate between a high activity due to camera motion and a high activity due to dancing people. Hence, these simple descriptors, especially when used to complete each other, promise to provide important clues about: semantics of a video.

Suggestions

Semi-automatic semantic video annotation tool
Aydınlılar, Merve; Yazıcı, Adnan; Department of Computer Engineering (2011)
Semantic annotation of video content is necessary for indexing and retrieval tasks of video management systems. Currently, it is not possible to extract all high-level semantic information from video data automatically. Video annotation tools assist users to generate annotations to represent video data. Generated annotations can also be used for testing and evaluation of content based retrieval systems. In this study, a semi-automatic semantic video annotation tool is presented. Generated annotations are in...
Efficient Multimedia Information Retrieval with Query Level Fusion
Sattari, Saeid; Yazıcı, Adnan (2015-10-28)
Multimedia data particularly digital videos that contain various modalities (visual, audio, and text) are complex and time consuming to deal with. Therefore, managing a large volume of multimedia data reveals the necessity for efficient methods for modeling, processing, storing and retrieving such data. In this study, we investigate how to efficiently manage multimedia data, especially video data. In addition, we discuss various flexible query types including the combination of content as well as concept-ba...
Automatic Semantic Content Extraction in Videos Using a Fuzzy Ontology and Rule-Based Model
Yildirim, Yakup; Yazıcı, Adnan; Yilmaz, Turgay (2013-01-01)
Recent increase in the use of video-based applications has revealed the need for extracting the content in videos. Raw data and low-level features alone are not sufficient to fulfill the user's needs; that is, a deeper understanding of the content at the semantic level is required. Currently, manual techniques, which are inefficient, subjective and costly in time and limit the querying capabilities, are being used to bridge the gap between low-level representative features and high-level semantic content. H...
An ontology-based multimedia information management system
Tarakçı, Hilal; Çiçekli, Fehime Nihan; Department of Computer Engineering (2008)
In order to manage the content of multimedia data, the content must be annotated. Although any user-defined annotation is acceptable, it is preferable if systems agree on the same annotation format. MPEG-7 is a widely accepted standard for multimedia content annotation. However, in MPEG-7, semantically identical metadata can be represented in multiple ways due to lack of precise semantics in its XML-based syntax. Unfortunately this prevents metadata interoperability. To overcome this problem, MPEG-7 standar...
Semantik video modeling and retrieval with visual, auditory, textual sources
Durak, Nurcan; Yazıcı, Adnan; Department of Computer Engineering (2004)
The studies on content-based video indexing and retrieval aim at accessing video content from different aspects more efficiently and effectively. Most of the studies have concentrated on the visual component of video content in modeling and retrieving the video content. Beside visual component, much valuable information is also carried in other media components, such as superimposed text, closed captions, audio, and speech that accompany the pictorial component. In this study, semantic content of video is m...
Citation Formats
K. Peker, A. A. Alatan, and A. Akansu, “Low-level motion activity features for semantic characterization of video,” 2000, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/53723.