Integration of multimodal multimedia database system architecture with query level fusion

Download
2013
Sattari, Saeid
Multimedia data particularly digital videos that contain various modalities (visual, audio, and text) are complex and time consuming to deal with. Therefore, managing large volume of multimedia data reveals the necessity for efficient methods of modeling, processing, storing and retrieving these data. In this study, we investigate some of the requirements to efficiently deal with multimedia data, especially video data. To satisfy such requirements we aim to integrate specific multimedia database architecture which consists of semantic content extractor, storage, index, query and coordinator modules. In addition, to simplify complicated and time consuming operations on video files some client-server based applications with appropriate graphical user interfaces are implemented to carry out these operations in multi-threaded mode. The proposed architecture also supports different query types including the combination of content as well as concept-based queries which provides users with the ability to perform multimodal query. Furthermore, we introduce a fusion approach at the query level to improve query retrieval performance of the multimedia database system.

Suggestions

Efficient Multimedia Information Retrieval with Query Level Fusion
Sattari, Saeid; Yazıcı, Adnan (2015-10-28)
Multimedia data particularly digital videos that contain various modalities (visual, audio, and text) are complex and time consuming to deal with. Therefore, managing a large volume of multimedia data reveals the necessity for efficient methods for modeling, processing, storing and retrieving such data. In this study, we investigate how to efficiently manage multimedia data, especially video data. In addition, we discuss various flexible query types including the combination of content as well as concept-ba...
Multimedia Information Retrieval Using Fuzzy Cluster-Based Model Learning
Sattari, Saeid; Yazıcı, Adnan (2017-07-12)
Multimedia data, particularly digital videos, which contain various modalities (visual, audio, and text) are complex and time consuming to model, process, and retrieve. Therefore, efficient methods are required for retrieval of such complex data. In this paper, we propose a multimodal query level fusion approach using a fuzzy cluster-based learning method to improve the retrieval performance of multimedia data. Experimental results on a real dataset demonstrate that employing fuzzy clustering achieves notab...
Fusion of multimodal information for multimedia information retrieval
Yılmaz, Turgay; Yazıcı, Adnan; Department of Computer Engineering (2014)
An effective retrieval of multimedia data is based on its semantic content. In order to extract the semantic content, the nature of multimedia data should be analyzed carefully and the information contained should be used completely. Multimedia data usually has a complex structure containing multimodal information. Noise in the data, non-universality of any single modality, and performance upper bound of each modality make it hard to rely on a single modality. Thus, multimodal fusion is a practical approach...
A novel optical flow-based representation for temporal video segmentation
Akpınar, Samet; Alpaslan, Ferda Nur (2017-01-01)
Temporal video segmentation is a field of multimedia research enabling us to temporally split video data into semantically coherent scenes. In order to develop methods challenging temporal video segmentation, detecting scene boundaries is one of the more widely used approaches. As a result, representation of temporal information becomes important. We propose a new temporal video segment representation to formalize video scenes as a sequence of temporal motion change information. The idea here is that some s...
A New service architecture for IPTV over internet
Özkardeş, Merve; Schmidt, Şenan Ece; Department of Electrical and Electronics Engineering (2013)
Multimedia applications over the Internet and Internet Protocol Television (IPTV) gain a lot of attention. IPTV has a number of service requirements such as; high bandwidth, scalability, minimum delay, jitter and channel switch time. IP multicast, IMS (IP Multimedia System) Protocol and peer-to-peer approaches are proposed for implementing IPTV. However, IP multicast requires all the routers in the core network to possess multicast capability, IMS does not easily scale and P2P cannot e ciently utilize the n...
Citation Formats
S. Sattari, “Integration of multimodal multimedia database system architecture with query level fusion,” M.S. - Master of Science, Middle East Technical University, 2013.