Multimodal query-level fusion for efficient multimedia information retrieval

Date

2018-10-01

Author

Sattari, Saeid
Yazıcı, Adnan

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

199
views

0
downloads

Managing a large volume of multimedia data containing various modalities such as visual, audio, and text reveals the necessity for efficient methods for modeling, processing, storing, and retrieving complex data. In this paper, we propose a fusion-based approach at the query level to improve query retrieval performance of multimedia data. We discuss various flexible query types including the combination of content as well as concept-based queries that provide users with the ability to efficiently perform multimodal querying. We have carried out a number of experiments on a video database to show the efficiency of our approach for various types of queries. Our experimental results show that our query-level fusion approach presents a notable improvement in retrieval performance especially for the concept-based queries.

Subject Keywords

Query level fusion, Query expansion, Multimodal query, Multimedia database, Cross-modal retrieval

URI

https://hdl.handle.net/11511/37805

Journal

INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS

DOI

https://doi.org/10.1002/int.21920

Collections

Department of Computer Engineering, Article

Suggestions

OpenMETU
Core

Efficient Multimedia Information Retrieval with Query Level Fusion Sattari, Saeid; Yazıcı, Adnan (2015-10-28) Multimedia data particularly digital videos that contain various modalities (visual, audio, and text) are complex and time consuming to deal with. Therefore, managing a large volume of multimedia data reveals the necessity for efficient methods for modeling, processing, storing and retrieving such data. In this study, we investigate how to efficiently manage multimedia data, especially video data. In addition, we discuss various flexible query types including the combination of content as well as concept-ba...
Improving the performance of Hadoop/Hive by sharing scan and computation tasks Özal, Serkan; Toroslu, İsmail Hakkı; Doğaç, Asuman; Department of Computer Engineering (2013) MapReduce is a popular model of executing time-consuming analytical queries as a batch of tasks on large scale data. During simultaneous execution of multiple queries, many oppor- tunities can arise for sharing scan and/or computation tasks. Executing common tasks only once can reduce the total execution time of all queries remarkably. Therefore, we propose to use Multiple Query Optimization (MQO) techniques to improve the overall performance of Hadoop Hive, an open source SQL-based distributed warehouse sy...
A transcoding robust data hiding method for image communication applications Candan, Çağatay (2005-09-14) We present a data embedding method for image communication applications. Our goal is to implement novel multimedia applications such as multi-language captions, interactive programming and title specific features over the existing image communication channel. To this aim, we present a data embedding method for JPEG images which has the desired degree of robustness to transcoding or bitrate adjustments that may take place in the communication channel. The described system is designed for JPEG images but can ...
Using object-oriented materialized views to answer selection-based complex queries Alhajj, R; Polat, Faruk (1999-09-01) Presented in this paper is a model that utilizes existing materialized views to handle a wide range of complex selection-based queries, including linear recursive queries. Such queries are complex because it is almost impossible for naive users to predict the formulation of their predicate expressions. Object variables bound to objects in the result of a query are allowed to appear in the predicate of that query. Also, the predicate definition is extended to make it possible to have in the output only a sub...
Multiobjective relational data warehouse design for the cloud Dökeroğlu, Tansel; Coşar, Ahmet; Department of Computer Engineering (2014) Conventional distributed DataWarehouse (DW) design techniques seek to assign data tables/fragments to a given static database hardware setting optimally. However; it is now possible to use elastic virtual resources provided by the Cloud environment, thus achieve reductions in both the execution time and the monetary cost of a DW system within predefined budget and response time constraints. Finding an optimal assignment plan for database tables to machines for this design problem is NP-Hard. Therefore, robu...

Citation Formats

S. Sattari and A. Yazıcı, “Multimodal query-level fusion for efficient multimedia information retrieval,” INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, pp. 2019–2037, 2018, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/37805.