RELIEF-MM: effective modality weighting for multimedia information retrieval

Date

2014-07-01

Author

Yilmaz, Turgay
Yazıcı, Adnan
Kitsuregawa, Masaru

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

57
views

0
downloads

Fusing multimodal information in multimedia data usually improves the retrieval performance. One of the major issues in multimodal fusion is how to determine the best modalities. To combine the modalities more effectively, we propose a RELIEF-based modality weighting approach, named as RELIEF-MM. The original RELIEF algorithm is extended for weaknesses in several major issues: class-specific feature selection, complexities with multi-labeled data and noise, handling unbalanced datasets, and using the algorithm with classifier predictions. RELIEF-MM employs an improved weight estimation function, which exploits the representation and reliability capabilities of modalities, as well as the discrimination capability, without any increase in the computational complexity. The comprehensive experiments conducted on TRECVID 2007, TRECVID 2008 and CCV datasets validate RELIEF-MM as an efficient, accurate and robust way of modality weighting for multimedia data.

Subject Keywords

Media Technology, Computer Networks and Communications, Hardware and Architecture, Software, Information Systems

URI

https://hdl.handle.net/11511/34719

Journal

MULTIMEDIA SYSTEMS

DOI

https://doi.org/10.1007/s00530-014-0360-6

Collections

Department of Computer Engineering, Article

Suggestions

OpenMETU
Core

Graph-based multilevel temporal video segmentation Sakarya, Ufuk; TELATAR, ZİYA (Springer Science and Business Media LLC, 2008-11-01) This paper presents a graph-based multilevel temporal video segmentation method. In each level of the segmentation, a weighted undirected graph structure is implemented. The graph is partitioned into clusters which represent the segments of a video. Three low-level features are used in the calculation of temporal segments' similarities: visual content, motion content and shot duration. Our strength factor approach contributes to the results by improving the efficiency of the proposed method. Experiments sho...
Efficient active rule processing in wireless multimedia sensor networks Oztarak, Hakan; Akkaya, Kemal; Yazıcı, Adnan; Sarisaray-Boluk, Pinar (Inderscience Publishers, 2016-01-01) Due to limited energy resources in wireless multimedia sensor networks (WMSNs), there is a need to perform data reduction and elimination over raw video data at the camera sensors before transmission. Nonetheless, this data reduction and elimination may create imprecision and uncertainty in the data, reducing the quality of decision making. In this paper, we propose a reactive mechanism for not only fusing uncertain data at the sink but also for automated processing of data using active rules, extending the...
Multimodal concept detection in broadcast media: KavTan SOYSAL, Medeni; Alatan, Abdullah Aydın; TEKİN, Mashar; ESEN, Ersin; SARACOĞLU, Ahmet; Acar, Banu Oskay; Ozan, Ezgi Can; Ates, Tugrul K.; SEVİMLİ, Hakan; SEVİNÇ, Muge; ATIL, Ilkay; Ozkan, Savas; Arabaci, Mehmet Ali; TANKIZ, Seda; KARADENİZ, Talha; ÖNÜR, Duygu; SELÇUK, Sezin; Alatan, A. Aydin; Çiloğlu, Tolga (Springer Science and Business Media LLC, 2014-10-01) Concept detection stands as an important problem for efficient indexing and retrieval in large video archives. In this work, the KavTan System, which performs high-level semantic classification in one of the largest TV archives of Turkey, is presented. In this system, concept detection is performed using generalized visual and audio concept detection modules that are supported by video text detection, audio keyword spotting and specialized audio-visual semantic detection components. The performance of the p...
Machine learning algorithms for accurate flow-based network traffic classification: Evaluation and comparison Soysal, Murat; Schmidt, Şenan Ece (Elsevier BV, 2010-06-01) The task of network management and monitoring relies on an accurate characterization of network traffic generated by different applications and network protocols. We employ three supervised machine learning (ML) algorithms, Bayesian Networks, Decision Trees and Multilayer Perceptrons for the flow-based classification of six different types of Internet traffic including peer-to-peer (P2P) and content delivery (Akamai) traffic. The dependency of the traffic classification performance on the amount and composi...
Event prediction from news text using subgraph embedding and graph sequence mining Çekinel, Recep Fırat; Karagöz, Pınar (Springer Science and Business Media LLC, 2022-2-28) Event detection from textual content by using text mining concepts is a well-researched field in the literature. On the other hand, graph modeling and graph embedding techniques in recent years provide an opportunity to represent textual contents as graphs. Text can be enriched with additional attributes in graphs, and the complex relationships can be captured within the graphs. In this paper, we focus on news prediction and model the problem as subgraph prediction. More specifically, we aim to predict the ...

Citation Formats

T. Yilmaz, A. Yazıcı, and M. Kitsuregawa, “RELIEF-MM: effective modality weighting for multimedia information retrieval,” MULTIMEDIA SYSTEMS, pp. 389–413, 2014, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/34719.