Hierarchical distance learning by stacking nearest neighbor classifiers

Date

2016-05-01

Author

Ozay, Mete
Yarman Vural, Fatoş Tunay

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

72
views

0
downloads

We propose a two-layer decision fusion technique, called Fuzzy Stacked Generalization (FSG) which establishes a hierarchical distance learning architecture. At the base-layer of an FSG, fuzzy k-NN classifiers receive different feature sets each of which is extracted from the same dataset to gain multiple views of the dataset At the meta-layer, first, a fusion space is constructed by aggregating decision spaces of all the base-layer classifiers. Then, a fuzzy k-NN classifier is trained in the fusion space by minimizing the difference between the large sample and N-sample classification error. In order to measure the degree of collaboration among the base-layer classifiers and the diversity of the feature spaces, a new measure called, shareability, is introduced. Shearability is defined as the number of samples that are correctly classified by at least one of the base-layer classifiers in FSG. In the experiments, we observe that FSG performs better than the popular distance learning and ensemble learning algorithms when the shareability measure is large enough such that most of the samples are correctly classified by at least one of the base-layer classifiers. The relationship between the proposed and state-of-the-art diversity measures is experimentally analyzed. The tests performed on a variety of artificial and real-world benchmark datasets show that the classification performance of FSG increases compared to that of state-of-the art ensemble learning and distance learning methods as the number of classes increases.

Subject Keywords

Decision fusion, Classification, Nearest neighbor rule, Ensemble learning, Hierarchical distance learning

URI

https://hdl.handle.net/11511/40481

Journal

INFORMATION FUSION

DOI

https://doi.org/10.1016/j.inffus.2015.09.004

Collections

Department of Computer Engineering, Article

Suggestions

OpenMETU
Core

Ensemble Detection: A New Architecture for MultiSensor Data Fusion with Ensemble Learning for Object Detection Ozay, Mete; Akalin, Okan; Yarman-Vural, Fatos T. (2009-09-16) In this work, we propose a framework for multimodal data fusion at decision level under a multilayer hierarchical ensemble learning architecture. The architecture provides a generative discriminative model for probability density estimations and decreases the entropy of the data throughout the vector spaces. The architecture is implemented for human motion detection problem, where the motion analysis problem is formulated as a multi-class classification problem on audio-visual data. The vector space transfo...
Multi-modal video event recognition based on association rules and decision fusion Guder, Mennan; Çiçekli, Fehime Nihan (2018-02-01) In this paper, we propose a multi-modal event recognition framework based on the integration of feature fusion, deep learning, scene classification and decision fusion. Frames, shots, and scenes are identified through the video decomposition process. Events are modeled utilizing features of and relations between the physical video parts. Event modeling is achieved through visual concept learning, scene segmentation and association rule mining. Visual concept learning is employed to reveal the semantic gap b...
Scalar mesons in radiative phi ->(KK-0)-K-0 gamma decay Gokalp, A.; Korkmaz, C. S.; Yılmaz, Osman (American Physical Society (APS), 2007-01-01) We study the radiative phi -> K-0(K) over bar (0)gamma decay within a phenomenological framework by considering the contributions of the f(0)(980) and a(0)(980) scalar resonances. We calculate the branching ratio B(phi -> K-0(K) over bar (0)gamma) by employing the coupling constants g(f0)K(+)K(-) and g(a0)K(+)K(-) as determined by different experimental groups.
Out-of-Sample Generalizations for Supervised Manifold Learning for Classification Vural, Elif (2016-03-01) Supervised manifold learning methods for data classification map high-dimensional data samples to a lower dimensional domain in a structure-preserving way while increasing the separation between different classes. Most manifold learning methods compute the embedding only of the initially available data; however, the generalization of the embedding to novel points, i.e., the out-of-sample extension problem, becomes especially important in classification applications. In this paper, we propose a semi-supervis...
Scalar f(0) and a(0) mesons in radiative phi -> K+K-gamma decay Gokalp, A.; Ozturk, F.; Yılmaz, Osman (Elsevier BV, 2009-01-26) We study the radiative phi -> K+K-gamma decay within a phenomenological framework by considering the contributions of the f(0)(980) and a(0)(980) scalar resonances. We consider the kaon-loop model and the no-structure model to evaluate these contributions and compare the results obtained in two models.

Citation Formats

M. Ozay and F. T. Yarman Vural, “Hierarchical distance learning by stacking nearest neighbor classifiers,” INFORMATION FUSION, pp. 14–31, 2016, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/40481.