Feature Dimensionality Reduction with Variational Autoencoders in Deep Bayesian Active Learning

Date

2021-06-09

Author

Ertekin Bolelli, Şeyda

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

350
views

0
downloads

Data annotation for training of supervised learning algorithms has been a very costly procedure. The aim of deep active learning methodologies is to acquire the highest performance in supervised deep learning models by annotating as few data points as possible. As the feature space of data grows, the application of linear models in active learning settings has become insufficient. Therefore, Deep Bayesian Active Learning methodology which represents model uncertainty has been widely studied. In this paper, a study has been conducted in order to increase the performance of Deep Bayesian Active Learning method. Feature dimensionality reduction is performed on data set by using Variational Autoencoder model. Low dimensional data is used to train a Bayesian Multi Layer Perceptron. The proposed method outperformed the Bayesian Multi Layer Perceptron model which is trained on entire feature space in terms of accuracy performance. The accuracy of the proposed method is tested on baseline datasets.

Subject Keywords

Deep Active Learning, Variational Autoencoder, Bayesian Neural Networks, Feature Learning

URI

https://hdl.handle.net/11511/91417

DOI

https://doi.org/10.1109/SIU53274.2021.9477979

Conference Name

29th Signal Processing and Communications Applications Conference (SIU)

Collections

Department of Computer Engineering, Conference / Seminar

Suggestions

OpenMETU
Core

Deep Learning-Based Hybrid Approach for Phase Retrieval IŞIL, ÇAĞATAY; Öktem, Sevinç Figen; KOÇ, AYKUT (2019-06-24) We develop a phase retrieval algorithm that utilizes the hybrid-input-output (HIO) algorithm with a deep neural network (DNN). The DNN architecture, which is trained to remove the artifacts of HIO, is used iteratively with HIO to improve the reconstructions. The results demonstrate the effectiveness of the approach with little additional cost.
EXTRACTION OF INTERPRETABLE DECISION RULES FROM BLACK-BOX MODELS FOR CLASSIFICATION TASKS GALATALI, EGEMEN BERK; ALEMDAR, HANDE; Department of Computer Engineering (2022-8-31) In this work, we have proposed a new method and ready to use workflow to extract simplified rule sets for a given Machine Learning (ML) model trained on a classifi- cation task. Those rules are both human readable and in the form of software code pieces thanks to the syntax of Python programming language. We have inspired from the power of Shapley Values as our source of truth to select most prominent features for our rule sets. The aim of this work to select the key interval points in given data in order t...
Deep learning approach for laboratory mice grimace scaling Eral, Mustafa; Halıcı, Uğur; Department of Electrical and Electronics Engineering (2016) Deep learning is extremely attractive research topic in pattern recognition and machine learning areas. Applications in speech recognition, natural language processing, and machine vision fields gained huge acceleration in performance by employing deep learning. In this thesis, deep learning is used for medical purposes in order to scale pain degree of drug stimulated mice by examining facial grimace. For this purpose each frame in the videos in the training set were scaled manually by experts according to ...
Mask Combination of Multi-Layer Graphs for Global Structure Inference Bayram, Eda; Thanou, Dorina; Vural, Elif; Frossard, Pascal (2020-01-01) Structure inference is an important task for network data processing and analysis in data science. In recent years, quite a few approaches have been developed to learn the graph structure underlying a set of observations captured in a data space. Although real-world data is often acquired in settings where relationships are influenced by a priori known rules, such domain knowledge is still not well exploited in structure inference problems. In this paper, we identify the structure of signals defined in a da...
Cross-modal Representation Learning with Nonlinear Dimensionality Reduction KAYA, SEMİH; Vural, Elif (2019-08-22) In many problems in machine learning there exist relations between data collections from different modalities. The purpose of multi-modal learning algorithms is to efficiently use the information present in different modalities when solving multi-modal retrieval problems. In this work, a multi-modal representation learning algorithm is proposed, which is based on nonlinear dimensionality reduction. Compared to linear dimensionality reduction methods, nonlinear methods provide more flexible representations e...

Citation Formats

Ş. Ertekin Bolelli, “Feature Dimensionality Reduction with Variational Autoencoders in Deep Bayesian Active Learning,” İstanbul, Türkiye, 2021, vol. 1, Accessed: 00, 2021. [Online]. Available: https://hdl.handle.net/11511/91417.