Enhanced Deep Learning with Improved Feature Subspace Separation

2018-09-30
Parlaktuna, Mustafa
Sekmen, Ali
Koku, Ahmet Buğra
Abdul Malek, Ayad
This research proposes a new deep convolutional network architecture that improves the feature subspace separation. In training, the system considers M classes of input sets {C-i}(i=1)(M) and M deep convolutional networks {DNi}(i=1)(M) whose filter and other parameters are randomly initialized. For each input class C-i, Convolutional Neural Network generates a set of features F-i. Then, a local subspace S-i is matched for each set F-i. This is followed with a full training of the deep convolutional network DNi based on a decision criteria developed with computation of rejections of all features in {F-i}(i=1)(M) to S-i. Five different deep convolutional network topologies are used to show that the proposed technique works better for small network topologies and has comparable performance to more complex networks.

Suggestions

IMPROVING PROPOSAL-BASED OBJECT DETECTION USING CONVOLUTIONAL CONTEXT FEATURES
Kaya, Emre Can; Alatan, Abdullah Aydın (2018-10-10)
A novel extension to proposal-based detection is proposed in order to learn convolutional context features for determining boundaries of objects better. Objects and their context are aimed to be learned through parallel convolutional stages. The resulting object and context feature maps are combined in such a way that they preserve their spatial relationship. The proposed algorithm is trained and evaluated on PASCAL VOC 2007 detection benchmark dataset and yielded improvements in performance over baseline, ...
Deep Learning-Based Hybrid Approach for Phase Retrieval
IŞIL, ÇAĞATAY; Öktem, Sevinç Figen; KOÇ, AYKUT (2019-06-24)
We develop a phase retrieval algorithm that utilizes the hybrid-input-output (HIO) algorithm with a deep neural network (DNN). The DNN architecture, which is trained to remove the artifacts of HIO, is used iteratively with HIO to improve the reconstructions. The results demonstrate the effectiveness of the approach with little additional cost.
Feature enhancement with deep generative models in deep bayesian active learning
Duymuş, Pınar Ezgi; Ertekin Bolelli, Şeyda; Department of Computer Engineering (2022-9)
Data-intensive models emerge as new advances in Deep Learning take place. However, access to annotated datasets with many data points is not constantly prevalent. This situation emphasizes the need for Active Learning to select the least possible amount of data without compromising the accuracy of the classifier models. Recent advancements occur in Deep Bayesian Active Learning (DBAL), which means incorporating uncertainty of model parameters into a Deep Network. In this work, we present an algorithm that i...
Deep Spectral Convolution Network for Hyperspectral Unmixing
Akar, Gözde (2018-10-10)
In this paper, we propose a novel hyperspectral unmixing technique based on deep spectral convolution networks (DSCN). Particularly, three important contributions are presented throughout this paper. First, fully-connected linear operation is replaced with spectral convolutions to extract local spectral characteristics from hyperspectral signatures with a deeper network architecture. Second, instead of batch normalization, we propose a spectral normalization layer which improves the selectivity of filters b...
Massive MIMO Channel Estimation With an Untrained Deep Neural Network
Balevi, Eren; Doshi, Akash; Andrews, Jeffrey G. (2020-03-01)
This paper proposes a deep learning-based channel estimation method for multi-cell interference-limited massive MIMO systems, in which base stations equipped with a large number of antennas serve multiple single-antenna users. The proposed estimator employs a specially designed deep neural network (DNN) based on the deep image prior (DIP) network to first denoise the received signal, followed by conventional least-squares (LS) estimation. We analytically prove that our LS-type deep channel estimator can app...
Citation Formats
M. Parlaktuna, A. Sekmen, A. B. Koku, and A. Abdul Malek, “Enhanced Deep Learning with Improved Feature Subspace Separation,” 2018, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/55116.