MetaLabelNet: Learning to Generate Soft-Labels From Noisy-Labels

Download

index.pdf

Date

2022-01-01

Author

Algan, Gorkem
Ulusoy, İlkay

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

113
views

34
downloads

Real-world datasets commonly have noisy labels, which negatively affects the performance of deep neural networks (DNNs). In order to address this problem, we propose a label noise robust learning algorithm, in which the base classifier is trained on soft-labels that are produced according to a meta-objective. In each iteration, before conventional training, the meta-training loop updates soft-labels so that resulting gradients updates on the base classifier would yield minimum loss on meta-data. Soft-labels are generated from extracted features of data instances, and the mapping function is learned by a single layer perceptron (SLP) network, which is called MetaLabelNet. Following, base classifier is trained by using these generated soft-labels. These iterations are repeated for each batch of training data. Our algorithm uses a small amount of clean data as meta-data, which can be obtained effortlessly for many cases. We perform extensive experiments on benchmark datasets with both synthetic and real-world noises. Results show that our approach outperforms existing baselines. The source code of the proposed model is available at https://github.com/gorkemalgan/MetaLabelNet.

Subject Keywords

Training, Noise measurement, Noise robustness, Feature extraction, Training data, Deep learning, Wide band gap semiconductors, Deep learning, label noise, noise robust, noise cleansing, meta-learning, SET, Deep learning, label noise, meta-learning, noise cleansing, noise robust

URI

https://hdl.handle.net/11511/99639

Journal

IEEE Transactions on Image Processing

DOI

https://doi.org/10.1109/tip.2022.3183841

Collections

Department of Electrical and Electronics Engineering, Article

Suggestions

OpenMETU
Core

Deep Learning in the Presence of Label Noise: A Meta-Learning Approach Algan, Görkem; Ulusoy, İlkay; Department of Electrical and Electronics Engineering (2021-3-12) Image classification systems recently made a giant leap with the advancement of deep neural networks. However, these systems require an excessive amount of labeled data to be adequately trained. Gathering a correctly annotated dataset is not always feasible due to practical challenges. Because of these practical challenges, label noise is a common problem in real-world datasets. This thesis presents two novel label noise robust learning algorithms: MSLG (Meta Soft Label Generation) and MetaLabelNet. Both al...
Meta Soft Label Generation for Noisy Labels Algan, Gorkem; Ulusoy, İlkay (2021-01-01) The existence of noisy labels in the dataset causes significant performance degradation for deep neural networks (DNNs). To address this problem, we propose a Meta Soft Label Generation algorithm called MSLG, which can jointly generate soft labels using meta-learning techniques and learn DNN parameters in an end-to-end fashion. Our approach adapts the meta-learning paradigm to estimate optimal label distribution by checking gradient directions on both noisy training data and noise-free meta-data. In order t...
Deep Learning-Based Hybrid Approach for Phase Retrieval IŞIL, ÇAĞATAY; Öktem, Sevinç Figen; KOÇ, AYKUT (2019-06-24) We develop a phase retrieval algorithm that utilizes the hybrid-input-output (HIO) algorithm with a deep neural network (DNN). The DNN architecture, which is trained to remove the artifacts of HIO, is used iteratively with HIO to improve the reconstructions. The results demonstrate the effectiveness of the approach with little additional cost.
Improving Perceptual Quality of Spatially Transformed Adversarial Examples Aydın, Ayberk; Temizel, Alptekin; Department of Modeling and Simulation (2022-8) Deep neural networks are known to be vulnerable to additive adversarial perturbations. The amount of these additive perturbations are generally quantified using Lp metrics over the difference between adversarial and benign examples. However, even when the measured perturbations are small, they tend to be noticeable by human observers since Lp distance metrics are not representative of human perception. Spatially transformed examples work by distorting pixel locations instead of applying an additive perturba...
Recursive shortest spanning tree algorithms for image segmentation Bayramoglu, NY; Bazlamaçcı, Cüneyt Fehmi (2005-11-24) Image segmentation has an important role in image processing and the speed of the segmentation algorithm may become a drawback for some applications. This study analyzes the run time performances of some variations of the Recursive Shortest Spanning Tree Algorithm (RSST) and proposes simple but effective modifications on these algorithms to improve their speeds. In addition, the effect of link weight cost function on the run time performance and the segmentation quality is examined. For further improvement ...

Citation Formats

G. Algan and İ. Ulusoy, “MetaLabelNet: Learning to Generate Soft-Labels From Noisy-Labels,” IEEE Transactions on Image Processing, vol. 31, pp. 4352–4362, 2022, Accessed: 00, 2022. [Online]. Available: https://hdl.handle.net/11511/99639.