Wasserstein generative adversarial active learning for anomaly detection with gradient penalty

2021-9
Duran, Hasan Ali
Anomaly detection has become a very important topic with the advancing machine learning techniques and is used in many different application areas. In this study, we approach differently than the anomaly detection methods performed on standard generative models and describe anomaly detection as a binary classification problem. However, in order to train a highly accurate classifier model, the number of anomaly data in data-sets is very limited, and with synthetic data produced using generative models, it can be brought to a usable level to train the model. In our model like GANs while Generator produces potential informative anomaly data, the Discriminator tries to determine whether the generated data is fake or real. In addition to these, we have added the Critic network to our model in order to enable the Generator to produce more realistic and informative data. In this way, we designed our model the Discriminator to be trained with the data produced by the Generator which is improved by the Critic network. Therefore, after sufficient training, the Discriminator turns into a natural anomaly detection classification tool. Since the Generator produce more realistic data in each epoch during the training phase, created ones more informative potential anomaly data for the Discriminator, which will allow the algorithm to develop with more informative data with active learning logic. Our novelty is a generative adversarial active learning (GAAL) structure designed over the Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP) instead of just applying this method over the standard GAN model. Both our Generator model can produce more realistic and more informative data than before, and at the same time, it prevents the mode collapse problem, which is one of the biggest problems of the standard GAN model. We have obtained a model that can detect anomalies with higher accuracy. Improved version of Wasserstein Generative Adversarial Active Learning (WGAAL-GP) has been tested on different data sets and the results obtained are presented by comparing them with previous studies.

Suggestions

A deep learning approach for the transonic flow field predictions around airfoils
Duru, Cihat; Alemdar, Hande; Baran, Özgür Uğraş (2022-01-01)
Learning from data offers new opportunities for developing computational methods in research fields, such as fluid dynamics, which constantly accumulate a large amount of data. This study presents a deep learning approach for the transonic flow field predictions around airfoils. The physics of transonic flow is integrated into the neural network model by utilizing Reynolds-averaged Navier–Stokes (RANS) simulations. A detailed investigation on the performance of the model is made both qualitatively and quant...
Deep Learning-Based Hybrid Approach for Phase Retrieval
IŞIL, ÇAĞATAY; Öktem, Sevinç Figen; KOÇ, AYKUT (2019-06-24)
We develop a phase retrieval algorithm that utilizes the hybrid-input-output (HIO) algorithm with a deep neural network (DNN). The DNN architecture, which is trained to remove the artifacts of HIO, is used iteratively with HIO to improve the reconstructions. The results demonstrate the effectiveness of the approach with little additional cost.
Competing labels: a heuristic approach to pseudo-labeling in deep semi-supervised learning
Bayrak, Hamdi Burak; Ertekin Bolelli, Şeyda; Yücel, Hamdullah; Department of Scientific Computing (2022-2-10)
Semi-supervised learning is one of the dominantly utilized approaches to reduce the reliance of deep learning models on large-scale labeled data. One mostly used method of this approach is pseudo-labeling. However, pseudo-labeling, especially its originally proposed form tends to remarkably suffer from noisy training when the assigned labels are false. In order to mitigate this problem, in our work, we investigate the gradient sent to the neural network and propose a heuristic method, called competing label...
Deep Learning-Enabled Technologies for Bioimage Analysis
Rabbi, Fazle; Dabbagh, Sajjad Rahmani; Angın, Pelin; Yetisen, Ali Kemal; Tasoglu, Savas (2022-02-01)
Deep learning (DL) is a subfield of machine learning (ML), which has recently demon-strated its potency to significantly improve the quantification and classification workflows in bio-medical and clinical applications. Among the end applications profoundly benefitting from DL, cellular morphology quantification is one of the pioneers. Here, we first briefly explain fundamental concepts in DL and then we review some of the emerging DL-enabled applications in cell morphology quantification in the fields of em...
Learning to rank web data using multivariate adaptive regression splines
Altınok, Gülşah; Batmaz, İnci; Karagöz, Pınar; Department of Statistics (2018)
A new trend, called learning to rank, has recently come to light in a wide variety of applications in Information Retrieval (IR), Natural Language Processing (NLP), and Data Mining (DM), to utilize machine learning techniques to automatically build the ranking models. Typical applications are document retrieval, expert search, definition search, collaborative filtering, question answering, and machine translation. In IR, there are three approaches used for ranking. The one is traditional model approaches su...
Citation Formats
H. A. Duran, “Wasserstein generative adversarial active learning for anomaly detection with gradient penalty,” M.S. - Master of Science, Middle East Technical University, 2021.