Yakamoz and Sunshine: Two novel time series anomaly detection methods

Download
2021-6
Boğazlıyan, Metin
In modern society, availability and reliability of data have become crucial. Hence, one important task for a variety of fields is to detect abnormal instances in data. One of the objectives of identification of anomalies is to detect outlying data points, leading to new discoveries. In this case, anomalies themselves are of primary interest. The other objective is to detect anomalies in the preprocessing step in statistical analysis that may otherwise lead to model misspecification, biased parameter estimation and incorrect results. Obtaining forecasts using time series is a subject that has never lost its popularity, and it is becoming ever more important with the development of technology. The presence of even a few abnormal observations in the series, on the other hand, has a negative effect on these forecasts. In view of the problems, it is understood that there is a need for widely applicable and effective anomaly detection methods. Our main goal is to provide model-free, unsupervised, efficient and accurate detection of anomalous observations in time series data. For this reason, two novel time series anomaly detection methods have been proposed. These methods do not require anomalous samples in their training datasets. This skill has considerable practical value since the collection of labelled data can be difficult. In addition, the location of the anomaly does not affect the performance of the methods. Success of the proposed methods in finding anomaly/anomalies is investigated using real and simulated time series datasets. From the performance comparison results, it is seen that the proposed methods are very effective in finding anomaly/anomalies in these time series regardless of the variation in the data.

Suggestions

Context- and sentiment-aware machine learning models for sentiment analysis
Deniz Kızılöz, Firdevsi Ayça; Angın, Pelin; Angın, Merih; Department of Computer Engineering (2023-1-24)
With the advances in information technologies, the amount of available data on web sources where people express their opinions increases continually. Sentiment analysis supports decision-makers in gaining insights from massive heaps of data. It has gained much attraction recently as it has proven to be a practical tool in a wide range of areas, including monitoring public opinion. Nevertheless, sentiment analysis research is still facing some challenges. One of the main challenges is the irrelevant and redu...
Explainable Security in SDN-Based IoT Networks
Sarica, Alper Kaan; Angın, Pelin (2020-12-01)
The significant advances in wireless networks in the past decade have made a variety of Internet of Things (IoT) use cases possible, greatly facilitating many operations in our daily lives. IoT is only expected to grow with 5G and beyond networks, which will primarily rely on software-defined networking (SDN) and network functions virtualization for achieving the promised quality of service. The prevalence of IoT and the large attack surface that it has created calls for SDN-based intelligent security solut...
NETWORK INTRUSION DETECTION WITH A DEEP LEARNING APPROACH
Kültür, Ebru; Acar, Aybar Can; Department of Cybersecurity (2022-2-7)
With the rapid growth of the information technology in several areas, providing security of those systems has gained more importance. As a result of this development in information technology, the complexity of cyber-attacks has also significantly increased. Therefore, traditional security tools such as Signature-based Intrusion Detection Systems (SIDS) have become insufficient for detecting new attacks. Intrusion Detection Systems (IDS) are used to monitor network traffic and capture malicious traffic. Tra...
Hyperspectral Anomaly Detection Method Based on Auto-encoder
Bati, Emrecan; Caliskan, Akin; Koz, Alper; Alatan, Abdullah Aydın (2015-09-23)
A major drawback of most of the existing hyperspectral anomaly detection methods is the lack of an efficient background representation, which can successfully adapt to the varying complexity of hyperspectral images. In this paper, we propose a novel anomaly detection method which represents the hyperspectral scenes of different complexity with the state-of-the-art representation learning method, namely auto-encoder. The proposed method first encodes the spectral image into a sparse code, then decodes the co...
Wasserstein generative adversarial active learning for anomaly detection with gradient penalty
Duran, Hasan Ali; Ertekin Bolelli, Şeyda; Department of Computer Engineering (2021-9)
Anomaly detection has become a very important topic with the advancing machine learning techniques and is used in many different application areas. In this study, we approach differently than the anomaly detection methods performed on standard generative models and describe anomaly detection as a binary classification problem. However, in order to train a highly accurate classifier model, the number of anomaly data in data-sets is very limited, and with synthetic data produced using generative models, it ca...
Citation Formats
M. Boğazlıyan, “Yakamoz and Sunshine: Two novel time series anomaly detection methods,” Ph.D. - Doctoral Program, Middle East Technical University, 2021.