A Cloud Based Architecture for Distributed Real Time Processing of Continuous Queries

Download

index.pdf

Date

2015

Author

Gökalp, Mert Onuralp

Metadata

Show full item record

Item Usage Stats

224
views

213
downloads

The technological advancements in Internet of Things (IoT) domain have enabled us to reshape the physical world through smart devices, sensors and actuators. The data collected by IoT devices has become a valuable asset to extract knowledge about the environment and other nearby devices. Existing IoT applications mostly store collected data in a central server and allow users to query stored data to notice and react to changes in the environment. Usually cloud and big data technologies are utilized in those applications for scalability. Nevertheless, the responsiveness of such IoT applications is limited due to the use of polling based queries. In this thesis, we primarily focus on the problem of specifying a generic and scalable architecture to process a multitude of continuous queries in real time, respond to events and notify users in a timely manner. For this purpose, we propose a data-flow based query definition model to allow users create flexible queries. We devise a centrally managed distributed infrastructure based on the state of the art big data technologies to execute the continuous queries over streaming data rather than storing and frequently querying the data collected. A prototype has been implemented to demonstrate the applicability and to evaluate the scalability of the proposed approach.

Subject Keywords

Cloud computing., Software architecture., Internet of things., Real-time data processing., Electronic data processing

URI

http://etd.lib.metu.edu.tr/upload/12619105/index.pdf
https://hdl.handle.net/11511/25022

Collections

Graduate School of Informatics, Thesis

Suggestions

OpenMETU
Core

A Cloud Based Architecture for Distributed Real Time Processing of Continuous Queries Gökalp, Mert Onuralp; Koçyiğit, Altan; Eren, Pekin Erhan (2015-08-28) With the rapid pace of technological advancements in smart device, sensor and actuator technologies, the Internet of Things (IoT) domain has received significant attention. These advances have brought us closer to the ubiquitous computing vision. However, in order to fully realize this vision, devices and applications should rapidly adapt to the changes in the environment and other nearby devices. Most of the existing applications store collected data in a data store and allow users to query stored data to ...
A Novel SDN Dataset for Intrusion Detection in IoT Networks Sarica, Alper Kaan; Angın, Pelin (2020-11-04) The number of Internet of Things (IoT) devices and the use cases they aim to support have increased sharply in the past decade with the rapid developments in wireless networking infrastructures. Despite many advantages, the widespread use of IoT has also created a large attack surface frequently exploited by cyber criminals, requiring real-time, automated detection and mitigation of various attacks in the high-volume network traffic generated. Software-defined networking (SDN) and machine learning (ML) base...
A visual programming framework for distributed Internet of Things centric complex event processing Gökalp, Mert Onuralp; Koçyiğit, Altan; Eren, Pekin Erhan (2019-03-01) Complex Event Processing (CEP) is a promising approach for real-time processing of big data streams originating from Internet of Things (IoT) devices. Even though scalability and flexibility are key issues for IoT applications, current studies are mostly based on centralized solutions and restrictive query languages. Moreover, development, deployment and operation of big-data applications require significant amount of technical expertise. Hence, a framework that provides a higher abstraction level programmi...
An Effective Forest Fire Detection Framework Using Heterogeneous Wireless Multimedia Sensor Networks Kizilkaya, Burak; Ever, Enver; Yatbaz, Hakan Yekta; Yazıcı, Adnan (2022-05-01) With improvements in the area of Internet of Things (IoT), surveillance systems have recently become more accessible. At the same time, optimizing the energy requirements of smart sensors, especially for data transmission, has always been very important and the energy efficiency of IoT systems has been the subject of numerous studies. For environmental monitoring scenarios, it is possible to extract more accurate information using smart multimedia sensors. However, multimedia data transmission is an expensi...
A generic framework for optimizing performance metrics by tuning parameters of clustering protocols in WSNs Alchihabi, Abdullah; Dervis, Ates; Ever, Enver; Al-Turjman, Fadi;( Abstracts: Wireless sensor network (WSN) is a key technology trend in emerging internet of things paradigms which are commonly used for application areas such as smart-cities, smart-grids, wearables, and connected health. There is a wealth of literature which considers various cluster-based routing protocols such as LEACH, HEED, and UHEED where these protocols are compared in terms of the network lifetime and/or the total number of packets successfully received by the base station under various operational conditions. While existing studies present various approaches to form WSN clusters in the most efficient way, various parameters are manually-assigned their values such as the radius of the cluster, the number of nodes in the cluster, and the number of clusters that should be formed to reach the base station. The choice of correct parameters is essential for reaching the most efficient configuration, however existing studies do not specify a systematic way for tuning these parameters. In other words, the optimization of cluster-based WSNs through fine tuning of related system parameters is not considered in the existing studies. We believe that presenting a generic approach to tune the parameters of clustering algorithms in order to optimize the performance metrics of WSNs is a significant contribution. In this study a systematic and an efficient method is presented to tune the parameters of clustering and routing protocols. Instead of brute force, or trial and error approaches, simulated annealing and K-beams algorithms are adopted together with discrete event system simulator OMNET++ with Castalia Framework. Results are presented comparatively with brute force approach in order to show the efficiency of the new approach in finding the optimum configuration in terms of energy efficiency as well as the rate of successfully received packets.; 2019-04-01) Wireless sensor network (WSN) is a key technology trend in emerging internet of things paradigms which are commonly used for application areas such as smart-cities, smart-grids, wearables, and connected health. There is a wealth of literature which considers various cluster-based routing protocols such as LEACH, HEED, and UHEED where these protocols are compared in terms of the network lifetime and/or the total number of packets successfully received by the base station under various operational conditions....

Citation Formats

M. O. Gökalp, “A Cloud Based Architecture for Distributed Real Time Processing of Continuous Queries,” M.S. - Master of Science, Middle East Technical University, 2015.