Optimizing age of information on real-life TCP/IP connections through reinforcement learning

Sert, Egemen
Sonmez, Canberk
Baghaee, Sajjad
Uysal, Elif
Age of Information (AoI) has emerged as a performance metric capturing the freshness of data for status-update based applications ( e.g. , remote monitoring) as a more suitable alternative to classical network performance indicators such as throughput or delay. Optimizing AoI often requires distinctly novel and sometimes counter-intuitive networking policies that adapt the rate of update transmissions to the randomness in network resources. However, almost all previous work on AoI to data has been theoretical, assuming idealized networking models, and known delay and service time distributions. It is difficult to obtain these statistics and optimize for them in a real-life network as there are many interacting phenomena in different networking layers ( e.g. , consider an end-to-end IoT application running over the Internet). With this work we introduce a deep reinforcement learning-based approach that can learn to minimize the AoI with no prior assumptions about network topology. After evaluating the learning model on an emulated network, we have shown that the method can be scaled up to any realistic network with unknown delay distribution.


Measuring age of information on real-life connections
Beytur, Hasan Burhan; Baghaee, Sajjad; Uysal, Elif (2019-04-01)
Age of Information (AoI) is a relatively new metric to measure freshness of networked application such as real-time monitoring of status updates or control. The AoI metric is discussed in the literature mainly in a theoretical way. In this work, we want to point out the issues related to the measuring AoI-related values, such as synchronization and calculation of the values. We discussed the effect of synchronization error in the measurement and a solution for calculating an estimate of average AoI without ...
Reinforcement Learning Based Adaptive Blocklength and MCS Selection for Minimization of Age Violation Probability
Özkaya, Ayşenur; Ceran Arslan, Elif Tuğçe; Department of Electrical and Electronics Engineering (2022-1)
As a measure of data freshness, Age of Information (AoI) is an important semantic performance metric in systems where small status update packets need to be delivered to a monitor in a timely manner. This study aims to minimize the age violation probability (AVP), which is defined as the probability that instantaneous age exceeds a certain threshold. The AVP can be considered as one of the key performance indicators in emerging 5G and beyond technologies such as massive machine-to-machine communications (mM...
Age-of-Information in Practice: Status Age Measured over TCP/IP Connections through WiFi, Ethernet and LTE
Sonmez, Canberk; Baghaee, Sajjad; Ergisi, Abdussamed; Uysal, Elif (2018-06-07)
The Age of Information (AoI) has gained importance as a Key Performance Indicator (KPI) measuring freshness of information in information-update systems and time-critical applications. Almost all the previous literature on AoI has been theoretical. Most of these theoretical studies assumed knowledge of the statistics of network delays and/or link service times. However, in real-life networks, various factors contribute to these parameters, resulting in a complicated effect on age. This paper reports the res...
Improving data freshness in random access channels
Atabay, Doğa Can; Uysal, Elif; Department of Electrical and Electronics Engineering (2019)
The conventional network performance metrics such as throughput and delay do not accurately reflect the needs of some applications. Age of information (AoI) is a newly proposed metric that indicates the freshness of information from the receiver’s perspective. In this work, a network of multiple transmitter devices continuously updating a central station over an error-free multiaccess channel is studied. The average AoI expressions are derived for Round-Robin, Slotted ALOHA, and a proposed random access str...
Linearization of RF power amplifiers with memoryless baseband predistortion method
Kolcuoğlu, Turusan; Demir, Şimşek; Department of Electrical and Electronics Engineering (2011)
In modern wireless communication systems, advanced modulation techniques are used to support more users by handling high data rates and to increase the utilization efficiency of the limited RF spectrum. These techniques are sensitive to the nonlinear distortions due to their high peak to average power ratios. Main source of nonlinear distortion in transmitter topologies are power amplifiers that determine the overall efficiency and linearity of the transmitter. To increase linearity without sacrificing effi...
Citation Formats
E. Sert, C. Sonmez, S. Baghaee, and E. Uysal, “Optimizing age of information on real-life TCP/IP connections through reinforcement learning,” 2018, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/48917.