Hierarchical coding to enable scalability and flexibility in heterogeneous cloud storage

Download

index.pdf

Date

2019-12-01

Author

Yang, Siyi
Hareedy, Ahmed
Calderbank, Robert
Dolecek, Lara

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

164
views

40
downloads

In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and heterogeneous. Codes with hierarchical locality have been intensively studied due to their effectiveness in reducing the average reading time in cloud storage. In this paper, we present the first codes with hierarchical locality that achieve scalability and flexibility in heterogeneous cloud storage using small field size. We propose a double- level construction utilizing so-called Cauchy Reed-Solomon codes. We then develop a triple-level construction based on this double-level code; this construction can be easily generalized into any hierarchical structure with a greater number of layers since it naturally achieves scalability in the cloud storage systems.

URI

https://hdl.handle.net/11511/98500

DOI

https://doi.org/10.1109/globecom38437.2019.9014049

Conference Name

2019 IEEE Global Communications Conference, GLOBECOM 2019

Collections

Department of Electrical and Electronics Engineering, Conference / Seminar

Suggestions

OpenMETU
Core

Hierarchical Coding for Cloud Storage: Topology-Adaptivity, Scalability, and Flexibility Yang, Siyi; Hareedy, Ahmed; Calderbank, Robert; Dolecek, Lara (2022-06-01) In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and heterogeneous. The recent rise of the blockchain technology is also moving various information systems towards decentralization to achieve high privacy at low costs. While codes with hierarchical locality have been intensively studied in the context of centralized cloud stor...
Distributed Connectivity Restoration in Underwater Acoustic Sensor Networks via Depth Adjustment Uzun, Erkay; ŞENEL, FATİH; Akkaya, Kemal; Yazıcı, Adnan (2015-06-12) In most applications of Underwater Acoustic Sensor Networks, network connectivity is required for data exchange, data aggregation and relaying the data to a surface station. However, such connectivity can be lost due to failure of some sensor nodes which creates disruptions to the network operations. In this paper, we present two algorithms, namely BMR and DURA, which can detect network partitioning due to such node failures and re-establish network connectivity through controlled depth adjustment of nodes ...
Optimal dynamic resource allocation for heterogenous cloud data centers Ekici, Nazım Umut; Güran Schmidt, Şenan.; Department of Electrical and Electronics Engineering (2019) Today's data centers are mostly cloud-based with virtualized servers to provide on-demand scalability and flexibility of the available resources such as CPU, memory, data storage and network bandwidth. Heterogeneous cloud data centers (CDCs) offer hardware accelerators in addition to these standard cloud server resources. A cloud data center provider may provide Infrastructure as a Service and Platform as a Service (IPaaS), where the user gets a virtual machine (VM) with processing, memory, storage and netw...
IMAGE-BASED OCCUPANCY SENSING AND PRIVACY IMPLICATIONS Haroon, Hammad; Pekeriçli, Mehmet Koray; Department of Building Science in Architecture (2022-7-07) As the use of data collection in the built environment increased, data pertaining to building occupancy has gained considerable importance in realms such as energy optimization and spatial usage analytics. However, many data collection approaches infringe on individuals’ rights to privacy, and subsequently their comfort. This thesis aims to address the tension between the proliferation of smart building technologies and individual privacy and autonomy, specifically focusing on image-based sensing. It explor...
Optimizing age of information on real-life TCP/IP connections through reinforcement learning Sert, Egemen; Sonmez, Canberk; Baghaee, Sajjad; Uysal, Elif (2018-07-05) Age of Information (AoI) has emerged as a performance metric capturing the freshness of data for status-update based applications ( e.g. , remote monitoring) as a more suitable alternative to classical network performance indicators such as throughput or delay. Optimizing AoI often requires distinctly novel and sometimes counter-intuitive networking policies that adapt the rate of update transmissions to the randomness in network resources. However, almost all previous work on AoI to data has been theoretic...

Citation Formats

S. Yang, A. Hareedy, R. Calderbank, and L. Dolecek, “Hierarchical coding to enable scalability and flexibility in heterogeneous cloud storage,” presented at the 2019 IEEE Global Communications Conference, GLOBECOM 2019, Hawaii, Amerika Birleşik Devletleri, 2019, Accessed: 00, 2022. [Online]. Available: https://hdl.handle.net/11511/98500.