Hierarchical Coding for Cloud Storage: Topology-Adaptivity, Scalability, and Flexibility

Download

index.pdf

Date

2022-06-01

Author

Yang, Siyi
Hareedy, Ahmed
Calderbank, Robert
Dolecek, Lara

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

147
views

46
downloads

In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and heterogeneous. The recent rise of the blockchain technology is also moving various information systems towards decentralization to achieve high privacy at low costs. While codes with hierarchical locality have been intensively studied in the context of centralized cloud storage due to their effectiveness in reducing the average reading time, those for decentralized storage networks (DSNs) have not yet been discussed. In this paper, we propose a joint coding scheme where each node receives extra protection through the cooperation with nodes in its neighborhood in a heterogeneous DSN with any given topology. This work extends and subsumes our prior work on coding for centralized cloud storage. In particular, our proposed construction not only preserves desirable properties such as scalability and flexibility, which are critical in dynamic networks, but also adapts to arbitrary topologies, a property that is essential in DSNs but has been overlooked in existing works.

Subject Keywords

cooperative data protection, decentralized storage networks, flexibility, Joint hierarchical coding, scalability

URI

https://hdl.handle.net/11511/97706

Journal

IEEE Transactions on Information Theory

DOI

https://doi.org/10.1109/tit.2022.3149454

Collections

Department of Electrical and Electronics Engineering, Article

Suggestions

OpenMETU
Core

Hierarchical coding to enable scalability and flexibility in heterogeneous cloud storage Yang, Siyi; Hareedy, Ahmed; Calderbank, Robert; Dolecek, Lara (2019-12-01) In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and heterogeneous. Codes with hierarchical locality have been intensively studied due to their effectiveness in reducing the average reading time in cloud storage. In this paper, we present the first codes with hierarchical locality that achieve scalability and flexibility in he...
Topology-Aware Cooperative Data Protection in Blockchain-Based Decentralized Storage Networks Yang, Siyi; Hareedy, Ahmed; Calderbank, Robert; Dolecek, Lara (2020-06-01) The continuous rise of the blockchain technology is moving various information systems towards decentralization. Blockchain-based decentralized storage networks (DSNs) offer significantly higher privacy and lower costs to customers compared with centralized cloud storage associated with specific vendors. Coding is required to retrieve data stored on failing components. While coding solutions for centralized storage have been intensely studied, those for DSNs have not yet been discussed. In this paper, we pr...
BIG DATA FOR INDUSTRY 4.0: A CONCEPTUAL FRAMEWORK Gökalp, Mert Onuralp; Kayabay, Kerem; Eren, Pekin Erhan; Koçyiğit, Altan (2016-12-17) Exponential growth in data volume originating from Internet of Things sources and information services drives the industry to develop new models and distributed tools to handle big data. In order to achieve strategic advantages, effective use of these tools and integrating results to their business processes are critical for enterprises. While there is an abundance of tools available in the market, they are underutilized by organizations due to their complexities. Deployment and usage of big data analysis t...
IMAGE-BASED OCCUPANCY SENSING AND PRIVACY IMPLICATIONS Haroon, Hammad; Pekeriçli, Mehmet Koray; Department of Building Science in Architecture (2022-7-07) As the use of data collection in the built environment increased, data pertaining to building occupancy has gained considerable importance in realms such as energy optimization and spatial usage analytics. However, many data collection approaches infringe on individuals’ rights to privacy, and subsequently their comfort. This thesis aims to address the tension between the proliferation of smart building technologies and individual privacy and autonomy, specifically focusing on image-based sensing. It explor...
Reinforcement Learning Based Adaptive Blocklength and MCS Selection for Minimization of Age Violation Probability Özkaya, Ayşenur; Ceran Arslan, Elif Tuğçe; Department of Electrical and Electronics Engineering (2022-1) As a measure of data freshness, Age of Information (AoI) is an important semantic performance metric in systems where small status update packets need to be delivered to a monitor in a timely manner. This study aims to minimize the age violation probability (AVP), which is defined as the probability that instantaneous age exceeds a certain threshold. The AVP can be considered as one of the key performance indicators in emerging 5G and beyond technologies such as massive machine-to-machine communications (mM...

Citation Formats

S. Yang, A. Hareedy, R. Calderbank, and L. Dolecek, “Hierarchical Coding for Cloud Storage: Topology-Adaptivity, Scalability, and Flexibility,” IEEE Transactions on Information Theory, vol. 68, no. 6, pp. 3657–3680, 2022, Accessed: 00, 2022. [Online]. Available: https://hdl.handle.net/11511/97706.