Hierarchical Coding for Cloud Storage: Topology-Adaptivity, Scalability, and Flexibility

Download
2022-06-01
Yang, Siyi
Hareedy, Ahmed
Calderbank, Robert
Dolecek, Lara
In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and heterogeneous. The recent rise of the blockchain technology is also moving various information systems towards decentralization to achieve high privacy at low costs. While codes with hierarchical locality have been intensively studied in the context of centralized cloud storage due to their effectiveness in reducing the average reading time, those for decentralized storage networks (DSNs) have not yet been discussed. In this paper, we propose a joint coding scheme where each node receives extra protection through the cooperation with nodes in its neighborhood in a heterogeneous DSN with any given topology. This work extends and subsumes our prior work on coding for centralized cloud storage. In particular, our proposed construction not only preserves desirable properties such as scalability and flexibility, which are critical in dynamic networks, but also adapts to arbitrary topologies, a property that is essential in DSNs but has been overlooked in existing works.
IEEE Transactions on Information Theory

Suggestions

Hierarchical coding to enable scalability and flexibility in heterogeneous cloud storage
Yang, Siyi; Hareedy, Ahmed; Calderbank, Robert; Dolecek, Lara (2019-12-01)
In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and heterogeneous. Codes with hierarchical locality have been intensively studied due to their effectiveness in reducing the average reading time in cloud storage. In this paper, we present the first codes with hierarchical locality that achieve scalability and flexibility in he...
Topology-Aware Cooperative Data Protection in Blockchain-Based Decentralized Storage Networks
Yang, Siyi; Hareedy, Ahmed; Calderbank, Robert; Dolecek, Lara (2020-06-01)
The continuous rise of the blockchain technology is moving various information systems towards decentralization. Blockchain-based decentralized storage networks (DSNs) offer significantly higher privacy and lower costs to customers compared with centralized cloud storage associated with specific vendors. Coding is required to retrieve data stored on failing components. While coding solutions for centralized storage have been intensely studied, those for DSNs have not yet been discussed. In this paper, we pr...
IMAGE-BASED OCCUPANCY SENSING AND PRIVACY IMPLICATIONS
Haroon, Hammad; Pekeriçli, Mehmet Koray; Department of Building Science in Architecture (2022-7-07)
As the use of data collection in the built environment increased, data pertaining to building occupancy has gained considerable importance in realms such as energy optimization and spatial usage analytics. However, many data collection approaches infringe on individuals’ rights to privacy, and subsequently their comfort. This thesis aims to address the tension between the proliferation of smart building technologies and individual privacy and autonomy, specifically focusing on image-based sensing. It explor...
Optimal dynamic resource allocation for heterogenous cloud data centers
Ekici, Nazım Umut; Güran Schmidt, Şenan.; Department of Electrical and Electronics Engineering (2019)
Today's data centers are mostly cloud-based with virtualized servers to provide on-demand scalability and flexibility of the available resources such as CPU, memory, data storage and network bandwidth. Heterogeneous cloud data centers (CDCs) offer hardware accelerators in addition to these standard cloud server resources. A cloud data center provider may provide Infrastructure as a Service and Platform as a Service (IPaaS), where the user gets a virtual machine (VM) with processing, memory, storage and netw...
Distributed Connectivity Restoration in Underwater Acoustic Sensor Networks via Depth Adjustment
Uzun, Erkay; ŞENEL, FATİH; Akkaya, Kemal; Yazıcı, Adnan (2015-06-12)
In most applications of Underwater Acoustic Sensor Networks, network connectivity is required for data exchange, data aggregation and relaying the data to a surface station. However, such connectivity can be lost due to failure of some sensor nodes which creates disruptions to the network operations. In this paper, we present two algorithms, namely BMR and DURA, which can detect network partitioning due to such node failures and re-establish network connectivity through controlled depth adjustment of nodes ...
Citation Formats
S. Yang, A. Hareedy, R. Calderbank, and L. Dolecek, “Hierarchical Coding for Cloud Storage: Topology-Adaptivity, Scalability, and Flexibility,” IEEE Transactions on Information Theory, vol. 68, no. 6, pp. 3657–3680, 2022, Accessed: 00, 2022. [Online]. Available: https://hdl.handle.net/11511/97706.