Filters








311 Hits in 7.9 sec

A SURVEY OF SOLUTIONS AND FUTURE DIRECTIONS FOR THE CHALLENGES OF IMPLEMENTING ERASURE CODES IN CLOUD AND FOG COMPUTING

Rana Al-Shami, Faculty of Computer and Information Technology (FCIT), Sana'a University, Sana'a, Yemen
2020 International Journal of Advanced Research in Computer Science  
However, many challenges and open issues associated with the use of a code erasure approach in cloud and fog computing environments have arisen.  ...  More recently, computing storage systems have started implementing an erasure code approach in storing big data due to its many advantages such as reducing storage cost, providing fault tolerance, and  ...  In [36] authors proposed a framework for developing mean and tail latency in erasure-coded storage systems with content (cache) storage at the edge and they also proposed a temporary storage policy called  ... 
doi:10.26483/ijarcs.v11i5.6650 fatcat:6heoanig7rbarb5r4ncmluyh7m

Systematic Data Placement Optimization in Multi-Cloud Storage for Complex Requirements

Maomeng Su, Lei Zhang, Yongwei Wu, Kang Chen, Keqin Li
2016 IEEE transactions on computers  
Current works use multiple cloud storage providers with erasure coding to achieve certain benefits including fault-tolerance improving or vendor lock-in avoiding.  ...  In fact, the key to optimize the multi-cloud storage is to effectively choose providers and erasure coding parameters.  ...  In the in-house storage scenario, Windows Azure employed Local Reconstruction Codes (LRC) [36] to reduce the number of data blocks that have to be read to reconstruct lost or corrupted blocks, without  ... 
doi:10.1109/tc.2015.2462821 fatcat:bxxqobf7yjfbtgsjrcwajjgymu

An ensemble of replication and erasure codes for cloud file systems

Yadi Ma, Thyaga Nandagopal, Krishna P. N. Puttaswamy, Suman Banerjee
2013 2013 Proceedings IEEE INFOCOM  
While erasure coded schemes reduce storage cost, they are associated with large access latencies and high bandwidth cost.  ...  In this paper, we propose a novel scheme named CAROM, an ensemble of replication and erasure codes, to provide resiliency in cloud file systems with high efficiency.  ...  Therefore caching will reduce access latency of successive operations on the same data block. Recall that we store all files using a systematic erasure code.  ... 
doi:10.1109/infcom.2013.6566920 dblp:conf/infocom/MaNPB13 fatcat:aatcp4tnfbhodim2xdacrb2qpu

A Tale of Two Erasure Codes in HDFS

Mingyuan Xia, Mohit Saxena, Mario Blaum, David Pease
2015 USENIX Conference on File and Storage Technologies  
In this paper, we present HACFS, a new erasure-coded storage system that instead uses two different erasure codes and dynamically adapts to workload changes.  ...  It uses a fast code to optimize for recovery performance and a compact code to reduce the storage overhead.  ...  Similarly, HACFS migrates data between fast and compact erasure codes, however with the objective to reduce extra network transfers for recovery in distributed storage.  ... 
dblp:conf/fast/XiaSBP15 fatcat:lo2poczdjncoxlophwokko33ae

Exploiting Workload Characteristics and Service Diversity to Improve the Availability of Cloud Storage Systems

Bo Mao, Suzhen Wu, Hong Jiang
2016 IEEE Transactions on Parallel and Distributed Systems  
In HyRD, large files are distributed in multiple cost-efficient cloud storage providers with erasure-coded data redundancy while small files and file system metadata are replicated on multiple high-performance  ...  The experiments conducted on our lightweight prototype implementation of HyRD show that HyRD improves the cost efficiency by 33.4% and 20.4%, and reduces the access latency by 58.7% and 34.8% than the  ...  On the other hand, erasure codes offer a particular advantage for large files in that their access latency is reduced by virtue of the parallel accesses among multiple cloud providers.  ... 
doi:10.1109/tpds.2015.2475273 fatcat:2rnpzkzyrnakxmdesonpjcnnvq

On the Adoption of Erasure Code for Cloud Storage by Major Distributed Storage Systems

Aatish Chiniah, Avinash Mungur
2021 EAI Endorsed Transactions on Cloud Systems  
CONCLUSION: This paper provides researchers in the field with a comprehensive review of Distributed Storage Systems and how the adoption of erasure codes will enhance their capabilities.  ...  INTRODUCTION: Traditional Cloud Systems are struggling to cope with the exponential growth of data in todays' distributed application environment.  ...  The issue with erasure codes is that together with the benefits of reducing the storage space needed for the same amount of redundancy, it also brings along additional bandwidth requirements, storage overheads  ... 
doi:10.4108/eai.14-9-2021.170955 fatcat:2lbpvhzs2ffvrmkhisa2gyfzcu

Erasure coding for cloud storage systems: A survey

Jun Li, Baochun Li
2013 Tsinghua Science and Technology  
Conventional erasure coding techniques, such as Reed-Solomon codes, are able to achieve a much lower storage cost with the same level of tolerance against disk failures.  ...  However, it incurs much higher repair costs, not to mention an even higher access latency.  ...  tradeoff between replication and MDS codes, which reduce the number of blocks accessed with a sacrifice of storage overhead.  ... 
doi:10.1109/tst.2013.6522585 fatcat:4a5uadseg5bg7fg5yu2uojs764

A cost effective multi-cloud data hosting scheme using charm

2016 International Journal of Latest Trends in Engineering and Technology  
In cloud computing, data is encoded into "n blocks including "m data blocks and "n [] m coding blocks, and these blocks are put into "n different clouds.  ...  An erasure code is a forward error correction (FEC) code for the binary erasure channel, in which a message of k symbols is transformed into a longer message (code word) with n symbols, such that the original  ... 
doi:10.21172/1.74.013 fatcat:c374jxk4bja3hpge46hv334uoq

Reliable Multi-cloud Storage Architecture Based on Erasure Code to Improve Storage Performance and Failure Recovery

Emmy Mugisha, Gongxuan Zhang
2017 International Journal of Advanced Cloud Computing and Applied Research  
This study proposes Reliable Multi-Cloud Storage Architecture (RMCSA) based on Erasure Codes, that content can be dispersed to different cloud storage providers to reduce challenges which lead to Lock-In  ...  Cloud storage disperses content blocks over single cloud storage nodes.  ...  Erasure Coding Concepts In cloud storage system, tenants store their content in the cloud and no longer possess the content locally.  ... 
doi:10.23953/cloud.ijaccar.260 fatcat:cwifw7w2j5ch3p5nlx5mxms3da

Adaptive Bandwidth-Efficient Recovery Techniques in Erasure-Coded Cloud Storage [chapter]

Rekha Nachiappan, Bahman Javadi, Rodrigo N. Calheiros, Kenan M. Matawie
2018 Lecture Notes in Computer Science  
In this paper, we propose a hybrid technique employing proactive replication of data blocks in erasure-coded storage systems.  ...  Experiments show that our approach improves repair bandwidth efficiency and reduces network traffic in cloud storage systems with limited storage overhead compared to available recovery approaches.  ...  Proactive replication reduces the number of blocks required for reconstructions in erasure coded cloud storage system. Hence, the system reduces network traffic with less storage overhead.  ... 
doi:10.1007/978-3-319-96983-1_23 fatcat:pevxvo4lfjfojedtyjq5whcts4

A Survey on Regenerating Codes for Distributed Cloud Storage

Sophia S, Dr. Sharvani G S
2015 International Journal of Engineering Research and  
In this paper we discuss about the various regenerating codes in order to improve storage efficiency and low repair traffic compare with traditional erasure code (eg. Reed Solomon codes).  ...  To provide fault tolerant in cloud storage it is necessary to strip data in multiple cloud server and need to reconstruct the lost data from other existing cloud server to preserve data redundancy is known  ...  But in case of erasure code Reed Solomon has less storage overhead than the replication with same faults tolerant. [6] The striping of data in distributed cloud storage using the conventional erasure  ... 
doi:10.17577/ijertv4is060014 fatcat:g6knyey3jbf6hl4t673xqj5wmm

On the Cost of Safe Storage for Public Clouds: An Experimental Evaluation

Dorian Burihabwa, Rogerio Pontes, Pascal Felber, Francisco Maia, Hugues Mercier, Rui Oliveira, Joao Paulo, Valerio Schiavoni
2016 2016 IEEE 35th Symposium on Reliable Distributed Systems (SRDS)  
However, most users tend to forget-or worse ignore-some of the main drawbacks of such cloud-based services, namely in terms of privacy.  ...  Cloud-based storage services such as Dropbox, Google Drive and OneDrive are increasingly popular for storing enterprise data, and they have already become the de facto choice for cloud-based backup of  ...  Moreover, erasure coding reduces by a fraction the costs of data migration from one cloud provider to another when compared to replication [6] .  ... 
doi:10.1109/srds.2016.028 dblp:conf/srds/BurihabwaPFMMOP16 fatcat:zra3dp2fujcqlmpu2wlnxlsssm

RACS

Hussam Abu-Libdeh, Lonnie Princehouse, Hakim Weatherspoon
2010 Proceedings of the 1st ACM symposium on Cloud computing - SoCC '10  
erasure-coding parameters.  ...  In this paper, we make a case for applying RAID-like techniques used by disks and file systems, but at the cloud storage level.  ...  ACKNOWLEDGMENTS We would like to thank the Internet Archive (Brewster Kahle), Fedora Commons/DuraCloud (Sandy Payette), and Amazon (Werner Vogels) for access to their system, traces and initial discussions  ... 
doi:10.1145/1807128.1807165 dblp:conf/cloud/Abu-LibdehPW10 fatcat:6vyedw3thfgcjbk52aktv6dm3a

Cost-optimized redundant data storage in the cloud

Philipp Waibel, Johannes Matt, Christoph Hochreiner, Olena Skarlat, Ronny Hans, Stefan Schulte
2017 Service Oriented Computing and Applications  
The use of cloud-based storage systems for storing data is a popular alternative to local storage systems.  ...  Beside several benefits of cloud-based storages, there are also downsides like vendor lock-in or unavailability.  ...  Acknowledgements Open access funding provided by TU Wien (TUW).  ... 
doi:10.1007/s11761-017-0218-9 fatcat:fb5qk7xs4farlat65ycdkw2wcm

New approaches to security and availability for cloud data

Ari Juels, Alina Oprea
2013 Communications of the ACM  
With a new technique called an integrity-protected dispersal code, it's possible to use parity blocks of the dispersal code themselves as MACs on the rows, and thus reduce the storage overhead for integrity  ...  To provide resilience against cloud provider failure, the gateway splits the data into fixed-sized blocks, and encodes the data with a new erasure code called dispersal code.  ... 
doi:10.1145/2408776.2408793 fatcat:bikcezie4zegpocmqhw6r2fvsu
« Previous Showing results 1 — 15 out of 311 results