Software-based erasure codes for scalable distributed storage

J.A. Cooley, J.L. Mineweaser, L.D. Servi, E.T. Tsung
20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, 2003. (MSST 2003). Proceedings.  
This paper presents a new class of erasure codes, Lincoln Erasure codes (LEC), applicable to large-scale distributed storage that includes thousands of disks attached to multiple networks. A high-performance software implementation that demonstrates the capability to meet these anticipated requirements is described. A framework for evaluation of candidate codes was developed to support in-depth analysis. When compared with erasure codes based on the work of Reed-Solomon and Luby, tests indicate
more » ... uby, tests indicate LEC has a higher throughput for encoding and decoding and lower probability of failure across a range of test conditions. Strategies are described for integration with storage-related hardware and software.
doi:10.1109/mass.2003.1194852 dblp:conf/mss/CooleyMST03 fatcat:yzhi2rof5vhgdpqjqzcl4r5cny