FlexFS: Transparent resilience for GRID storage resources

Konstantinos Tsakalozos, Vassil Kriakov, Alex Delis
2009 2009 International Symposium on Autonomous Decentralized Systems  
Existing GRID infrastructures rely on explicit user instructions in order to replicate files for the purposes of resiliency. This human-intensive process is inefficient, error prone and, more importantly, makes file replication in GRIDs a cumbersome task. To address this problem, we introduce FlexFS -a fully automated file-system framework that seamlessly plugs into existing GRID structures providing automated file replication and transparent-to-user resilience. FlexFS breaks apart files into
more » ... ocks and injects resilient information into these blocks through the use of Forward Erasure Correction codes. FlexFS employs a number of methods that facilitate the automated storage and efficient retrieval of the blocks in order to provide I/O throughput similar to that of local hard disks, all in the face of ever-changing utilization and availability of the GRID resources. Compared to currently available GRID replication schemes, FlexFS attains 15% to 230% higher throughput, both for reading and writing files.
doi:10.1109/isads.2009.5207356 dblp:conf/isads/TsakalozosKD09 fatcat:prf2s2tm45fjjdlvawrferwjve