Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems [chapter]

Javier García Blas, Florin Isailă, J. Carretero, Robert Latham, Robert Ross
2009 Lecture Notes in Computer Science  
This paper presents the design and implementation of an asynchronous data-staging strategy for file accesses based on ROMIO, the most popular MPI-IO distribution, and ZeptoOS, an open source operating system solution for Blue Gene systems. We describe and evaluate a two-level file write-back implementation and a one-level prefetching solution. The experimental results demonstrate that both solutions achieve high performance through a high degree of overlap between computation, communication, and file I/O.
doi:10.1007/978-3-642-03770-2_23 fatcat:zjpiuv4xbrcwrgjxwfiovqf4le