Application-specific I/O Optimizations on Petascale Supercomputers

Efecan Poyraz, Heming Xu, Yifeng Cui
2014 Procedia Computer Science  
Data-intensive science frontiers and challenges are emerg ing as computer technology has evolved substantially. Large-scale simu lations demand significant I/ O workload, and as a result the I/O performance often becomes a bottleneck preventing high performance in scientific applications. In this paper we introduce a variety of I/ O optimization techniques developed and implemented when scaling a seismic application to petascale. These techniques include file system striping, data aggreg ation,
more » ... reader/writer limit ing and less interleaving of data, collective MPI-IO, and data staging. The optimizations result in nearly perfect scalability of the target applicat ion on some of the most advanced petascale systems. The techniques introduced in this paper are applicab le to other scientific applications facing similar petascale I/O challenges.
doi:10.1016/j.procs.2014.05.082 fatcat:k4kzmje24je67invuvn6o4uxbu