A hypergraph partitioning based approach for scheduling of tasks with batch-shared I/O

Gaurav Khanna, Nagavijayalakshmi Vydyanathan, T. Kurc, U. Catalyurek, P. Wyckoff, J. Saltz, P. Sadayappan
2005 CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005.  
This paper proposes a novel, hypergraph partitioning based strategy to schedule multiple data analysis tasks with batchshared I/O behavior. This strategy formulates the sharing of files among tasks as a hypergraph to minimize the I/O overheads due to transferring of the same set of files multiple times and employs a dynamic scheme for file transfers to reduce contention on the storage system. We experimentally evaluate the proposed approach using application emulators from two application
more » ... s; analysis of remotelysensed data and biomedical imaging.
doi:10.1109/ccgrid.2005.1558643 dblp:conf/ccgrid/KhannaVKCWSS05 fatcat:wrjvt2u4jbatvjwm6bm22dk54q