Job Superscheduler Architecture and Performance in Computational Grid Environments

Hongzhang Shan, Leonid Oliker, Rupak Biswas
2003 Proceedings of the 2003 ACM/IEEE conference on Supercomputing - SC '03  
Computational grids hold great promise in utilizing geographically separated heterogeneous resources to solve large-scale complex scientific problems. However, a number of major technical hurdles, including distributed resource management and effective job scheduling, stand in the way of realizing these gains. In this paper, we propose a novel grid superscheduler architecture and three distributed job migration algorithms. We also model the critical interaction between the superscheduler and
more » ... onomous local schedulers. Extensive performance comparisons with ideal, central, and local schemes using real workloads from leading computational centers are conducted in a simulation environment. Additionally, synthetic workloads are used to perform a detailed sensitivity analysis of our superscheduler. Several key metrics demonstrate that substantial performance gains can be achieved via smart superscheduling in distributed computational grids.
doi:10.1145/1048935.1050194 dblp:conf/sc/ShanOB03 fatcat:n7nodwsxdvfgtixrozk2vbcq7i