Scheduling Strategies for Cycle Scavenging in Multicluster Grid Systems

Ozan Sonmez, Bart Grundeken, Hashim Mohamed, Alexandru Iosup, Dick Epema
2009 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid  
The use of today's multicluster grids exhibits periods of submission bursts with periods of normal use and even of idleness. To avoid resource contention, many users employ observational scheduling, that is, they postpone the submission of relatively low-priority jobs until a cluster becomes (largely) idle. However, observational scheduling leads to resource contention when several such users crowd the same idle cluster. Moreover, this job execution model either delays the execution of more
more » ... rtant jobs, or requires extensive administrative support for job and user priorities. Instead, in this work we investigate the use of cycle scavenging to run jobs on grid resources politely yet efficiently, and with an acceptable administrative cost. We design a twolevel cycle scavenging scheduling architecture that runs unobtrusively alongside regular grid scheduling. We equip this scheduler with two novel cycle scavenging scheduling policies that enforce fair resource sharing among competing cycle scavenging users. We show through experiments with real and synthetic applications in a real multicluster grid that the proposed architecture can execute jobs politely yet efficiently.
doi:10.1109/ccgrid.2009.46 dblp:conf/ccgrid/SonmezGMIE09 fatcat:4tf7mevvkjcqzc6vteywcvqm6i