Dynamic Load-Balancing and High Performance Communication in Jcluster

Bao-Yin Zhang, Ze-Yao Mo, Guang-Wen Yang, Wei-Min Zheng
2007 2007 IEEE International Parallel and Distributed Processing Symposium  
This paper describes the dynamic load-balancing and high performance communication provided in Jcluster, an efficient Java parallel environment. For the efficient loadbalancing, we implement a task scheduler based on a Transitive Random Stealing algorithm, which improves the Random Stealing, a well-known load-balancing algorithm. The experiment results show that the scheduler performs efficiently, especially for a large-scale cluster. With the method of asynchronously multithreaded
more » ... readed transmission, a high performance PVM-like and MPI-like message passing interface is implemented in pure Java. The evaluation of the communication performance is conducted among Jcluster, LAM-MPI and mpiJava on LAM-MPI based on the Java Grande Forum's pingpong benchmark.
doi:10.1109/ipdps.2007.370417 dblp:conf/ipps/ZhangMYZ07 fatcat:id4vxflh7fhw5mg2siqcprhhjy