Application of secretary algorithm to dynamic load balancing in user-space on multicore systems

Teng-Sheng Moh, Kyoung-Hwan Yun
2014 2014 International Conference on High Performance Computing & Simulation (HPCS)  
APPLICATION OF SECRETARY ALGORITHM TO DYNAMIC LOAD BALANCING IN USER-SPACE ON MULTICORE SYSTEMS by Kyoung-Hwan Yun In recent years, multicore processors have been so prevalent in many types of systems and are now widely used even in commodities for a wide range of applications. Although multicore processors are clearly a popular hardware solution to problems that were not possible with traditional single-core processors, taking advantage of them are inevitably met by software challenges. As
more » ... hl's law puts it, the performance gain is limited by the percentage of the software that cannot be run in parallel on multiple cores. Even when an application is "embarrassingly" parallelized by a careful design of algorithm and implementation, load balancing of tasks across different cores is a very important and critical aspect in utilizing a multicore system as close to its fullest potential as possible. In this paper, we investigate how a solution to a cardinal payoff variant of the secretary problem can be applied to a proactive, decentralized, dynamic load balancing technique in user-space to assist single program, multiple data (SPMD) applications in multiprogrammed environment so that all tasks can make roughly equal progress distributed over all cores. We examine how this method compares with the default Linux load balancer in terms of scalability and predictability. Our experiments show promising results that show our technique outperforms the default Linux scheduler by an average 40% speedup in multiprogrammed environment with less time variance among multiple executions. ACKNOWLEDGEMENTS I would like to express my sincere thanks and indebtedness to my advisor, Dr. Teng Moh, for his invaluable inspirations and guidance throughout the course of study and this project. He has instilled in me much interest in the areas of distributed computing, randomized algorithms, and machine learning. My gratitude goes out as well to the rest of my master's committee members, Dr. Melody Moh and Dr. Robert Chun, for their gracious offer of time and advice.
doi:10.1109/hpcsim.2014.6903793 dblp:conf/hpcs/MohY14 fatcat:cghto5lhxjbx5pypzqudnbfgwy