Balanced Schedule on Storm for Performance Enhancement

Arwa Z. Selim, Noha E. El-Attar, I. M. Hanafy, Wael A. Awad
2022 International Journal of Advanced Computer Science and Applications  
In recent years, real-time and big data aroused and received a lot of attention due to the spread of embedded systems in almost everything in life. This has led to many challenges that need to be solved to enhance and improve systems that work on big real-time data. Apache Storm is a system used for computing and analyzing big real-time data of distributed systems. This paper aims to develop a scheduler to improve the scheduling of the applications represented by topologies on the Storm
more » ... The proposed scheduler is hybridization between the scheduling algorithms of A3 Storm and the Workload scheduler. Its objective is to minimize the communication between tasks while balancing the workload on all cluster machines. The proposed scheduler is compared with the A3 Storm and Fischer and Bernstein's scheduling algorithm. The comparison has been made using four different topologies. The experimental results show that our proposed scheduler outperforms the two other schedulers in throughput and complete latency.
doi:10.14569/ijacsa.2022.0130175 fatcat:6klrxvftgzcm3eh22yi3ud4nj4