A survey of pipelined workflow scheduling

Anne Benoit, Ümit V. Çatalyürek, Yves Robert, Erik Saule
2013 ACM Computing Surveys  
A large class of applications need to execute the same workflow on different data sets of identical size. Efficient execution of such applications necessitates intelligent distribution of the application components and tasks on a parallel machine, and the execution can be orchestrated by utilizing task-, data-, pipelined-, and/or replicated-parallelism. The scheduling problem that encompasses all of these techniques is called pipelined workflow scheduling, and it has been widely studied in the
more » ... ast decade. Multiple models and algorithms have flourished to tackle various programming paradigms, constraints, machine behaviors or optimization goals. This paper surveys the field by summing up and structuring known results and approaches.
doi:10.1145/2501654.2501664 fatcat:avzu434g2zbptm532lii42bqx4