Compiler Optimization for Extreme-Scale Scripting

Timothy G. Armstrong, Justin M. Wozniak, Michael Wilde, Ian T. Foster
2014 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing  
The data-driven task parallelism execution model can support parallel programming models that are well suited for large-scale distributed-memory parallel computing, for example, simulations and analysis pipelines running on clusters and clouds. We describe a novel compiler intermediate representation and optimizations for this execution model, including adaptions of standard techniques alongside novel techniques. These techniques are applied to Swift/T, a high-level scripting language for
more » ... le data flow composition of functions, which may be serial or use lower-level parallel programming models such as MPI and OpenMP. This paper presents preliminary results, indicating that our compiler optimizations reduce communication overhead by 70% to 93% on distributed-memory systems.
doi:10.1109/ccgrid.2014.115 dblp:conf/ccgrid/ArmstrongWWF14 fatcat:74numjfokbbj5kejpairnteyme