Efficient Execution of Multi-query Data Analysis Batches Using Compiler Optimization Strategies [chapter]

Henrique Andrade, Suresh Aryangat, Tahsin Kurc, Joel Saltz, Alan Sussman
2004 Lecture Notes in Computer Science  
This work investigates the leverage that can be obtained from compiler optimization techniques for efficient execution of multiquery workloads in data analysis applications. Our approach is to address multi-query optimization at the algorithmic level, by transforming a declarative specification of scientific data analysis queries into a highlevel imperative program that can be made more efficient by applying compiler optimization techniques. These techniques -including loop fusion, common
more » ... ression elimination and dead code eliminationare employed to allow data and computation reuse across queries. We describe a preliminary experimental analysis on a real remote sensing application that analyzes very large quantities of satellite data. The results show our techniques achieve sizable reductions in the amount of computation and I/O necessary for executing query batches and in average execution times for the individual queries in a given batch.
doi:10.1007/978-3-540-24644-2_33 fatcat:k4glcqv2knepzlpsuzodm547yq