Query Optimization over Web Services

Utkarsh Srivastava, Kamesh Munagala, Jennifer Widom, Rajeev Motwani
2006 Very Large Data Bases Conference  
Web services are becoming a standard method of sharing data and functionality among loosely-coupled systems. We propose a generalpurpose Web Service Management System (WSMS) that enables querying multiple web services in a transparent and integrated fashion. This paper tackles a first basic WSMS problem: query optimization for Select-Project-Join queries spanning multiple web services. Our main result is an algorithm for arranging a query's web service calls into a pipelined execution plan that
more » ... optimally exploits parallelism among web services to minimize the query's total running time. Surprisingly, the optimal plan can be found in polynomial time even in the presence of arbitrary precedence constraints among web services, in contrast to traditional query optimization where the analogous problem is NP-hard. We also give an algorithm for determining the optimal granularity of data "chunks" to be used for each web service call. Experiments with an initial prototype indicate that our algorithms can lead to significant performance improvement over more straightforward techniques.
dblp:conf/vldb/SrivastavaMWM06 fatcat:g5a73ka53jbp5jk3bjkkaaluau