Time and Cost Sensitive Data-Intensive Computing on Hybrid Clouds

Tekin Bicer, David Chiu, Gagan Agrawal
2012 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)  
Purpose-built clusters permeate many of today's organizations, providing both large-scale data storage and computing. Within local clusters, competition for resources complicates applications with deadlines. However, given the emergence of the cloud's pay-as-you-go model, users are increasingly storing portions of their data remotely and allocating compute nodes ondemand to meet deadlines. This scenario gives rise to a hybrid cloud, where data stored across local and cloud resources may be
more » ... ssed over both environments. While a hybrid execution environment may be used to meet time constraints, users must now attend to the costs associated with data storage, data transfer, and node allocation time on the cloud. In this paper, we describe a modeling-driven resource allocation framework to support both time and cost sensitive execution for data-intensive applications executed in a hybrid cloud setting. We evaluate our framework using two dataintensive applications and a number of time and cost constraints. Our experimental results show that our system is capable of meeting execution deadlines within a 3.6% margin of error.
doi:10.1109/ccgrid.2012.95 dblp:conf/ccgrid/BicerCA12 fatcat:mmq5kxt4uzef5dqlmexnascv3i