IaaS Cloud Benchmarking: Approaches, Challenges, and Experience [chapter]

Alexandru Iosup, Radu Prodan, Dick Epema
2014 Cloud Computing for Data-Intensive Applications  
Infrastructure-as-a-Service (IaaS) cloud computing is an emerging commercial infrastructure paradigm under which clients (users) can lease resources when and for how long needed, under a cost model that reflects the actual usage of resources by the client. For IaaS clouds to become mainstream technology and for current cost models to become more clientfriendly, benchmarking and comparing the non-functional system properties of various IaaS clouds is important, especially for the cloud users. In
more » ... this article we focus on the IaaS cloudspecific elements of benchmarking, from a user's perspective. We propose a generic approach for IaaS cloud benchmarking, discuss numerous challenges in developing this approach, and summarize our experience towards benchmarking IaaS clouds. We argue for an experimental approach that requires, among others, new techniques for experiment compression, new benchmarking methods that go beyond blackbox and isolated-user testing, new benchmark designs that are domain-specific, and new metrics for elasticity and variability.
doi:10.1007/978-1-4939-1905-5_4 fatcat:27lr6kkccvdydmviuot6f2khgm