An Empirical Investigation of the Component-Based Performance Prediction Method Palladio [chapter]

Ralf Reussner, Steffen Becker, Anne Koziolek, Heiko Koziolek
2013 Perspectives on the Future of Software Engineering  
Model-based performance prediction methods aim at evaluating the expected response time, throughput, and resource utilization of a software system at design time, before implementation, to achieve predictability of the system's performance characteristics. Existing performance prediction methods use monolithic, throw-away prediction models or component-based, reusable prediction models. While it is intuitively clear that the development of reusable models requires more effort, the actual higher
more » ... amount of effort had not been quantified or analysed systematically yet. Furthermore, the achieved prediction accuracy of the methods when applied by developers had not yet been compared. To study the effort, we conducted a controlled experiment with 19 computer science students who predicted the performance of two example systems applying an established, monolithic method (Software Performance Engineering) as well as our own component-based method (Palladio) in 2007. This paper summarizes two earlier papers on this study. The results show that the effort of model creation with Palladio is approximately 1.25 times higher than with SPE in our experimental setting, with the resulting models having comparable prediction accuracy. Therefore, in some cases, the creation of reusable prediction models can already be justified, if they are reused at least once.
doi:10.1007/978-3-642-37395-4_13 dblp:conf/birthday/Reussner0KK13 fatcat:mdbaqc2g6jeptl7elxykjnqsie