Metric-based selection of timer methods for accurate measurements

Michael Kuperberg, Martin Krogmann, Ralf Reussner
2011 Proceeding of the second joint WOSP/SIPEW international conference on Performance engineering - ICPE '11  
Performance measurements are often concerned with accurate recording of timing values, which requires timer methods of high quality. Evaluating the quality of a given timer method or performance counter involves analysing several properties, such as accuracy, invocation cost and timer stability. These properties are metrics with platform-dependent values, and ranking and selecting timer methods requires comparisons using multidimensional metric sets, which make the comparisons ambiguous and
more » ... cessary complex. To solve this problem, this paper proposes a new unified metric that allows for a simpler comparison. The one-dimensional metric is designed to capture fine-granular differences between timer methods, and normalises accuracy and other quality attributes by using CPU cycles instead of time units. The proposed metric is evaluated on all timer methods provided by Java and .NET platform APIs.
doi:10.1145/1958746.1958770 dblp:conf/wosp/KuperbergKR11 fatcat:c2gluwqf7bfi7agrvydti3bfti