Beyond accuracy

Mouzhi Ge, Carla Delgado-Battenfeld, Dietmar Jannach
2010 Proceedings of the fourth ACM conference on Recommender systems - RecSys '10  
When we evaluate the quality of recommender systems (RS), most approaches only focus on the predictive accuracy of these systems. Recent works suggest that beyond accuracy there is a variety of other metrics that should be considered when evaluating a RS. In this paper we focus on two crucial metrics in RS evaluation: coverage and serendipity. Based on a literature review, we first discuss both measurement methods as well as the tradeoff between good coverage and serendipity. We then analyze
more » ... role of coverage and serendipity as indicators of recommendation quality, present novel ways of how they can be measured and discuss how to interpret the obtained measurements. Overall, we argue that our new ways of measuring these concepts reflect the quality impression perceived by the user in a better way than previous metrics thus leading to enhanced user satisfaction.
doi:10.1145/1864708.1864761 dblp:conf/recsys/GeDJ10 fatcat:vx24khtqofchllearheod6cwy4