A month in the life of a production news recommender system

Alan Said, Jimmy Lin, Alejandro Bellogín, Arjen de Vries
2013 Proceedings of the 2013 workshop on Living labs for information retrieval evaluation - LivingLab '13  
During the last decade, recommender systems have become a ubiquitous feature in the online world. Research on systems and algorithms in this area has flourished, leading to novel techniques for personalization and recommendation. The evaluation of recommender systems, however, has not seen similar progress-techniques have changed little since the advent of recommender systems, when evaluation methodologies were "borrowed" from related research areas. As an effort to move evaluation methodology
more » ... orward, this paper describes a production recommender system infrastructure that allows research systems to be evaluated in situ, by realworld metrics such as user clickthrough. We present an analysis of one month of interactions with this infrastructure and share our findings.
doi:10.1145/2513150.2513159 dblp:conf/cikm/SaidLBV13 fatcat:3xx56bngezdy5lmsgz6kpufywm