Filters








8 Hits in 4.3 sec

Report on the workshop on reproducibility and replication in recommender systems evaluation (RepSys)

Alejandro Bellogín, Pablo Castells, Alan Said, Domonkos Tikk
2014 SIGIR Forum  
Reproducibility and replication involve recommendation algorithm implementations, experimental protocols, and evaluation metrics.  ...  Experiment replication and reproduction are key requirements for empirical research methodology, and an important open issue in the field of Recommender Systems.  ...  for a lively workshop.  ... 
doi:10.1145/2641383.2641389 fatcat:oizjlpkbkves3b5a2irwa53x2m

Research paper recommender system evaluation

Joeran Beel, Stefan Langer, Marcel Genzmehr, Bela Gipp, Corinna Breitinger, Andreas Nürnberger
2013 Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation - RepSys '13  
Over 80 approaches for academic literature recommendation exist today. The approaches were introduced and evaluated in more than 170 research articles, as well as patents, presentations and blogs.  ...  Information on runtime and coverage was rarely provided.  ...  There is mostly consensus on what makes a good recommender system and on the methods to evaluate recommender systems [1, 11, 62] .  ... 
doi:10.1145/2532508.2532512 dblp:conf/recsys/BeelLGGBN13 fatcat:fenaekxxszaixda3xrq52i7ray

A comparative analysis of offline and online evaluations and discussion of research paper recommender system evaluation

Joeran Beel, Marcel Genzmehr, Stefan Langer, Andreas Nürnberger, Bela Gipp
2013 Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation - RepSys '13  
We discuss this finding in detail and conclude that offline evaluations may be inappropriate for evaluating research paper recommender systems, in many settings.  ...  We conducted a study in which we evaluated various recommendation approaches with both offline and online evaluations.  ...  To evaluate a recommender system, some ratings are removed, and the recommender system creates recommendations based on the information remaining.  ... 
doi:10.1145/2532508.2532511 dblp:conf/recsys/BeelGLNG13 fatcat:2bxioctjfrhgnne223bgjip5le

How to improve the statistical power of the 10-fold cross validation scheme in recommender systems

Andrej Košir, Ante Odić, Marko Tkalčič
2013 Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation - RepSys '13  
At this stage development of recommender systems (RS), an evaluation of competing approaches (methods) yielding similar performances in terms of experiment reproduction is of crucial importance in order  ...  In this work we provide guidelines on how to achieve the highest power in the comparison of RS and we demonstrate them on a comparison of RS performances when different variables are contextualized.  ...  INTRODUCTION The discussions on the evaluation in recommender systems have been mostly focused on the choice of the evaluation metric (e.g. RMSE vs. precision etc.).  ... 
doi:10.1145/2532508.2532510 dblp:conf/recsys/KosirOT13 fatcat:hjtybjpnvvag3bgrsx4qeh3kjy

Towards reproducibility in recommender-systems research

Joeran Beel, Corinna Breitinger, Stefan Langer, Andreas Lommatzsch, Bela Gipp
2016 User modeling and user-adapted interaction  
In this article, we examine the challenge of reproducibility in recommender-system research.  ...  Numerous recommendation approaches are in use today. However, comparing their effectiveness is a challenging task because evaluation results are rarely reproducible.  ...  This, in turn, would ease future research, increase the value of individual research contributions, and support the operators of recommender systems who seek the most effective recommendation approaches  ... 
doi:10.1007/s11257-016-9174-x fatcat:xhcr64duqza73ipqjkgeavgi7a

Towards Effective Research-Paper Recommender Systems and User Modeling based on Mind Maps [article]

Joeran Beel
2017 arXiv   pre-print
, and an online evaluation based on 430,893 recommendations displayed to 4,700 users.  ...  The recommender system builds user models based on the mind maps, and recommends research papers based on the user models.  ...  110 This chapter has been published as: Beel, Joeran, Bela Gipp, Ammar Shaker, and Nick Friedrich.  ... 
arXiv:1703.09109v1 fatcat:egcsnop34jbi7p2urz34pxr3vi

Towards effective research-paper recommender systems and user modeling based on mind maps [article]

Jöran Beel, Universitäts- Und Landesbibliothek Sachsen-Anhalt, Martin-Luther Universität, Andreas Nürnberger, Klaus Turowski
2018
The recommender system builds user models based on the users' mind maps, and recommends research papers based on the user models.  ...  , and an online evaluation based on 430,893 recommendations displayed to 4,700 users.  ...  as: Beel, Joeran, Bela Gipp, Ammar Shaker, and Nick Friedrich.  ... 
doi:10.25673/4222 fatcat:bju62zu6hvbjnow5pphq2p7vqy

Deliberative water governance : theory and practice in the Mekong region [article]

John Gregory Dore, University, The Australian National, University, The Australian National
2018
In doing so, it examines the theory and practice of deliberative water governance, informed and illustrated in a region that comprises Cambodia, Laos, Myanmar, Thailand, Vietnam and China's Yunnan Province  ...  I examine firstly international practice, including still-topical issues from the World Commission on Dams, and the potential of multi-stakeholder platforms.  ...  Acknowledgements In addition to this global Ashgate production, the paper is being included in a set of Mekong papers on wider water governance issues by the M-POWER network (www.mpowernet.org).  ... 
doi:10.25911/5d63bfe27aaa7 fatcat:ipknzttbsjb6dcw753o2cczbpe