A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf
.
Active Sampling for Large-scale Information Retrieval Evaluation
2017
Proceedings of the 2017 ACM on Conference on Information and Knowledge Management - CIKM '17
Evaluation is crucial in Information Retrieval. The development of models, tools and methods has significantly benefited from the availability of reusable test collections formed through a standardized and thoroughly tested methodology, known as the Cranfield paradigm. Constructing these collections requires obtaining relevance judgments for a pool of documents, retrieved by systems participating in an evaluation task; thus involves immense human labor. To alleviate this effort different
doi:10.1145/3132847.3133015
dblp:conf/cikm/LiK17
fatcat:qbk6yzqkwne33o6d4gotbkxr3y