A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf
.
A Flexible Framework for Offline Effectiveness Metrics
2022
Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval
The use of offline effectiveness metrics is one of the cornerstones of evaluation in information retrieval. Static resources that include test collections and sets of topics, the corresponding relevance judgments connecting them, and metrics that map document rankings from a retrieval system to numeric scores have been used for multiple decades as an important way of comparing systems. The basis behind this experimental structure is that the metric score for a system can serve as a surrogate
doi:10.1145/3477495.3531924
fatcat:p2h7lbpjrffrjjsrkz5yznkjci