Bias and Fairness in Effectiveness Evaluation by Means of Network Analysis and Mixture Models

Kevin Roitero, Stefano Mizzaro, Michael Soprano
2019 Italian Information Retrieval Workshop  
Information retrieval effectiveness evaluation is often carried out by means of test collections. Many works investigated possible sources of bias in such an approach. We propose a systematic approach to identify bias and its causes, and to remove it, thus enforcing fairness in effectiveness evaluation by means of test collections.
dblp:conf/iir/RoiteroMS19 fatcat:2qhxzlgwyfd2fd66syqelrm4qu