Methods for ranking information retrieval systems without relevance judgments

Shengli Wu, Fabio Crestani
2003 Proceedings of the 2003 ACM symposium on Applied computing - SAC '03  
In this paper we present some new methods of ranking information retrieval systems without relevance judgement. The common ground of these methods is using a measure we called reference count . An extensive experimentation was conducted to evaluate the effectiveness of the proposed methods using various different standards Information Retrieval evaluation measures for the ranking, like average precision, R-precision, and precision and different document levels. We also compared the
more » ... of the proposed methods with the method proposed by Soboroff et al. The experimental results showed that the proposed methods are effective, and in many cases are more effective than Soboroff at al.'s method.
doi:10.1145/952686.952693 fatcat:k2g55wzdaze3vprlkkj2ovozsu