Comparing relevance feedback algorithms for web search

Vishwa Vinay, Ken Wood, Natasa Milic-Frayling, Ingemar J. Cox
2005 Special interest tracks and posters of the 14th international conference on World Wide Web - WWW '05  
We evaluate three different relevance feedback (RF) algorithms, Rocchio, Robertson/Sparck-Jones (RSJ) and Bayesian, in the context of Web search. We use a target-testing experimental procedure whereby a user must locate a specific document. For user relevance feedback, we consider all possible user choices of indicating zero or more relevant documents from a set of 10 displayed documents. Examination of the effects of each user choice permits us to compute an upper-bound on the performance of
more » ... ch RF algorithm. We find that there is a significant variation in the upper-bound performance of the three RF algorithms and that the Bayesian algorithm approaches the best possible.
doi:10.1145/1062745.1062864 dblp:conf/www/VinayWMC05 fatcat:gfzl7zocnvae5hnfxjqseqfn5q