Combining Families of Information Retrieval Algorithms Using Metalearning [chapter]

Michael Cornelson, Ed Greengrass, Robert L. Grossman, Ron Karidi, Daniel Shnidman
2004 Survey of Text Mining  
This paper describes some experiments which use meta-learning to combine families of information retrieval (IR) algorithms obtained by varying the normalizations and similarity functions. By meta-learning, we mean the following simple idea: a family of IR algorithms is applied to a corpus of documents in which relevance is known to produce a learning set. A machine learning algorithm is then applied to this data set to produce a classifier which combines the different IR algorithms. In
more » ... rithms. In experiments with TREC-3 data, we could significantly improve precision at the same level of recall with this technique. Most prior work in this area has focused on combining different IR algorithms with various averaging schemes or has used a fixed combining function. The combining function in meta-learning is a statistical model itself which in general depends on the document, the query, and the various scores produced by the different component IR algorithms.
doi:10.1007/978-1-4757-4305-0_7 fatcat:3pa6qs5pyzbdpnmww6nnrp5nwe