Filters








1,123 Hits in 2.0 sec

Term Proximity Scoring for Keyword-Based Retrieval Systems [chapter]

Yves Rasolofo, Jacques Savoy
2003 Lecture Notes in Computer Science  
This paper suggests the use of proximity measurement in combination with the Okapi probabilistic model.  ...  Our experiments were conducted using the TREC8, TREC9 and TREC10 test collections, and show that the suggested approach is stable and generally tends to improve retrieval effectiveness especially at the  ...  TREC-9: Query-by-query average precision difference (OkaTP-Okapi) Collection + - = Sign test TREC-8 TREC-9 TREC-10 29 19 23 15 12 16 3 5 3 Okapi < OkaTP Okapi = OkaTP Okapi = OkaTP  ... 
doi:10.1007/3-540-36618-0_15 fatcat:hbhtdyoyrzamlljscmhv6lfwnm

Investigate the use of Anchor-Text and of Query-Document Similarity Scores to Predict the Performance of Search Engine

Abdulmohsen Almalawi, Rayed AlGhamdi, Adel Fahad
2017 International Journal of Advanced Computer Science and Applications  
It evaluated the performance of the predictors based on 1) the correlation between the average precision (AP), 2) the precision at 10 (P@10) of the full text retrieved results, 3) a similarity score of  ...  that are consistent and statistically significant on all topics(TREC-9 and TREC-10) Metric Predictor Okapi Dirichlet Cosine AP Similarity of Full-text 3 3 - Similarity of anchor-text - 3 -  ...  The correlations of this predictor with precision at 10 (P@10) are only significant for Cosine model on TREC-9.  ... 
doi:10.14569/ijacsa.2017.081140 fatcat:fej6i76bybchlkp2wfjn2qst3y

User interface effects in past batch versus user experiments

Andrew Turpin, William Hersh
2002 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '02  
system [2, 3] .  ...  Table 3 shows the absolute numbers of relevant and irrelevant documents that were used to calculate these pro- DOCUMENT RELEVANCE VERSUS TI-TLE RELEVANCE USER'S CHOICES Looking at all the top 10  ... 
doi:10.1145/564376.564479 dblp:conf/sigir/TurpinH02 fatcat:2b4x6rrid5bzdfhjh3zugw4z6m

Passage retrieval vs. document retrieval for factoid question answering

Charles L. A. Clarke, Egidio L. Terra
2003 Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval - SIGIR '03  
[5] for use at TREC 2002. The method is related to passage-retrieval methods developed by others [4, 9] .  ...  On full documents, Okapi and MultiText provide similar performance, with none of the differences being significant at the 95% level.  ... 
doi:10.1145/860435.860534 dblp:conf/sigir/ClarkeT03 fatcat:zbt4somusjahbpwopne2ietzvu

Passage retrieval vs. document retrieval for factoid question answering

Charles L. A. Clarke, Egidio L. Terra
2003 Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval - SIGIR '03  
[5] for use at TREC 2002. The method is related to passage-retrieval methods developed by others [4, 9] .  ...  On full documents, Okapi and MultiText provide similar performance, with none of the differences being significant at the 95% level.  ... 
doi:10.1145/860500.860534 fatcat:3aae4nx3xnbvpk4txps5fhhzaa

Across the Bridge: CLEF 2001 — Non-english Monolingual Retrieval. The French Task [chapter]

Eugenia Matoyo, Tony Valsamidis
2002 Lecture Notes in Computer Science  
He set up the okapi pack in the computing laboratory at the university and took great pains to set up the environment variable settings as required for the successful operation of the Okapi software.  ...  Special acknowledgement of help and collaboration also goes to Surinder Singh Dio of the Unix help at the University of Greenwich.  ...  Since Porter's stemmer for English has successfully been used previously with Okapi in similar TREC experiments [9] , it implies that Okapi could not properly handle the accented words in the French  ... 
doi:10.1007/3-540-45691-0_27 fatcat:5rlxhcibundwta2ap36jgyumvy

Challenging conventional assumptions of automated information retrieval with real users: Boolean searching and batch retrieval evaluations

William Hersh, Andrew Turpin, Susan Price, Dale Kraemer, Daniel Olson, Benjamin Chan, Lynetta Sacherek
2001 Information Processing & Management  
We challenged these assumptions in the Text Retrieval Conference (TREC) interactive track, with real users following a consensus protocol to search for an instance recall task.  ...  Fig. 3 . 3 Searching interface for the TREC-8 interactive experiment (both TFIDF and Okapi weighting). Fig. 5 ( 5 a)±(c) show the linear ®t of the intermediate outcome variables.  ...  This analysis also looked at other factors predictive of successful searching from data collected by the user experiments. 3.  ... 
doi:10.1016/s0306-4573(00)00054-6 fatcat:s4fad5xgfzerzasxkqqzrkqobm

Evaluating interactive systems in TREC

Micheline Beaulieu, Stephen Robertson, Edie Rasmussen
1996 Journal of the American Society for Information Science  
Through successive interactive studies in TREC, the Okapi team at City University London has identified methodological issues relevant to this process.  ...  The TREC (Text REtrieval Conference) experiments were designed to allow large-scale laboratory testing of information retrieval techniques.  ...  Acknowledgment Okapi's participation in TREC was supported by British Library Research and Development Department.  ... 
doi:10.1002/(sici)1097-4571(199601)47:1<85::aid-asi8>3.3.co;2-7 fatcat:noxh7ma75zfznn26srdvyzcdiq

Evaluating interactive systems in TREC

Micheline Beaulieu, Stephen Robertson, Edie Rasmussen
1996 Journal of the American Society for Information Science  
Through successive interactive studies in TREC, the Okapi team at City University London has identified methodological issues relevant to this process.  ...  The TREC (Text REtrieval Conference) experiments were designed to allow large-scale laboratory testing of information retrieval techniques.  ...  Acknowledgment Okapi's participation in TREC was supported by British Library Research and Development Department.  ... 
doi:10.1002/(sici)1097-4571(199601)47:1<85::aid-asi8>3.0.co;2-z fatcat:rttsu2clhzatfbjlztmle5krya

Machine translation and monolingual information retrieval (poster abstract)

Martin Franz, J. Scott McCarley
1999 Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '99  
Experiments on the TREC 6 and 7 ad hoc tasks [l, 21 yield modest improvements in performance.  ...  Gains for LCA scores reflected similar gains from Okapi scores. These results are consistent with previous observations. [3] on the TREC-7 ad hoc task.  ...  Results for both TREC-6 and TREC-7, across both Okapi and LCA scores are given in Table 1 . Gains were much smaller for TREC-7.  ... 
doi:10.1145/312624.312725 dblp:conf/sigir/FranzM99 fatcat:hcaal2rggbbtdf7aulp7iecezy

Evaluating Passage Retrieval Approaches for Question Answering [chapter]

Ian Roberts, Robert Gaizauskas
2004 Lecture Notes in Computer Science  
-9 and TREC 2001.  ...  Automatic open domain question answering (QA) has been the focus of much recent research, stimulated by the introduction of a QA track in TREC in 1999.  ...  However, Okapi has considerably lower answer redundancy scores than approaches 1 and 3.  ... 
doi:10.1007/978-3-540-24752-4_6 fatcat:l2de4l73lzhidmenemnwcx2buq

Do batch and user evaluations give the same results?

William Hersh, Andrew Turpin, Susan Price, Benjamin Chan, Dale Kramer, Lynetta Sacherek, Daniel Olson
2000 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '00  
Figure 3 - 3 Instance recall for each topic. The point values show the mean and confidence intervals for users with Okapi (circular point) and TFIDF (square point) weighting.  ...  User experiments to determine if those measures give comparable results with human searchers with new TREC interactive track data. 3.  ... 
doi:10.1145/345508.345539 dblp:conf/sigir/HershTPCKSO00 fatcat:d6ybdwpfmjgbbkap5na7u3dtcy

When query expansion fails

Bodo Billerbeck, Justin Zobel
2003 Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval - SIGIR '03  
We have focused on a method shown by Robertson and Walker to be successful at TREC 8 [8], where an average of about 10% improvement in effectiveness was demonstrated through query expansion.  ...  In this approach, documents are initially ranked using the Okapi BM25 measure [7, 9] applied to the original query.  ...  Exploring the parameters In much of the Okapi work, fixed values were used for key parameters.  ... 
doi:10.1145/860500.860514 fatcat:zri5vxidlzc5jb4xb6grqoih6m

When query expansion fails

Bodo Billerbeck, Justin Zobel
2003 Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval - SIGIR '03  
We have focused on a method shown by Robertson and Walker to be successful at TREC 8 [8], where an average of about 10% improvement in effectiveness was demonstrated through query expansion.  ...  In this approach, documents are initially ranked using the Okapi BM25 measure [7, 9] applied to the original query.  ...  Exploring the parameters In much of the Okapi work, fixed values were used for key parameters.  ... 
doi:10.1145/860435.860514 dblp:conf/sigir/BillerbeckZ03 fatcat:4rdro4uiz5aldbys7ccz44xrtq

A new approach for evaluating query expansion

Tonya Custis, Khalid Al-Kofahi
2007 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '07  
Figure 3 : 3 The Recall (at 1000) of the four retrieval systems on the FSupp collection as a function of the number of query terms removed (the horizontal axis).  ...  At two query terms removed, TCS starts outperforming Okapi FB.  ... 
doi:10.1145/1277741.1277840 dblp:conf/sigir/CustisA07 fatcat:fbmv2oujmjfdjhspw6uvf34wui
« Previous Showing results 1 — 15 out of 1,123 results