890 Hits in 2.4 sec

Low cost evaluation in information retrieval

Ben Carterette, Evangelos Kanoulas, Emine Yilmaz
2010 Proceeding of the 33rd international ACM SIGIR conference on Research and development in information retrieval - SIGIR '10  
Further, Evangelos was actively involved in coordinating the Million Query Track in TREC 2007 -2009 and he is one of the co-coordinators of the TREC 2010 Session Track.  ...  track in 2010.  ... 
doi:10.1145/1835449.1835675 dblp:conf/sigir/CarteretteKY10 fatcat:wp4bkff3g5cbpprqupyy5stmeu

Overview of the INEX 2010 Data Centric Track [chapter]

Andrew Trotman, Qiuyue Wang
2011 Lecture Notes in Computer Science  
The INEX 2010 Data Centric Track is discussed. A dump of IMDb was used as the document collection, 28 topics were submitted, 36 runs were submitted by 8 institutes, and 26 topics were assessed.  ...  Most runs (all except 2) did not use the structure present in the topics; and consequently no improvement is yet seen by search engines that do so.  ...  Fig. 3 .Fig. 4 . 34 Best runs measured with MAgP T2I(300) Best runs measured with MAiP Overview of the INEX 2010 Data Centric Track 7 : Fig. 1.  ... 
doi:10.1007/978-3-642-23577-1_15 fatcat:tlq7r7h5rjbxjja7v7scpqpd3a

Review of Methods in TREC from 1992 to 2014

Kalpana Khandale, Maheshkumar B., C. Namrata
2016 International Journal of Computer Applications  
This paper describes the overview of Text Retrieval conferences (TRECs) from 1992 (TREC-1) to 2014 (TREC-23).  ...  A brief comparative report about the methods, number of tracks and the outcomes are presented in this paper so that researchers working or want to work under this domain get an up to date view regarding  ...  Binning method [36] [37] [38] 2009(TREC-18) 91 2010(TREC-19) 80 2011(TREC-20) 108 2012(TREC-21) 129 2013(TREC-22) 97 2010(TREC-19) 80 6. Average precision (AP) Federated Web 1.  ... 
doi:10.5120/ijca2016907938 fatcat:ibtvcqhmbjcv7jjs4vgz7y2ium

Inferring query intent from reformulations and clicks

Filip Radlinski, Martin Szummer, Nick Craswell
2010 Proceedings of the 19th international conference on World wide web - WWW '10  
This approach was also used by the TREC 2009 Web Track judges to obtain more representative topic descriptions from real queries.  ...  We present an approach for identifying the popular meanings of queries using web search logs and user click behavior.  ...  for the TREC 2009 Web Track.  ... 
doi:10.1145/1772690.1772859 dblp:conf/www/RadlinskiSC10 fatcat:w5qjrqubpnfddl5dihsbpilevu

Overview of the FIRE 2011 RISOT Task [chapter]

Utpal Garain, Jiaul H. Paik, Tamaltaru Pal, Prasenjit Majumder, David S. Doermann, Douglas W. Oard
2013 Lecture Notes in Computer Science  
The collection used for search was a subset of the FIRE 2008 and 2010 Bengali test collections that contained 92 topics and 62,825 documents.  ...  RISOT was a pilot task in FIRE 2011 which focused on the retrieval of automatically recognized text from machine printed sources.  ...  The TREC Confusion track was part of TREC-4 in 1995 [1] and TREC-5 in 1996 [2] .  ... 
doi:10.1007/978-3-642-40087-2_19 fatcat:ju2c5ojivndx7f6v367md7g4iu

Dynamic Query Suggestion in Web Search Engines: A Comparative Examination

Ali Shiri, Lydia Zvyagintseva
2016 Proceedings of the Annual Conference of CAIS / Actes du congrès annuel de l'ACSI  
Using the TREC Web Track topics, this study conducts a comparative examination of the number, type and variations in the query term suggestions provided by the Web search engines.Le but de cette étude  ...  The purpose of this study is to examine the performance of dynamic query suggestion in three popular web search engines, namely Google, Yahoo! and Bing.  ...  The rationale for the selection of TREC topics lies in the fact that these topics are designed for the TREC Web Track experiments over web data.  ... 
doi:10.29173/cais868 fatcat:jcgyi4h33vd7fg3d436dh3stoe

The first international workshop on entity-oriented search (EOS)

Krisztian Balog, Arjen P. de Vries, Pavel Serdyukov, Ji-Rong Wen
2012 SIGIR Forum  
We would also like to thank the members of the program committee for their efforts: Wo- We extend our sincere gratitude to all the authors and presenters as well as to our invited speakers for their contributions  ...  Acknowledgments We would like to thank ACM and SIGIR for hosting the workshop. We are grateful for the sponsorship received from Yandex to award the best workshop paper.  ...  Using 70 topics from the 2009 and 2010 editions of the TREC Entity track, the logistic regression method has shown to outperform three baselines approaches.  ... 
doi:10.1145/2093346.2093353 fatcat:hqr6vdt6krbd3fgakpgz4wrhd4

A domain-independent approach to finding related entities

Olga Vechtomova, Stephen E. Robertson
2012 Information Processing & Management  
The evaluation was conducted on the Related Entity Finding task of the Entity Track of TREC 2010, as well as the QA list questions from TREC 2005 and 2006.  ...  The proposed method extracts the category of the target entity from the query, identifies instances of this category as seed entities, and computes similarity between candidate and seed entities.  ...  Example of the Entity track topic (TREC 2010). !  ... 
doi:10.1016/j.ipm.2011.12.003 fatcat:f7hxlt36e5gw3henruj2ybyuyy

LSTM vs. BM25 for Open-domain QA

Sosuke Kato, Riku Togashi, Hideyuki Maeda, Sumio Fujita, Tetsuya Sakai
2017 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR '17  
., those extracted from the old TREC QA tracks. Given massive training data plus a separate corpus of Q&A pairs as the target knowledge source, how well would such a system really perform?  ...  In this demonstration, we provide the attendees of SIGIR 2017 an opportunity to experience a live comparison of two open-domain QA systems, one based on a long short-term memory (LSTM) architecture with  ...  Wang and Nyberg [10] , the top performer in that track, first searched the web and Yahoo!  ... 
doi:10.1145/3077136.3084147 dblp:conf/sigir/KatoTMFS17 fatcat:g5t3wx4y2rfqrbm7osvg2qhhgm

DeepTileBars: Visualizing Term Distribution for Neural Information Retrieval [article]

Zhiwen Tang, Grace Hui Yang
2018 arXiv   pre-print
Although its design and implementation are light-weight, DeepTileBars outperforms other state-of-the-art Neu-IR models on benchmark datasets including the Text REtrieval Conference (TREC) 2010-2012 Web  ...  Tracks and LETOR 4.0.  ...  Any opinions, findings, conclusions, or recommendations expressed in this paper are of the authors, and do not necessarily reflect those of the sponsor.  ... 
arXiv:1811.00606v2 fatcat:xgvq7gybtramhkjru5dusshshq

Intelligent web page retrieval using Wikipedia knowledge

Falah H. Al-akashi, Diana Inkpen
2012 Proceedings of the 2nd International Conference on Web Intelligence, Mining and Semantics - WIMS '12  
Our index contains separate information about the frequency of the terms in Wikpedia articles, in home pages, and in other types of web pages, instead of using a generic term frequency for the whole text  ...  for different aspects of the queries).  ...  We chose the results of the best systems presented in the TREC 2010 web track overview paper [9] and in the TREC 2011 overview paper [11] .  ... 
doi:10.1145/2254129.2254192 dblp:conf/wims/Al-akashiI12 fatcat:i7o474s275fmjc43qpvdljji5e

What Snippets Say about Pages in Federated Web Search [chapter]

Thomas Demeester, Dong Nguyen, Dolf Trieschnigg, Chris Develder, Djoerd Hiemstra
2012 Lecture Notes in Computer Science  
What is the likelihood that a Web page is considered relevant to a query, given the relevance assessment of the corresponding snippet?  ...  Our test collection covers the main Web search engines like Google, Yahoo!  ...  This research was partly supported by the Netherlands Organization for Scientific Research, NWO, grants 639.022.809 and 640.005.002, and partly by the IBBT (Interdisciplinary Institute for Broadband Technology  ... 
doi:10.1007/978-3-642-35341-3_21 fatcat:v6xgiso435f3jhcdxhpin2nbam

Graded Relevance [chapter]

Tetsuya Sakai
2020 Evaluating Information Retrieval and Access Tasks  
My survey shows that the majority of the past tasks fully utilised graded relevance by means of graded evaluation measures, but not all of them; interestingly, even a few relatively recent tasks chose  ...  I conclude the chapter by a summary of my survey in table form.  ...  , and to the present and past organisers and participants of the NTCIR tasks!  ... 
doi:10.1007/978-981-15-5554-1_1 fatcat:zmifqjkcezgpximffpjxjpnklm

Overview of EIREX 2010: Computing [article]

Julián Urbano, Mónica Marrero, Diego Martín, Jorge Morato
2011 arXiv   pre-print
This overview paper summarizes the results of the EIREX 2010 track, focusing on the creation of the test collection and the analysis to assess its reliability.  ...  The first Information Retrieval Education through Experimentation track (EIREX 2010) was run at the University Carlos III of Madrid, during the 2010 spring semester.  ...  This overview paper summarizes the results of the EIREX 2010 track, focusing on the creation of the test collection and the analysis to assess its reliability.  ... 
arXiv:1201.0274v1 fatcat:ncqlelfg4rc4tm7e3s7b2klydq

The Effect of Content-Equivalent Near-Duplicates on the Evaluation of Search Engines [chapter]

Maik Fröbe, Jan Philipp Bittner, Martin Potthast, Matthias Hagen
2020 Lecture Notes in Computer Science  
In this paper, we reproduce the aforementioned study and extend it to incorporate all TREC Terabyte, Web, and Core tracks.  ...  The worst-case penalty of having filtered duplicates in any of these tracks were losses between 8 and 53 ranks.  ...  of 2010 and 2012 in terms of Δ nDCG .  ... 
doi:10.1007/978-3-030-45442-5_2 fatcat:rkhgv7v7ajct5c5sqoeesoixbe
« Previous Showing results 1 — 15 out of 890 results