Filters








257 Hits in 9.2 sec

Challenging conventional assumptions of automated information retrieval with real users: Boolean searching and batch retrieval evaluations

William Hersh, Andrew Turpin, Susan Price, Dale Kraemer, Daniel Olson, Benjamin Chan, Lynetta Sacherek
2001 Information Processing & Management  
We challenged these assumptions in the Text Retrieval Conference (TREC) interactive track, with real users following a consensus protocol to search for an instance recall task.  ...  Our results showed that Boolean and natural language searching achieved comparable results and that the results from batch evaluations were not comparable to those obtained in experiments with real users  ...  Acknowledgements This study was funded in part by Grant LM-06311 from the US National Library of Medicine.  ... 
doi:10.1016/s0306-4573(00)00054-6 fatcat:s4fad5xgfzerzasxkqqzrkqobm

The search problem posed by large heterogeneous data sets in litigation

Jason R. Baron, Paul Thompson
2007 Proceedings of the 11th international conference on Artificial intelligence and law - ICAIL '07  
The TREC Legal Track is presented as a forum for the evaluation of e-discovery research and one new evaluation measure, elusion, is described, which has potential for addressing problems of measuring recall  ...  Lawyers and their large institutional clients increasingly face the enormous problem of how to efficiently and efficaciously conduct searches for relevant documents in large heterogeneous electronic data  ...  The evaluation measures undertaken in the TREC legal track are expected to make an important contribution to better understanding of Boolean methods vs. nonBoolean ranking schemes across a variety of legal  ... 
doi:10.1145/1276318.1276344 dblp:conf/icail/BaronT07 fatcat:mdbdypls6bdwvkukjbn3cfh534

Further reflections on TREC

Karen Sparck Jones
2000 Information Processing & Management  
The analysis of the tests is presented through a series of key questions about indexing models, document and query descriptions, search strategies, etc.  ...  The paper reviews the TREC Programme up to TREC-6 (1997), considering the test results, the substantive ®ndings for IR that follow and the lessons TREC oers for IR evaluation.  ...  from a Fellow researcher or from a Defender of TREC.  ... 
doi:10.1016/s0306-4573(99)00044-8 fatcat:lqrad3oravfsxkzahlpj3afmea

Evaluation of information retrieval for E-discovery

Douglas W. Oard, Jason R. Baron, Bruce Hedin, David D. Lewis, Stephen Tomlinson
2010 Artificial Intelligence and Law  
This work has led to new approaches to measuring effectiveness in both batch and interactive frameworks, large data sets, and some surprising results for the recall and precision of Boolean and statistical  ...  The scale and nature of E-discovery tasks, however, has pushed traditional information retrieval evaluation approaches to their limits.  ...  Additionally, the TREC Legal Track would not have been possible without the support of Ellen Voorhees and Ian Soboroff of NIST; the faculty, staff and students of IIT, UCSF, Tobacco Documents Online, and  ... 
doi:10.1007/s10506-010-9093-9 fatcat:b32vy55jyzemneqol4y5cnbo3m

The Text REtrieval Conferences (TRECs)

Donna Harman
1996 Proceedings of a workshop on held at Vienna, Virginia May 6-8, 1996 -  
Thanks also go to the TREC program committee and the staff at NIST. The TREC tracks could not happen without the efforts of the track coordinators; our special thanks to them.  ...  Acknowledgments The authors gratefully acknowledge the continued support of the TREC conferences by the Intelligent Systems Office of the Defense Advanced Research Projects Agency.  ...  The topics consist of natural language text describing a user's information need (see sec. 3.2 for details).  ... 
doi:10.3115/1119018.1119026 dblp:conf/tipster/Harman96 fatcat:wjklhj3nwnenfkfxben2756yla

The Text REtrieval Conferences (TRECs)

Donna Harman
1996 Proceedings of a workshop on held at Vienna, Virginia May 6-8, 1996 -  
Thanks also go to the TREC program committee and the staff at NIST. The TREC tracks could not happen without the efforts of the track coordinators; our special thanks to them.  ...  Acknowledgments The authors gratefully acknowledge the continued support of the TREC conferences by the Intelligent Systems Office of the Defense Advanced Research Projects Agency.  ...  The topics consist of natural language text describing a user's information need (see sec. 3.2 for details).  ... 
doi:10.3115/1119018.1119070 dblp:conf/tipster/Harman96a fatcat:bxx2gy23cbeenn5ryxedzg3ixe

The text retrieval conferences (TRECS)

Ellen M. Voorhees, Donna Harman
1996 Proceedings of a workshop on held at Baltimore, Maryland October 13-15, 1998 -  
Thanks also go to the TREC program committee and the staff at NIST. The TREC tracks could not happen without the efforts of the track coordinators; our special thanks to them.  ...  Acknowledgments The authors gratefully acknowledge the continued support of the TREC conferences by the Intelligent Systems Office of the Defense Advanced Research Projects Agency.  ...  The topics consist of natural language text describing a user's information need (see sec. 3.2 for details).  ... 
doi:10.3115/1119089.1119127 dblp:conf/tipster/VoorheesH98 fatcat:yo3fnbp2tffqzfjhndiwd4zsre

Real-World Expertise Retrieval: The Information Seeking Behaviour of Recruitment Professionals [chapter]

Tony Russell-Rose, Jon Chamberlain
2016 Lecture Notes in Computer Science  
This paper presents results of a survey of recruitment professionals, investigating their information seeking behaviour and needs regarding IR systems and applications.  ...  Recruitment professionals perform complex search tasks in order to find candidates that match client job briefs.  ...  For example, much academic research continues to assume that searches are formulated as natural language queries, but this study shows that many professions prefer to formulate their queries as Boolean  ... 
doi:10.1007/978-3-319-30671-1_51 fatcat:d6jdzzlsxfazhg4sraki4cyb3y

Toward automatic facet analysis and need negotiation

Jimmy Lin, Philip Wu, Eileen Abels
2008 ACM Transactions on Information Systems  
We discuss results from a controlled Wizard-of-Oz case study, set in the context of the TREC 2005 HARD track evaluation, in which a trained intermediary executed an integrated search and interaction strategy  ...  This work explores the hypothesis that interactions between a trained human search intermediary and an information seeker can inform the design of interactive IR systems.  ...  As we discuss in Section 7, a search strategy based on conceptual facet analysis provides a basis for understanding the nature of clarification exchanges.  ... 
doi:10.1145/1416950.1416956 fatcat:spdexizcibaahpbvjzjjpj4b4e

Modeling and solving term mismatch for full-text retrieval

Le Zhao
2012 SIGIR Forum  
Even though modern retrieval systems typically use a multitude of features to rank documents, the backbone for search ranking is usually the standard tf.idf retrieval models.  ...  Jamie has given me the opportunity to work on a large number of tasks related to my interest in core retrieval modeling.  ...  the ranking needed by the Boolean system for a fair ranked Boolean retrieval vs. ranked keyword retrieval comparison.  ... 
doi:10.1145/2422256.2422277 fatcat:iboh56u5kvdrhcnt4uqyorwvp4

Features and Aggregators for Web-scale Entity Search [article]

Uma Sawant, Soumen Chakrabarti
2013 arXiv   pre-print
The first one is the W3C dataset used in TREC-scale enterprise search, with pre-annotated entity mentions.  ...  Proximity scoring has been studied in IR outside the scope of entity search. However, aggregation has been hardwired except in a few cases where probabilistic language models are used.  ...  Figure 7 repeats the feature comparison for TREC. A prominent observation is that |Se| is an excellent single feature for the Web, but not at all for TREC.  ... 
arXiv:1303.3164v1 fatcat:s3nerteo7zgelkf7t4gnhylkpi

Analysis of biomedical and health queries: Lessons learned from TREC and CLEF evaluation benchmarks

Lynda Tamine, Cécile Chouquet, Thomas Palmer
2015 Journal of the Association for Information Science and Technology  
A large body of research work examined, from both the query side and the user behaviour side, the characteristics of medical and health-related searches.  ...  Based on the outcome of our study, we show that, even for expert oriented queries, language specificity level varies significantly across tasks as well as search difficulty and that the most related predictive  ...  Different from previous work, we present, in this paper, a large-scale exploratory analysis of medical and health-related searches held specifically within TREC and CLEF evaluation campaigns.  ... 
doi:10.1002/asi.23351 fatcat:odvg52zbnrhili7ikkopf3rbaa

Natural language question answering: the view from here

L. HIRSCHMAN, R. GAIZAUSKAS
2001 Natural Language Engineering  
Acknowledgements The authors would like to thank the following for their invaluable help in reviewing papers for this special issue: Giuseppe Attardi, Eric Breck, Ted Briscoe, John Carroll, Eugene Charniak  ...  Figure 1 proposes such a general architecture for the QA task, conceived as that of asking natural language questions to a system that has as its knowledge source a large collection of natural language  ...  Historically, the introduction of large-scale common evaluations, such as TREC, has created strong communities of interest and has accelerated research progress.  ... 
doi:10.1017/s1351324901002807 fatcat:hwkl3jwd6jcchdduxtulhjjgju

The impact of MeSH (Medical Subject Headings) terms on information seeking effectiveness

Ying-Hsang Liu
2009 SIGIR Forum  
For instance, in a large-scale study comparing five types of index languages in the subject field of library and information science considering the factors of index language specificity and exhaustivity  ...  the use of very large number of search topics (e.g., fifty topics in TREC main track evaluation activities).  ...  The session will be audio taped and the observer will take notes during the session. You will also be asked for demographic data such as age, gender, level, main area of study and native language.  ... 
doi:10.1145/1670564.1670582 fatcat:comonziilnfb7h576xzcse6yvm

Using Language Models For Information Retrieval

Djoerd Hiemstra, Franciska De Jong
2001 Zenodo  
The development of a model that supports multiple representations of a document, for instance by allowing proximity searches or searches for terms from a particular record field (e.g. a search for terms  ...  A practical comparison of a language model-based retrieval system with similar systems that are based on well-established models and term weighting algorithms in a controlled experiment.  ...  I am most grateful to Wessel Kraaij of TNO-TPD for our cooperation in these projects, for our cooperation in four years of joined TREC-participations, and for implementing the language model algorithms  ... 
doi:10.5281/zenodo.570441 fatcat:mfju6ok4t5bzjp2pvp6bktfdn4
« Previous Showing results 1 — 15 out of 257 results