8 Hits in 5.6 sec

Further reflections on TREC

Karen Sparck Jones
2000 Information Processing & Management  
The paper summarises the structure of the TREC work and analyses the experimental data in some detail.  ...  The paper reviews the TREC Programme up to TREC-6 (1997), considering the test results, the substantive ®ndings for IR that follow and the lessons TREC oers for IR evaluation.  ...  Acknowledgements I am grateful to Stephen Robertson and Donna Harman for their comments, and wish speci®cally to acknowledge the latter's scrupulous care in distinguishing her points as from a Referee,  ... 
doi:10.1016/s0306-4573(99)00044-8 fatcat:lqrad3oravfsxkzahlpj3afmea

Natural Language Processing and Information Retrieval [chapter]

Ellen M. Voorhees
1999 Lecture Notes in Computer Science  
for compound index terms; and the implicit linguistic processing inherent in the statistical methods.  ...  Information retrieval addresses the problem of nding those documents whose content matches a user's request from among a large collection of documents.  ...  Acknowledgements My thanks to Donna Harman and Chris Buckley for improving this paper through their comments.  ... 
doi:10.1007/3-540-48089-7_3 fatcat:bgh5hwznava75gmiuuzy4jnphy

Some Points in a Time

Karen Spärck Jones
2005 Computational Linguistics  
They have proved effective in more ways than might have been expected, and encourage new thinking about what language and information processing involve. * This paper is the text of the talk given on receipt  ...  This paper offers a personal perspective on the development of language and information processing over the last half century, focusing on the use of statistical methods.  ...  The TREC (Text Retrieval Conferences) evaluation programme (Voorhees and Harman (in press)) was designed to answer this question, but its scale and development, in a major, long term activity under Donna  ... 
doi:10.1162/0891201053630237 fatcat:3rjwktsygvdfxbsq2ot3benrei

A day without a search engine: an experimental study of online and offline searches

Yan Chen, Grace YoungJoo Jeon, Yong-Mi Kim
2013 Experimental Economics  
search experiences and outcomes.  ...  Given this popularity, the question arises as to how much time people save by using search engines for their information needs, and the extent to which online search affects search experiences and outcomes  ...  Harman, "The Text REtrieval Conference," in Ellen M. Voorhees and Donna K. Harman, eds., TREC: Experiment and Evaluation in Information Retrieval, Cambridge, Massachusetts: The MIT Press, 2005.  ... 
doi:10.1007/s10683-013-9381-9 fatcat:heaiwfos5jegtmtjaoz36z52le

Processing Social Media Messages in Mass Emergency: A Survey [article]

Muhammad Imran, Carlos Castillo, Fernando Diaz, Sarah Vieweg
2015 arXiv   pre-print
In particular, many social media messages communicated during emergencies convey timely, actionable information.  ...  Processing social media messages to obtain such information, however, involves solving multiple challenges including: handling information overload, filtering credible information, and prioritizing different  ...  Voorhees and Donna K. Harman (Eds.). 2005. TREC: Experiment and Evaluation in Information Retrieval. MIT Press. Dingding Wang and Tao Li. 2010.  ... 
arXiv:1407.7071v3 fatcat:e7mcvae5freddaus7ndolygeti

A comparison of rankings produced by summarization evaluation measures

Robert L. Donaway, Kevin W. Drummey, Laura A. Mather
2000 NAACL-ANLP 2000 Workshop on Automatic Summarization -   unpublished
This paper proposes using sentence-rankbased and content-based measures for evaluating extract summaries, and compares these with recallbased evaluation measures.  ...  evaluation measures produce a ranking of all possible extract summaries of a document., Recall-based evaluation measures, which depend on costly human-generated ground truth summaries, produce uncorrelated  ...  Thanks go also to Tomek Strzalkowski, Inderjeet Mani, Donna Harman, and Hal Wilson for their suggestions of how to improve the design of the experiment.  ... 
doi:10.3115/1567564.1567572 fatcat:ugaccxa76za3lia5oasxznmsgy

Workshop on Novel Methodologies for Evaluation in Information Retrieval [chapter]

Mark Sanderson, Martin Braschler, Nicola Ferro, Julio Gonzalo
Lecture Notes in Computer Science  
With such challenges in mind that we decided to hold the first Workshop on Novel Methodologies for Evaluation in Information Retrieval.  ...  Information retrieval is an empirical science; the field cannot move forward unless there are means of evaluating the innovations devised by researchers.  ...  [Journal of the American Society for Information Science and Technology, 57(11):1427-1439, 2006. [19] E.M. Voorhees. The philosophy of information retrieval evaluation.  ... 
doi:10.1007/978-3-540-78646-7_86 dblp:conf/ecir/SandersonBFG08 fatcat:75ac5kcrvneglnzypu72zcvmka

Workshop Crossing Barriers in Text Summarization Research

Horacio Saggion, Jean-Luc Borovets, Bulgaria, Horacio Saggion, Choy-Kim Chuah, Gustavo Crispino, Donna Harman, Min-Yen Kan, Guy Lapalme, Constantin Orasan, Dragomir Radev, Stan Szpakowicz (+5 others)
2005 unpublished
In response to our call for papers addressing new summarization problems, we received 21 submissions from nine countries: Brazil,  ...  The availability of massive on-line textual and multimedia databases and the development of the Internet have made of Text Summarization not only an indispensable technology but also an active and interesting  ...  References Acknowledgements This work was partly supported by Dutch Telematics Institute project DRUID, the EU project In-DiCo (IST-FP5-34306) and the EU project AMI (IST-FP6-506811).  ...