19 Hits in 4.6 sec

Interactive Okapi at Sheffield - TREC-8

Micheline Hancock-Beaulieu, Helene Fowkes, Nega Alemayehu, Mark Sanderson
1999 Text Retrieval Conference  
The study raises methodological questions with regard to the specification of interactive searching tasks and topics.  ...  Twenty-four subjects searched the six test topics on two versions of the Okapi system, one with relevance feedback and one without.  ...  With respect to the stated high level goal of the Interactive Track in TREC-8, which is to examine the process as well as the outcome, the Sheffield experiment focused principally on the process.  ... 
dblp:conf/trec/Hancock-BeaulieuFAS99 fatcat:lo2xkpe75zbovaizqulqwllnfa

Spoken Document Retrieval for TREC-8 at Cambridge University

Sue E. Johnson, Philip C. Woodland, Karen Sparck Jones, P. Jourlin
1999 Text Retrieval Conference  
This paper presents work done at Cambridge University on the TREC-8 Spoken Document Retrieval (SDR) Track.  ...  The paper also presents results for cross-recogniser experiments using our retrieval strategies on transcriptions from our own first pass output, AT&T, CMU, 2 NIST-run BBN baselines, LIMSI and Sheffield  ...  The second TREC-8 task assumes no knowledge of the story boundaries at both recognition and retrieval time (story-unknown case).  ... 
dblp:conf/trec/JohnsonWJJ99 fatcat:qpea2md4sjc6laah5ioobmffma

Sheffield Interactive Experiment at TREC-9

Micheline Hancock-Beaulieu, Helene Fowkes, Hideo Joho
2000 Text Retrieval Conference  
The paper reports on the experiment conducted by the University of Sheffield in the Interactive Track of TREC-9 based on the Okapi probabilistic ranking system.  ...  An analysis of the ranking of documents retrieved by the Okapi system and deemed relevant by the assessors also revealed that more than 50% appeared in the top 10 and 80% in the top 30.  ...  Introduction The experiment for TREC-9 as in previous rounds in which Sheffield has participated was based on the Okapi system.  ... 
dblp:conf/trec/Hancock-BeaulieuFJ00 fatcat:vsggbfskqzezjkwr54glo2muey

Forming test collections with no system pooling

Mark Sanderson, Hideo Joho
2004 Proceedings of the 27th annual international conference on Research and development in information retrieval - SIGIR '04  
Using established techniques for evaluating the quality of relevance judgments, in all three cases, test collections are formed that are as good as TREC.  ...  Forming test collection relevance judgments from the pooled output of multiple retrieval systems has become the standard process for creating resources such as the TREC, CLEF, and NTCIR test collections  ...  ACKNOWLEDGMENTS The authors wish to thank Keith van Rijsbergen and Jamie Callan for valuable inputs at a number of stages of the work.  ... 
doi:10.1145/1008992.1009001 dblp:conf/sigir/SandersonJ04 fatcat:34a6xc7guzbk7cejyw5vdroo2y

Spoken Document Retrieval for TREC-9 at Cambridge University

Sue E. Johnson, P. Jourlin, Karen Sparck Jones, Philip C. Woodland
2000 Text Retrieval Conference  
The CU-HTK transcriptions from TREC-8 with Word Error Rate (WER) of 20.5% were used in conjunction with stopping, Porter stemming, Okapi-style weighting and query expansion using a contemporaneous corpus  ...  This paper presents work done at Cambridge University for the TREC-9 Spoken Document Retrieval (SDR) track.  ...  : 8 Interaction of Query and Document Expansion on SU task on s1 transcriptions.  ... 
dblp:conf/trec/JohnsonJJW00 fatcat:4p4rs4lfpvfhnosvqi3lw326om

The NRRC reliable information access (RIA) workshop

Donna Harman, Chris Buckley
2004 Proceedings of the 27th annual international conference on Research and development in information retrieval - SIGIR '04  
OVERVIEW OF WORKSHOP The main data used for experimentation and failure analysis was the TREC ad hoc data from TRECs 6, 7, and 8 (topics 300-450).  ...  SIGIR'04, July 25-29, 2004, Sheffield, South Yorkshire, UK.  ... 
doi:10.1145/1008992.1009104 dblp:conf/sigir/HarmanB04 fatcat:jnqumxwzpjeyld465cxosjs4ey

A Study of User Interaction with a Concept-Based Interactive Query Expansion Support Tool [chapter]

Hideo Joho, Mark Sanderson, Micheline Beaulieu
2004 Lecture Notes in Computer Science  
Acknowledgements The authors thank to the participants of our experiments from Department of Information Studies and Computer Science at the University of Sheffield.  ...  The task defined by the TREC-8 Interactive Track is referred to as an instance finding task.  ...  We used the test collection from TREC-8 Interactive Track [5] as well as the Ad-hoc task as the basis of our experiments.  ... 
doi:10.1007/978-3-540-24752-4_4 fatcat:yw7ifqtvhvdkfiahrgnhcyrwyy

A formal study of information retrieval heuristics

Hui Fang, Tao Tao, ChengXiang Zhai
2004 Proceedings of the 27th annual international conference on Research and development in information retrieval - SIGIR '04  
Okapi Method The Okapi formula is another highly effective retrieval formula that represents the classical probabilistic retrieval model [8] .  ...  This constraint regulates the interaction between TF and document length.  ... 
doi:10.1145/1008992.1009004 dblp:conf/sigir/FangTZ04 fatcat:pythkoovifh3rcpq3wr3pta6fq

Modeling Users' Successive Searches in Digital Environments

Amanda Spink, Tom Wilson, David Ellis, Nigel Ford
1998 D-Lib Magazine  
(Spaces in links that caused linking problems were removed 8/31/05.)  ...  The project will last for eighteen months at UNT and two years at Sheffield. Quantitative and qualitative analysis methods will be employed.  ... 
doi:10.1045/april98-spink fatcat:xpc7zzjgsjcdhn5bulcwmfycr4

Using Concept Hierarchies in Text-Based Image Retrieval: A User Evaluation [chapter]

Daniela Petrelli, Paul Clough
2006 Lecture Notes in Computer Science  
The University of Sheffield participated in Interactive ImageCLEF 2005 with a comparative user evaluation of two interfaces: one displaying search results as a list, the other organizing retrieved images  ...  into a hierarchy of concepts displayed on the interface as an interactive menu.  ...  We are grateful to the 8 participants for spending their time with us and patiently dealing with bizarre translations and puzzling system's behaviours.  ... 
doi:10.1007/11878773_35 fatcat:lwyg3x6rabcvzd52u5afozjvc4

A decision-theoretic approach to database selection in networked IR

Norbert Fuhr
1999 ACM Transactions on Information Systems  
However, things are not so simple (3, 4, 5, 6, 7, 8) and have begun to be addressed by the interactive track of TREC (9) and Mira (10).  ...  "Evaluating interactive systems in TREC".  ... 
doi:10.1145/314516.314517 fatcat:pa3itrgvszd2ffx6gpcs4ut4ti

Test Collection Based Evaluation of Information Retrieval Systems

Mark Sanderson
2010 Foundations and Trends in Information Retrieval  
At its core, the modern-day test collection is little different from the structures that the pioneering researchers in the 1950s and 1960s conceived of.  ...  This monograph surveys the research conducted and explains the methods and measures devised for evaluation of retrieval systems, including a detailed look at the use of statistical significance testing  ...  In the ad hoc track for TRECs 2-8, nearly 500 runs were archived.  ... 
doi:10.1561/1500000009 fatcat:qdacqkqj25eojkpchctdzvrt2e

The CLEF 2005 Cross–Language Image Retrieval Track [chapter]

Paul Clough, Henning Müller, Thomas Deselaers, Michael Grubinger, Thomas M. Lehmann, Jeffery Jensen, William Hersh
2006 Lecture Notes in Computer Science  
were offered in the ImageCLEF track: a ad-hoc retrieval from an historic photographic collection, ad-hoc retrieval from a medical collection, an automatic image annotation task, and a user-centered (interactive  ...  Creating Relevance Assessments Relevance assessments were performed by staff at the University of Sheffield (the majority unfamiliar with the St.  ...  eval/trec eval.7.3.tar.gz 6 7 8 9  ... 
doi:10.1007/11878773_60 fatcat:tnktsl6hkbbupofowyjau6t3g4

Fifty years of UK research in information science

Jack Meadows
2008 Journal of information science  
Work on retrieval of chemical information began at Sheffield in the 1960s, and has expanded in subsequent decades.  ...  One of the most successful developments of such an interactive approach is the Okapi project, which began in the early 1980s, moving to the City University in 1989 [14] .  ... 
doi:10.1177/0165551508089718 fatcat:2kg3dmir3zagljwjzy5324npzm

Searching spontaneous conversational speech

Franciska de Jong, Douglas W. Oard, Roeland Ordelman, Stephan Raaijmakers
2007 SIGIR Forum  
Preface Nearly a decade ago, we learned from the TREC Spoken Document Retrieval (SDR) track that searching speech was a "solved problem."  ...  in the TREC 8 and TREC 9 SDR evaluations [3] .  ...  8 and TREC 9 SDR Text and Speech collections.  ... 
doi:10.1145/1328964.1328982 fatcat:wwpzqq7ndrfedh4imhoznvccl4
« Previous Showing results 1 — 15 out of 19 results