64,477 Hits in 6.3 sec

A critical investigation of recall and precision as measures of retrieval system performance

Vijay Raghavan, Peter Bollmann, Gwang S. Jung
1989 ACM Transactions on Information Systems  
In this paper, we systematically investigate the various problems and issues associated with the use of recall and precision as measures of retrieval system performance.  ...  Recall and precision are often used to evaluate the effectiveness of information retrieval systems.  ...  Shu, Lih-chuyun for providing some of the experimental results used in this paper.  ... 
doi:10.1145/65943.65945 fatcat:74kxttvk6fa4tbphva735is7xa

A Study Of Indexing Consistency Between Library Of Congress And British Library Catalogers

Yaşar Tonta
1991 Zenodo  
By applying Hooper's "consistency of a pair" equation, the average indexing consistency value was found for 82 titles.  ...  The major findings of the study are discussed, and, in the Appendix, the examples of LCSH that assigned by both LC and BL catalogers for the same document are provided along with its consistency value.  ...  The Public-Access Computer Systems Review is a refereed electronic journal that is distributed on BITNET, Internet, and other computer networks. There is no subscription fee.  ... 
doi:10.5281/zenodo.437117 fatcat:eugskwgyj5dmriutzelphovr7q

Page 29 of Library & Information Science Abstracts Vol. , Issue 3 [page]

1991 Library & Information Science Abstracts  
Retrieval performance measures. Recall and Precision 91/1473 A critical investigation of recall and precision as measures of retrieval system performance. Vijay V. Raghavan, Gwang S.  ...  Recall and Precision. Mathematical models 91/1475 A mathematical model of retrieval system performance. Davis B. McCarn, Craig M. Lewis.  ... 

Evaluation of Information Retrieval Systems

Keneilwe Zuva
2012 International Journal of Computer Science & Information Technology (IJCSIT)  
Scalar methods notably precision, recall, Area Under Curve (AUC) and F measure were used.  ...  One of the challenges of modern information retrieval is to adequately evaluate Information Retrieval System (IRS) in order to estimate future performance in a specified application domain.  ...  Precision-recall analysis has remained as the appropriate evaluation performance measures of choice in applications such as database image retrieval.  ... 
doi:10.5121/ijcsit.2012.4304 fatcat:z4hc7jhavbg4touhuqpjoemdv4

Story Link Detection In Turkish Corpus

Güven Köse, Yaşar Tonta, Hamid Ahmadlouei
2013 Zenodo  
Furthermore, the combination of two methods using the AND and OR functions increased the precision ratio by 7.9% and recall ratio by 1.2%, respectively, indicating that retrieval performance of SLD algorithms  ...  Story Link Detection (SLD) is known as a sub-task of Topic Detection and Tracking (TDT). SLD aims to specify whether two randomly selected stories discuss the same topic or not.  ...  Evaluation Methodology We assessed the performance by computing the precision, recall and the F-measure that is based on precision and recall.  ... 
doi:10.5281/zenodo.1147445 fatcat:aacaok3lrvep7da67vpmdexyui

Story Link Detection in Turkish Corpus

Guven Kose, Yasar Tonta, Hamid Ahmadlouei, Aydin Can Polatkan
2013 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT)  
Furthermore, the combination of two methods using the AND and OR functions increased the precision ratio by 7.9% and recall ratio by 1.2%, respectively, indicating that retrieval performance of SLD algorithms  ...  Story Link Detection (SLD) is known as a sub-task of Topic Detection and Tracking (TDT). SLD aims to specify whether two randomly selected stories discuss the same topic or not.  ...  ACKNOWLEDGMENT This work is partially supported by the Scientific and Technical Research Council of Turkey (TÜBİTAK) under the grant number 106E014.  ... 
doi:10.1109/wi-iat.2013.23 dblp:conf/webi/KoseTAP13 fatcat:zn2vz7ejmzhsximdfjvmcrpdja

Retrieval of Radiology Reports Citing Critical Findings with Disease- Specific Customization

Ronilda Lacson
2012 Open Medical Informatics Journal  
Results: Both applications can be utilized for retrieval. iSCOUT and ANNIE had precision values between 0.90-0.98 and recall values between 0.79 and 0.94.  ...  disease entities and; 2) evaluates each application's performance in identifying and retrieving radiology reports citing critical imaging findings for three distinct diseases, pulmonary nodule, pneumothorax  ...  ACKNOWLEDGEMENTS This work was funded in part by Grant R18HS019635 from the Agency for Healthcare Research and Quality. CONFLICT OF INTEREST  ... 
doi:10.2174/1874431101206010028 pmid:22934127 pmcid:PMC3428631 fatcat:mpyf6dpaabe3tlriainsqzc7l4

Effectiveness and efficiency of three-dimensional shape retrieval

Kuiyang Lou, Natraj Iyer, Subramaniam Jayanti, Yagnanarayanan Kalyanaraman, Sunil Prabhakar, Karthik Ramani
2005 Journal of engineering design  
The search effectiveness is characterized by the precision and recall of results; and the search efficiency is evaluated by the ratio of the number of the visited nodes in a search operation to the number  ...  A real database of 113 3D shapes and synthetic databases created by random number generator are employed for the investigation. Four feature vectors are extracted to represent 3D shapes.  ...  ACKNOWLEDGEMENTS Initial funding for this project came from the 21st Century Research and Technology Fund award from the state of Indiana.  ... 
doi:10.1080/09544820500031583 fatcat:pslmn7wnuvhv5hungpy6zaecpe

eXtended cumulated gain measures for the evaluation of content-oriented XML retrieval

Gabriella Kazai, Mounia Lalmas
2006 ACM Transactions on Information Systems  
Both system and user-oriented evaluation aspects are considered and both recall and precision-like qualities are measured.  ...  established measures like precision and recall.  ...  ACKNOWLEDGEMENTS We are thankful for the help of Paul Ogilvie and Saadia Malik on some of the scripts for the R statistical package.  ... 
doi:10.1145/1185877.1185883 fatcat:lj6dxirjtncn5fpu6xtuamk3ru

Textual Analysis and Linking of Narratives (TALON)

F.G.M. Prats
2005 2005 IEEE Design Symposium, Systems and Information Engineering  
This paper describes the design and implementation of a methodology for parsing free-text narratives in an expert decision system for law enforcement.  ...  Brown of the Department of Systems and Information Engineering at the University of Virginia. The author also expresses gratitude to his technical advisor and good friend, Jason Dalton.  ...  ACKNOWLEDGEMENTS The author acknowledges the diligent guidance of his thesis and academic advisor, Prof. Donald E.  ... 
doi:10.1109/sieds.2005.193255 fatcat:vu2vzukci5ao7anyscpprjb2yu

Relevance similarity: an alternative means to monitor information retrieval systems

Peng Dong, Marie Loh, Adrian Mondry
2005 Biomedical Digital Libraries  
The performance of the retrieval system was not significantly different as a result of the variations in relevance assessment in this particular query set.  ...  In a situation where individual assessment can be compared with a gold standard, this parameter is used to study the effect of such variation on the performance of a medical information retrieval system  ...  We are also grateful for the help given by A. Ramasamy from University of Oxford, UK and A. L. Zhu from National University of Singapore on the statistical analysis of computed data.  ... 
doi:10.1186/1742-5581-2-6 pmid:16029513 pmcid:PMC1181804 fatcat:lgsywlbdofdq5j2vtafoh4lgau

Evaluating Passage Retrieval Approaches for Question Answering [chapter]

Ian Roberts, Robert Gaizauskas
2004 Lecture Notes in Computer Science  
recall and precision measures, and (b) demonstrate their use in evaluating a variety of passage retrieval approaches using questions from TREC-9 and TREC 2001.  ...  Many QA systems have been developed and most follow the same broad pattern of operation: first an information retrieval (IR) system, often passage-based, is used to find passages from a large document  ...  Metrics for evaluating IR performance for QA In the context of the QA task, the traditional IR performance measures of recall and precision demonstrate shortcomings that prompt us to define two new measures  ... 
doi:10.1007/978-3-540-24752-4_6 fatcat:l2de4l73lzhidmenemnwcx2buq

Efficient Video Surveillance: Performance Evaluation in Distributed Video Surveillance Systems [chapter]

Aleksandra Karimaa
2011 Video Surveillance  
F-measure (called also F1 score or F score) measures data retrieval accuracy by combining both measures of precision and recall (see Equation 3 ).  ...  The system of excellent performance is characterized by high values of precicion, recall and f-measure. The precision describes amount of relevant data within all the data retrieved.  ... 
doi:10.5772/15259 fatcat:gy5ebesiybchzms7s4qrco5pgu

Evaluation of query expansion using MeSH in PubMed

Zhiyong Lu, Won Kim, W. John Wilbur
2008 Information retrieval (Boston)  
The aggregate retrieval performance is assessed using both F-measure and mean rank precision.  ...  We run Boolean searches based on a collection of 55 topics and about 160,000 MEDLINE Ò citations used in the 2006 and 2007 TREC Genomics Tracks.  ...  Acknowledgments This research was funded by the Intramural Research Program of NIH, National Library of Medicine.  ... 
doi:10.1007/s10791-008-9074-8 pmid:19774223 pmcid:PMC2747526 fatcat:lyxu2m4t3ffb5bgo7qbn5dbrcm

The Impact of Modes of Mediation on the Web Retrieval Process [chapter]

Mandeep Pannu, Rachid Anane, Anne James
2012 Lecture Notes in Computer Science  
The work is supported by an experimental evaluation of the impact of different mediation modes on documents retrieval process in terms of recall and precision.  ...  This paper is concerned with the investigation of mediation between users and Web search engines and the impact of different modes of mediation on the Web search effectiveness.  ...  The investigation has led to the proposal of a mediation approach which was applied in the development of three evaluated systems.  ... 
doi:10.1007/978-3-642-32597-7_26 fatcat:ghxyvly2azap7jqdjlwszxmaym
« Previous Showing results 1 — 15 out of 64,477 results