Filters








45,907 Hits in 4.0 sec

Performance evaluation in content-based image retrieval: overview and proposals

Henning Müller, Wolfgang Müller, David McG. Squire, Stéphane Marchand-Maillet, Thierry Pun
2001 Pattern Recognition Letters  
Evaluation of retrieval performance is a crucial problem in content-based image retrieval CBIR.  ...  Problems such a s a commonimage database for performance comparisons and a means of getting relevance judgments or ground truth for queries are explained.  ...  Obtaining relevance judgments In CBIR there is not yet a common means of obtaining relevance judgments for queries.  ... 
doi:10.1016/s0167-8655(00)00118-5 fatcat:q3zsturvkndvppag3adln2pmqa

Advancing Biomedical Image Retrieval: Development and Analysis of a Test Collection

W. R. Hersh, H. Muller, J. R. Jensen, J. Yang, P. N. Gorman, P. Ruch
2006 JAMIA Journal of the American Medical Informatics Association  
Users' studies also are necessary to determine the best measures for evaluating the efficacy of image retrieval systems.  ...  Methods: After participating research groups obtained and assessed results from their systems in the image retrieval task of Cross-Language Evaluation Forum, we assessed the results for common themes and  ...  For the 25 topics, a total of 21,795 images were in the pools for relevance judgments.  ... 
doi:10.1197/jamia.m2082 pmid:16799124 pmcid:PMC1561788 fatcat:4cjszhblkzbufj6eekdfiwk5du

Qualitative evaluation of automatic assignment of keywords to images

Chih-Fong Tsai, Ken McGarry, John Tait
2006 Information Processing & Management  
Much current research focuses on automatically assigning keywords to images for enhancing retrieval effectiveness.  ...  In image retrieval, most systems lack user-centred evaluation since they are assessed by some chosen ground truth dataset.  ...  CBIR and/or relevance feedback Barnard Acknowledgement The authors would like to thank Chris Stokoe, James Malone, Sheila Garfield, Mark Elshaw, and Jean Davison to participate the system evaluation  ... 
doi:10.1016/j.ipm.2004.11.001 fatcat:rzvs6g637nfhpcb2vdhp6o2bbq

The ImageCLEFmed Medical Image Retrieval Task Test Collection

William Hersh, Henning Müller, Jayashree Kalpathy-Cramer
2008 Journal of digital imaging  
The goal of the ImageCLEF medical image retrieval task (Image-CLEFmed) is to improve understanding and system capability in search for medical images.  ...  A growing number of clinicians, educators, researchers, and others use digital images in their work and search for them via image retrieval systems.  ...  Instructions for obtaining the data described in this paper can be obtained from the ImageCLEFmed Website (http://ir.ohsu. edu/image/).  ... 
doi:10.1007/s10278-008-9154-8 pmid:18769965 pmcid:PMC3043731 fatcat:msdjjtocxffopbydj7bbwdgwja

Benchmarking Soundtrack Recommendation Systems with SRBench [article]

Aleksandar Stupar, Sebastian Michel
2013 arXiv   pre-print
In this work, a benchmark to evaluate the retrieval performance of soundtrack recommendation systems is proposed.  ...  The benchmark consists of two types of relevance assessments: (i) judgments obtained from a user study, that serve as a "gold standard" for (ii) relevance judgments gathered through Amazon's Mechanical  ...  Creating trap questions for text retrieval, in case of preference judgments, is an easy task: a pair of one relevant and one obviously irrelevant document are presented to the evaluator.  ... 
arXiv:1308.1224v1 fatcat:n7gxexds6vhehgon56z2vcoex4

The CLEF Cross Language Image Retrieval Track (ImageCLEF) 2004 [chapter]

Paul Clough, Mark Sanderson, Henning Müller
2004 Lecture Notes in Computer Science  
For 2004 we have extended the tasks to include a medical image retrieval task and a user-centred evaluation.  ...  In this paper we describe ImageCLEF 1 , the cross language image retrieval track of the Cross Language Evaluation Forum (CLEF 3 ).  ...  Conclusions and Future Work In this paper we have discussed our proposal for three cross-language image retrieval tasks as part of the ImageCLEF campaign.  ... 
doi:10.1007/978-3-540-27814-6_31 fatcat:tnbxoph5obeddkof27u66cftxa

Overview of the FIRE 2011 RISOT Task [chapter]

Utpal Garain, Jiaul H. Paik, Tamaltaru Pal, Prasenjit Majumder, David S. Doermann, Douglas W. Oard
2013 Lecture Notes in Computer Science  
RISOT was a pilot task in FIRE 2011 which focused on the retrieval of automatically recognized text from machine printed sources.  ...  The collection used for search was a subset of the FIRE 2008 and 2010 Bengali test collections that contained 92 topics and 62,825 documents.  ...  blind evaluations using new relevance judgments.  For this year's task we generated clean images.  ... 
doi:10.1007/978-3-642-40087-2_19 fatcat:ju2c5ojivndx7f6v367md7g4iu

Scalable ranked retrieval using document images

Rajiv Jain, Douglas W. Oard, David Doermann, Bertrand Coüasnon, Eric K. Ringger
2013 Document Recognition and Retrieval XXI  
basis for relevance feedback can yield improvements in retrieval effectiveness.  ...  Despite the explosion of text on the Internet, hard copy documents that have been scanned as images still play a significant role for some tasks.  ...  Because the relevance judgments are sparse, we have chosen to report Bpref [24] , an evaluation measure optimized for experiments with sparse relevance judgments.  ... 
doi:10.1117/12.2038656 dblp:conf/drr/JainOD14 fatcat:fakph7vukvglnanvqfjadbx42a

Comparing the quality of accessing medical literature using content-based visual and textual information retrieval

Henning Müller, Jayashree Kalpathy-Cramer, Charles E. Kahn, Jr., William Hersh, Khan M. Siddiqui, Brent J. Liu
2009 Medical Imaging 2009: Advanced PACS-based Imaging Informatics and Therapeutic Applications  
This article describes the results of the medical image retrieval task of the ImageCLEF 2008 evaluation campaign.  ...  Many technical solutions have been proposed, and application scenarios for image retrieval as well as image classification have been set up.  ...  The use of a ternary judgment scheme allows varying sets of relevance judgments and evaluations.  ... 
doi:10.1117/12.811416 fatcat:pvkxymulzbd4nnjhivv7fzcpye

Seven Years of Image Retrieval Evaluation [chapter]

Paul Clough, Henning Müller, Mark Sanderson
2010 ImageCLEF  
for evaluating visual information retrieval systems and is the focus of this book.  ...  In this chapter we discuss evaluation of Information Retrieval (IR) systems and in particular ImageCLEF, a large-scale evaluation campaign that has produced several publicly-accessible resources required  ...  Andrews University Library in Scotland for providing us access to the historic set of photographs for the first ImageCLEF evaluation campaign.  ... 
doi:10.1007/978-3-642-15181-1_1 fatcat:yuvmyscbufg5lclr36z4pughm4

An Overview of Evaluation Campaigns in Multimedia Retrieval [chapter]

Suzanne Little, Ainhoa Llorente, Stefan Rüger
2010 ImageCLEF  
for evaluating visual information retrieval systems and is the focus of this book.  ...  In this chapter we discuss evaluation of Information Retrieval (IR) systems and in particular ImageCLEF, a large-scale evaluation campaign that has produced several publicly-accessible resources required  ...  Andrews University Library in Scotland for providing us access to the historic set of photographs for the first ImageCLEF evaluation campaign.  ... 
doi:10.1007/978-3-642-15181-1_27 fatcat:nnglqvlfw5a6fceju5vrwyswim

How do healthcare professionals select the medical images they need?

Shahram Sedghi, Mark Sanderson, Paul Clough
2013 ASLIB Proceedings  
a measure for the evaluation of the information retrieval process for traditional textual documents, regardless of the person who made the judgment.  ...  relevancy as a relevance criterion for the relevance judgment of images.  ... 
doi:10.1108/00012531311297186 fatcat:e4zkvmzzijhwnnlybbrm6e6uya

How do health care professionals select medical images they need?

Shahram Sedghi, Mark Sanderson, Paul Clough
2012 ASLIB Proceedings  
a measure for the evaluation of the information retrieval process for traditional textual documents, regardless of the person who made the judgment.  ...  relevancy as a relevance criterion for the relevance judgment of images.  ... 
doi:10.1108/00012531211244815 fatcat:r42kudpvsjbejlx4nkhajbee44

Evaluating performance of biomedical image retrieval systems—An overview of the medical image retrieval task at ImageCLEF 2004–2013

Jayashree Kalpathy-Cramer, Alba García Seco de Herrera, Dina Demner-Fushman, Sameer Antani, Steven Bedrick, Henning Müller
2015 Computerized Medical Imaging and Graphics  
( of( test( collections( is( relevance( judgments(that(determine(which(content(is(considered(relevant(to(each(topic.( Biomedical(information(retrieval(systems(are(complex,(comprising(many(key(components  ...  (ImageCLEF(initiative,( which(is(a(part(of(the(Cross-Language(Evaluation(Forum(((CLEF),(a(challenge(evaluation(for( information(retrieval(from(diverse(languages ([24].  ...  ,(performed(a(user(study(with(26(participants(in(order(to(investigate( the(relevance(criteria(used(by(health(care(professionals(to(make(relevance(judgments(when( searching( for( medical( images( [36]  ... 
doi:10.1016/j.compmedimag.2014.03.004 pmid:24746250 pmcid:PMC4177510 fatcat:xuck5guwojexviqczz4keargjm

Overview of the TREC 2012 Crowdsourcing Track

Mark D. Smucker, Gabriella Kazai, Matthew Lease
2012 Text Retrieval Conference  
In 2012, the Crowdsourcing track had two separate tasks: a text relevance assessing task (TRAT) and an image relevance assessing task (IRAT).  ...  Research who is one of the organizers of ImageCLEF 2012 and who has been instrumental in preparing the Flickr topics and image sets for use in the IRAT.  ...  We are grateful for the help of Monica Lestari Paramita, Paul D. Clough, Mark Sanderson and Wuytack Tom for making the BELGA corpus available to us.  ... 
dblp:conf/trec/SmuckerKL12 fatcat:dla4gzpemjfarogxo3herjt7sm
« Previous Showing results 1 — 15 out of 45,907 results