A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
Filters
Performance evaluation in content-based image retrieval: overview and proposals
2001
Pattern Recognition Letters
Preserved Fulltext
Evaluation of retrieval performance is a crucial problem in content-based image retrieval CBIR. ...
Problems such a s a commonimage database for performance comparisons and a means of getting relevance judgments or ground truth for queries are explained. ...
Obtaining relevance judgments In CBIR there is not yet a common means of obtaining relevance judgments for queries. ...
doi:10.1016/s0167-8655(00)00118-5
fatcat:q3zsturvkndvppag3adln2pmqa
Advancing Biomedical Image Retrieval: Development and Analysis of a Test Collection
2006
JAMIA Journal of the American Medical Informatics Association
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2010; you can also visit the original URL.
The file type is application/pdf.
Users' studies also are necessary to determine the best measures for evaluating the efficacy of image retrieval systems. ...
Methods: After participating research groups obtained and assessed results from their systems in the image retrieval task of Cross-Language Evaluation Forum, we assessed the results for common themes and ...
For the 25 topics, a total of 21,795 images were in the pools for relevance judgments. ...
doi:10.1197/jamia.m2082
pmid:16799124
pmcid:PMC1561788
fatcat:4cjszhblkzbufj6eekdfiwk5du
Qualitative evaluation of automatic assignment of keywords to images
2006
Information Processing & Management
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2005; you can also visit the original URL.
The file type is application/pdf.
Much current research focuses on automatically assigning keywords to images for enhancing retrieval effectiveness. ...
In image retrieval, most systems lack user-centred evaluation since they are assessed by some chosen ground truth dataset. ...
CBIR and/or relevance feedback Barnard
Acknowledgement The authors would like to thank Chris Stokoe, James Malone, Sheila Garfield, Mark Elshaw, and Jean Davison to participate the system evaluation ...
doi:10.1016/j.ipm.2004.11.001
fatcat:rzvs6g637nfhpcb2vdhp6o2bbq
The ImageCLEFmed Medical Image Retrieval Task Test Collection
2008
Journal of digital imaging
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2010; you can also visit the original URL.
The file type is application/pdf.
The goal of the ImageCLEF medical image retrieval task (Image-CLEFmed) is to improve understanding and system capability in search for medical images. ...
A growing number of clinicians, educators, researchers, and others use digital images in their work and search for them via image retrieval systems. ...
Instructions for obtaining the data described in this paper can be obtained from the ImageCLEFmed Website (http://ir.ohsu. edu/image/). ...
doi:10.1007/s10278-008-9154-8
pmid:18769965
pmcid:PMC3043731
fatcat:msdjjtocxffopbydj7bbwdgwja
Benchmarking Soundtrack Recommendation Systems with SRBench
[article]
2013
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
In this work, a benchmark to evaluate the retrieval performance of soundtrack recommendation systems is proposed. ...
The benchmark consists of two types of relevance assessments: (i) judgments obtained from a user study, that serve as a "gold standard" for (ii) relevance judgments gathered through Amazon's Mechanical ...
Creating trap questions for text retrieval, in case of preference judgments, is an easy task: a pair of one relevant and one obviously irrelevant document are presented to the evaluator. ...
arXiv:1308.1224v1
fatcat:n7gxexds6vhehgon56z2vcoex4
The CLEF Cross Language Image Retrieval Track (ImageCLEF) 2004
[chapter]
2004
Lecture Notes in Computer Science
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
For 2004 we have extended the tasks to include a medical image retrieval task and a user-centred evaluation. ...
In this paper we describe ImageCLEF 1 , the cross language image retrieval track of the Cross Language Evaluation Forum (CLEF 3 ). ...
Conclusions and Future Work In this paper we have discussed our proposal for three cross-language image retrieval tasks as part of the ImageCLEF campaign. ...
doi:10.1007/978-3-540-27814-6_31
fatcat:tnbxoph5obeddkof27u66cftxa
Overview of the FIRE 2011 RISOT Task
[chapter]
2013
Lecture Notes in Computer Science
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2012; you can also visit the original URL.
The file type is application/pdf.
RISOT was a pilot task in FIRE 2011 which focused on the retrieval of automatically recognized text from machine printed sources. ...
The collection used for search was a subset of the FIRE 2008 and 2010 Bengali test collections that contained 92 topics and 62,825 documents. ...
blind evaluations using new relevance judgments. For this year's task we generated clean images. ...
doi:10.1007/978-3-642-40087-2_19
fatcat:ju2c5ojivndx7f6v367md7g4iu
Scalable ranked retrieval using document images
2013
Document Recognition and Retrieval XXI
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
basis for relevance feedback can yield improvements in retrieval effectiveness. ...
Despite the explosion of text on the Internet, hard copy documents that have been scanned as images still play a significant role for some tasks. ...
Because the relevance judgments are sparse, we have chosen to report Bpref [24] , an evaluation measure optimized for experiments with sparse relevance judgments. ...
doi:10.1117/12.2038656
dblp:conf/drr/JainOD14
fatcat:fakph7vukvglnanvqfjadbx42a
Comparing the quality of accessing medical literature using content-based visual and textual information retrieval
2009
Medical Imaging 2009: Advanced PACS-based Imaging Informatics and Therapeutic Applications
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2010; you can also visit the original URL.
The file type is application/pdf.
This article describes the results of the medical image retrieval task of the ImageCLEF 2008 evaluation campaign. ...
Many technical solutions have been proposed, and application scenarios for image retrieval as well as image classification have been set up. ...
The use of a ternary judgment scheme allows varying sets of relevance judgments and evaluations. ...
doi:10.1117/12.811416
fatcat:pvkxymulzbd4nnjhivv7fzcpye
Seven Years of Image Retrieval Evaluation
[chapter]
2010
ImageCLEF
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2012; you can also visit the original URL.
The file type is application/pdf.
for evaluating visual information retrieval systems and is the focus of this book. ...
In this chapter we discuss evaluation of Information Retrieval (IR) systems and in particular ImageCLEF, a large-scale evaluation campaign that has produced several publicly-accessible resources required ...
Andrews University Library in Scotland for providing us access to the historic set of photographs for the first ImageCLEF evaluation campaign. ...
doi:10.1007/978-3-642-15181-1_1
fatcat:yuvmyscbufg5lclr36z4pughm4
An Overview of Evaluation Campaigns in Multimedia Retrieval
[chapter]
2010
ImageCLEF
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
for evaluating visual information retrieval systems and is the focus of this book. ...
In this chapter we discuss evaluation of Information Retrieval (IR) systems and in particular ImageCLEF, a large-scale evaluation campaign that has produced several publicly-accessible resources required ...
Andrews University Library in Scotland for providing us access to the historic set of photographs for the first ImageCLEF evaluation campaign. ...
doi:10.1007/978-3-642-15181-1_27
fatcat:nnglqvlfw5a6fceju5vrwyswim
How do healthcare professionals select the medical images they need?
2013
ASLIB Proceedings
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
a measure for the evaluation of the information retrieval process for traditional textual documents, regardless of the person who made the judgment. ...
relevancy as a relevance criterion for the relevance judgment of images. ...
doi:10.1108/00012531311297186
fatcat:e4zkvmzzijhwnnlybbrm6e6uya
How do health care professionals select medical images they need?
2012
ASLIB Proceedings
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
a measure for the evaluation of the information retrieval process for traditional textual documents, regardless of the person who made the judgment. ...
relevancy as a relevance criterion for the relevance judgment of images. ...
doi:10.1108/00012531211244815
fatcat:r42kudpvsjbejlx4nkhajbee44
Evaluating performance of biomedical image retrieval systems—An overview of the medical image retrieval task at ImageCLEF 2004–2013
2015
Computerized Medical Imaging and Graphics
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2018; you can also visit the original URL.
The file type is application/pdf.
( of( test( collections( is( relevance( judgments(that(determine(which(content(is(considered(relevant(to(each(topic.( Biomedical(information(retrieval(systems(are(complex,(comprising(many(key(components ...
(ImageCLEF(initiative,( which(is(a(part(of(the(Cross-Language(Evaluation(Forum(((CLEF),(a(challenge(evaluation(for( information(retrieval(from(diverse(languages ([24]. ...
,(performed(a(user(study(with(26(participants(in(order(to(investigate(
the(relevance(criteria(used(by(health(care(professionals(to(make(relevance(judgments(when(
searching( for( medical( images( [36] ...
doi:10.1016/j.compmedimag.2014.03.004
pmid:24746250
pmcid:PMC4177510
fatcat:xuck5guwojexviqczz4keargjm
Overview of the TREC 2012 Crowdsourcing Track
2012
Text Retrieval Conference
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
In 2012, the Crowdsourcing track had two separate tasks: a text relevance assessing task (TRAT) and an image relevance assessing task (IRAT). ...
Research who is one of the organizers of ImageCLEF 2012 and who has been instrumental in preparing the Flickr topics and image sets for use in the IRAT. ...
We are grateful for the help of Monica Lestari Paramita, Paul D. Clough, Mark Sanderson and Wuytack Tom for making the BELGA corpus available to us. ...
dblp:conf/trec/SmuckerKL12
fatcat:dla4gzpemjfarogxo3herjt7sm
« Previous
Showing results 1 — 15 out of 45,907 results