Validating Retinal Fundus Image Analysis Algorithms: Issues and a Proposal

Emanuele Trucco, Alfredo Ruggeri, Thomas Karnowski, Luca Giancardo, Edward Chaum, Jean Pierre Hubschman, Bashir al-Diri, Carol Y. Cheung, Damon Wong, Michael Abràmoff, Gilbert Lim, Dinesh Kumar (+7 others)
<span title="2013-05-24">2013</span> <i title="Association for Research in Vision and Ophthalmology (ARVO)"> <a target="_blank" rel="noopener" href="" style="color: black;">Investigative Ophthalmology and Visual Science</a> </i> &nbsp;
This paper concerns the validation of automatic retinal image analysis (ARIA) algorithms. For reasons of space and consistency, we concentrate on the validation of algorithms processing color fundus camera images, currently the largest section of the ARIA literature. We sketch the context (imaging instruments and target tasks) of ARIA validation, summarizing the main image analysis and validation techniques. We then present a list of recommendations focusing on the creation of large
more &raquo; ... of test data created by international consortia, easily accessible via moderated Web sites, including multicenter annotations by multiple experts, specific to clinical tasks, and capable of running submitted software automatically on the data stored, with clear and widely agreed-on performance criteria, to provide a fair comparison.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="">doi:10.1167/iovs.12-10347</a> <a target="_blank" rel="external noopener" href="">pmid:23794433</a> <a target="_blank" rel="external noopener" href="">pmcid:PMC4597487</a> <a target="_blank" rel="external noopener" href="">fatcat:ittct3figzb45j7kgcqltqiscy</a> </span>
<a target="_blank" rel="noopener" href="" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href=""> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> Publisher / </button> </a> <a target="_blank" rel="external noopener" href="" title="pubmed link"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> </button> </a>