VISCERAL: Evaluation-as-a-Service for Medical Imaging [chapter]

Allan Hanbury, Henning Müller
2017 Cloud-Based Benchmarking of Medical Image Analysis  
Systematic evaluation has had a strong impact on many data analysis domains, for example, TREC and CLEF in information retrieval, ImageCLEF in image retrieval, and many challenges in conferences such as MICCAI for medical imaging and ICPR for pattern recognition. With Kaggle, a platform for machine learning challenges has also had a significant success in crowdsourcing solutions. This shows the importance to systematically evaluate algorithms and that the impact is far larger than simply
more » ... ing a single system. Many of these challenges also showed the limits of the commonly used paradigm to prepare a data collection and tasks, distribute these and then evaluate the participants' submissions. Extremely large datasets are cumbersome to download, while shipping hard disks containing the data becomes impractical.
doi:10.1007/978-3-319-49644-3_1 fatcat:fshbd44tnbgzvg57f3i3rjmnwq