Seven Years of Image Retrieval Evaluation [chapter]

Paul Clough, Henning Müller, Mark Sanderson
2010 ImageCLEF  
In this chapter we discuss evaluation of Information Retrieval (IR) systems and in particular ImageCLEF, a large-scale evaluation campaign that has produced several publicly-accessible resources required for evaluating visual information retrieval systems and is the focus of this book. This chapter sets the scene for the book by describing the purpose of system and user-centred evaluation, the purpose of test collections, the role of evaluation campaigns such as TREC and CLEF, our motivations
more » ... r starting ImageCLEF and then a summary of the tracks run over the seven years (data, tasks and participants). The chapter will also provide an insight into lessons learned and experiences gained over the years spent organising ImageCLEF, and a summary of the main highlights.
doi:10.1007/978-3-642-15181-1_1 fatcat:yuvmyscbufg5lclr36z4pughm4