What Happened in CLEF2009: Introduction to the Working Notes
Conference and Labs of the Evaluation Forum
The objective of the Cross Language Evaluation Forum 1 is to promote research in the field of multilingual system development. This is done through the organisation of annual evaluation campaigns in which a series of tracks designed to test different aspects of mono-and cross-language information retrieval (IR) are offered. The intention is to encourage experimentation with all kinds of multilingual information access -from the development of systems for monolingual retrieval operating on many
... anguages to the implementation of complete multilingual multimedia search services. This has been achieved by offering an increasingly complex and varied set of evaluation tasks over the years. The aim is not only to meet but also to anticipate the emerging needs of the R&D community and to encourage the development of next generation multilingual IR systems. These Working Notes contain descriptions of the experiments conducted within CLEF 2009 -the tenth in a series of annual system evaluation campaigns. The results of the experiments will be presented and discussed in the CLEF 2009 Workshop, 30 September -2 October, Corfu, Greece. The final papers -revised and extended as a result of the discussions at the Workshop -together with a comparative analysis of the results will appear in the CLEF 2009 Proceedings, to be published by Springer in their Lecture Notes for Computer Science series. Since CLEF 2005, the Working Notes are published in electronic format only and are distributed to participants at the Workshop on a memory stick together with a printed volume of Extended Abstracts. The Working Notes for all the ten CLEF campaigns can be found in electronic form on the CLEF website at www.clef-campaign.org. Both the 2009 Working Notes and Book of Abstracts are divided into ten sections, corresponding to the eight main evaluation tracks, the experimental pilot task, and another evaluation initiative using CLEF data: Morpho Challenge 2009. Appendices are also included containing run statistics for the Ad Hoc and Grid@CLEF tracks, and a list of all participating institutions. The main features of the 2009 campaign are briefly outlined in the following sections in order to provide the necessary background to the experiments reported in the rest of the Working Notes.