What happened in CLEF 2008: Introduction to the Working Notes

Carol Peters
2008 Conference and Labs of the Evaluation Forum  
The objective of the Cross Language Evaluation Forum 1 is to promote research in the field of multilingual system development. This is done through the organisation of annual evaluation campaigns in which a series of tracks designed to test different aspects of mono-and cross-language information retrieval (IR) are offered. The intention is to encourage experimentation with all kinds of multilingual information access -from the development of systems for monolingual retrieval operating on many
more » ... anguages to the implementation of complete multilingual multimedia search services. This has been achieved by offering an increasingly complex and varied set of evaluation tasks over the years. The aim is not only to meet but also to anticipate the emerging needs of the R&D community and to encourage the development of next generation multilingual IR systems. These Working Notes contain descriptions of the experiments conducted within CLEF 2008 -the ninth in a series of annual system evaluation campaigns. The results of the experiments will be presented and discussed in the CLEF 2008 Workshop, 17-19 September, Aarhus, Denmark. The final papers -revised and extended as a result of the discussions at the Workshop -together with a comparative analysis of the results will appear in the CLEF 2008 Proceedings, to be published by Springer in their Lecture Notes for Computer Science series. Since CLEF 2005, the Working Notes are published in electronic format only and are distributed to participants at the Workshop together with a printed volume of Extended Abstracts. In previous years, this was in form of a CD-ROM; this year the Working Notes will be distributed on a memory stick. We're moving with the times! Both Working Notes and Book of Abstracts are divided into ten sections, corresponding to the seven main evaluation tracks, the two pilot tasks, and an additional section describing another evaluation initiative using CLEF data: MorphoChallenge 2008. In addition appendices are included containing run statistics for the Ad Hoc, Domain-Specific, and GeoCLEF tracks, plus a list of all participating groups showing in which track they took part. The main features of the 2008 campaign are briefly outlined here below in order to provide the necessary background to the experiments reported in the rest of the Working Notes. CLEF is run mainly on a voluntary basis and is coordinated by the Istituto di Scienza e Tecnologie dell'Informazione, Consiglio Nazionale delle Ricerche, Pisa. The following institutions have contributed to the organisation of the different tracks of the CLEF 2008 campaign:
dblp:conf/clef/Peters08a fatcat:sguzidsq25hincctifanop2sz4