10 Years of CLEF Data in DIRECT: Where We Are and Where We Can Go

Maristella Agosti, Giorgio Maria Di Nunzio, Marco Dussin, Nicola Ferro
2010 NTCIR Conference on Evaluation of Information Access Technologies  
This paper discusses the evolution of large-scale evaluation campaigns and the corresponding evaluation infrastructures needed to carry them out. We present the next challenges for these initiatives and show how digital library systems can play a relevant role in supporting the research conducted in these fora by acting as virtual research environments.
dblp:conf/ntcir/AgostiNDF10 fatcat:swtcyahksrec5hz7rzmn4za4na