Overview of the NTCIR-8 ACLIA Tasks: Advanced Cross-Lingual Information Access

Teruko Mitamura, Hideki Shima, Tetsuya Sakai, Noriko Kando, Tatsunori Mori, Koichi Takeda, Chin-Yew Lin, Ruihua Song, Chuan-Jie Lin, Cheng-Wei Lee
2010 NTCIR Conference on Evaluation of Information Access Technologies  
This paper presents an overview of the ACLIA (Advanced Cross-Lingual Information Access) task cluster at NTCIR-8. The task overview includes: a definition of and motivation for the evaluation; a description of the complex and factoid question types evaluated; the document sources and exchange formats selected and/or defined; the official metrics used in evaluating participant runs; the tools and process used to develop the official evaluation topics; summary data regarding the runs submitted;
more » ... d the results of evaluating the submitted runs with the official metrics.
dblp:conf/ntcir/MitamuraSSKMTLS10 fatcat:2rink2joubet7goe4vus64tyry