Polish Monolingual Task within Cultural Heritage in CLEF (CHiC) 2013. Wrocław Runs

Adam Pawlowski
2013 Conference and Labs of the Evaluation Forum  
The objective of the experiment described in the article was the evaluation of Polish digital resources searchable by the engine Europeana. Queries were created so as to represent proportional shares of common names, named entities and their combinations. They were manually enriched by students, experienced professionals and humanities-oriented educated persons. The system responses were then evaluated according to their Mean Average Precision. The average efficiency of information retrieval
more » ... Polish monolingual queries was weak: there were only 26.6% of highly relevant responses and as much as 73.5% of queries produced unsatisfactory results. MAP produced the best results for the automatic search (0,314), while enriched files contained less relevant results: for the expert users MAP value was 0,1795, for the educated users it was 0,1529 and for students 0,1279. The overall results proved that the IR process concerning Polish resources searchable by Europeana require significant improvement.
dblp:conf/clef/Pawlowski13 fatcat:xclxsd6o4zdxplessly27bwrte