Assessing concept selection for video retrieval

Bouke Huurnink, Katja Hofmann, Maarten de Rijke
2008 Proceeding of the 1st ACM international conference on Multimedia information retrieval - MIR '08  
We explore the use of benchmarks to address the problem of assessing concept selection in video retrieval systems. Two benchmarks are presented, one created by human association of queries to concepts, the other generated from an extensively tagged collection. They are compared in terms of reliability, captured semantics, and retrieval performance. Recommendations are given for using the benchmarks to assess concept selection algorithms; the assessment is demonstrated on two existing
more » ... The benchmarks are released to the research community.
doi:10.1145/1460096.1460170 dblp:conf/mir/HuurninkHR08 fatcat:h7mlbl52enb6pgtxfbi5b7dsry