Instance search retrospective with focus on TRECVID

George Awad, Wessel Kraaij, Paul Over, Shin'ichi Satoh
2017 International Journal of Multimedia Information Retrieval  
This paper presents an overview of the Video Instance Search benchmark which was run over a period of 6 years (2010-2015) as part of the TREC Video Retrieval (TRECVID) workshop series. The main contributions of the paper include i) an examination of the evolving design of the evaluation framework and its components (system tasks, data, measures); ii) an analysis of the influence of topic characteristics (such as rigid/non rigid, planar/non-planar, stationary/mobile on performance; iii) a
more » ... vel overview of results and best-performing approaches. The Instance Search (INS) benchmark worked with a variety of large collections of data including Sound & Vision, Flickr, BBC (British Broadcasting Corporation) Rushes for the first 3 pilot years and with the small world of the BBC Eastenders series for the last 3 years.
doi:10.1007/s13735-017-0121-3 pmid:28758054 pmcid:PMC5531298 fatcat:3khp2cscmbhohipfx246gspqlq