Key Event Detection in Video using ASR and Visual Data

Niraj Shrestha, Aparna N. Venkitasubramanian, Marie-Francine Moens
<span title="">2014</span> <i title="Dublin City University and the Association for Computational Linguistics"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/dp2g5gfrlben3ex5zv23ummeem" style="color: black;">Proceedings of the Third Workshop on Vision and Language</a> </i> &nbsp;
Multimedia data grow day by day which makes it necessary to index them automatically and efficiently for fast retrieval, and more precisely to automatically index them with key events. In this paper, we present preliminary work on key event detection in British royal wedding videos using automatic speech recognition (ASR) and visual data. The system first automatically acquires key events of royal weddings from an external corpus such as Wikipedia, and then identifies those events in the ASR
more &raquo; ... a. The system also models name and face alignment to identify the persons involved in the wedding events. We compare the results obtained with the ASR output with results obtained with subtitles. The error is only slightly higher when using ASR output in the detection of key events and their participants in the wedding videos compared to the results obtained with subtitles. This work is licenced under a Creative Commons Attribution 4.0 International License. License details: http:// creativecommons.org/licenses/by/4.0/
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.3115/v1/w14-5407">doi:10.3115/v1/w14-5407</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/acl-vl/ShresthaVM14.html">dblp:conf/acl-vl/ShresthaVM14</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/gjy447zno5etnjo23zdztlmkzi">fatcat:gjy447zno5etnjo23zdztlmkzi</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170921231624/http://anthology.aclweb.org/W/W14/W14-5407.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/86/50/865065cd4c20dff2f0a4bc38bb8cb6e7edf1cd25.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.3115/v1/w14-5407"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / doi.org </button> </a>