Video annotation of TV content using audiovisual information

Joao Mateus, Frederico Malheiro, Sofia Cavaco, Nuno Correia, Rui Jesus
2012 2012 International Conference on Multimedia Computing and Systems  
Content provider companies and televisions have large video archives but usually do not take full advantage of them. In order to assist the exploration of video archives, we developed ViewProcFlow, a tool to automatically extract metadata from video. This metadata is obtained by applying several state of the art video processing methods applied to a real world challenge: cut detection, face detection and object identification. In addition, we also developed a method to annotate videos with
more » ... pts from audio and visual information. The main novelty of this technique is the use of environmental sound recognition to annotate video. The goal is to supply the system with more information such that it has a better understanding of the content and also to enable better browse and search functionalities. This tool has been included in the workflow of a video production company, which confirms its success.
doi:10.1109/icmcs.2012.6320188 dblp:conf/icmcs2/MateusMC0J12 fatcat:k6jym3l2yvcjtnfjbluv6f4fuy