Keyframe Extraction Using Local Visual Semantics in the Form of a Region Thesaurus

Evaggelos Spyrou, Yannis Avrithis
2007 Second International Workshop on Semantic Media Adaptation and Personalization (SMAP 2007)  
This paper presents an approach for efficient keyframe extraction, using local semantics in form of a region thesaurus. More specifically, certain MPEG-7 color and texture features are locally extracted from keyframe regions. Then, using a hierarchical clustering approach a local region thesaurus is constructed to facilitate the description of each frame in terms of higher semantic features. The feature is consisted by the most common region types that are encountered within the video shot,
more » ... the video shot, along with their synonyms. These region types carry semantic information. Each keyframe is represented by a vector consisting of the degrees of confidence of the existence of all region types within this shot. Using this keyframe representation, the most representative keyframe is then selected for each shot. Where a single keyframe is not adequate, using the same algorithm and exploiting the coverage of the visual thesaurus, more keyframes are extracted.
doi:10.1109/smap.2007.39 dblp:conf/smap/SpyrouA07 fatcat:nnnnz2ersvevzb22cpyunvowhm