On clustering and retrieval of video shots through temporal slices analysis

Chong-Wah Ngo, Ting-Chuen Pong, Hong-Jiang Zhang
2002 IEEE transactions on multimedia  
Based on the analysis of temporal slices, we propose novel approaches for clustering and retrieval of video shots. Temporal slices are a set of two-dimensional (2-D) images extracted along the time dimension of an image volume. They encode rich set of visual patterns for similarity measure. In this paper, we first demonstrate that tensor histogram features extracted from temporal slices are suitable for motion retrieval. Subsequently, we integrate both tensor and color histograms for
more » ... g a two-level hierarchical clustering structure. Each cluster in the top level contains shots with similar color while each cluster in bottom level consists of shots with similar motion. The constructed structure is then used for the cluster-based retrieval. The proposed approaches are found to be useful particularly for sports games, where motion and color are important visual cues when searching and browsing the desired video shots.
doi:10.1109/tmm.2002.802022 fatcat:zvuowrweuncklmdybfx5djog6u