Video Précis: Highlighting Diverse Aspects of Videos

Nitesh Shroff, Pavan Turaga, Rama Chellappa
2010 IEEE transactions on multimedia  
Summarizing long unconstrained videos is gaining importance in surveillance, web-based video browsing, and video-archival applications. Summarizing a video requires one to identify key aspects that contain the essence of the video. In this paper, we propose an approach that optimizes two criteria that a video summary should embody. The first criterion, 'coverage', requires that the summary be able to represent the original video well. The second criterion, 'diversity', requires that the
more » ... es that the elements of the summary be as distinct from each other as possible. Given a user-specified summary length, we propose a cost function to measure the quality of a summary. The problem of generating a précis is then reduced to a combinatorial optimization problem of minimizing the proposed cost function. We propose an efficient method to solve the optimization problem. We demonstrate through experiments (on KTH data, unconstrained skating video, a surveillance video, and a YouTube home video) that optimizing the proposed criterion results in meaningful video summaries over a wide range of scenarios. Summaries thus generated are then evaluated using both quantitative measures and user-studies.
doi:10.1109/tmm.2010.2058795 fatcat:r24hozk2wjbxniypwzrljcnlju