Creating music videos using automatic media analysis

Jonathan Foote, Matthew Cooper, Andreas Girgensohn
2002 Proceedings of the tenth ACM international conference on Multimedia - MULTIMEDIA '02  
We present methods for automatic and semi-automatic creation of music videos, given an arbitrary audio soundtrack and source video. Significant audio changes are automatically detected; similarly, the source video is automatically segmented and analyzed for suitability based on camera motion and exposure. Video with excessive camera motion or poor contrast is penalized with a high unsuitability score, and is more likely to be discarded in the final edit. High quality video clips are then
more » ... ically selected and aligned in time with significant audio changes. Video clips are adjusted to match the audio segments by selecting the most suitable region of the desired length. Besides a fully automated solution, our system can also start with clips manually selected and ordered using a graphical interface. The video is then created by truncating the selected clips (preserving the high quality portions) to produce a video digest that is synchronized with the soundtrack music, thus enhancing the impact of both.
doi:10.1145/641007.641119 dblp:conf/mm/FooteCG02 fatcat:ymwje4cejffkpfpgbmyuolbgzm