Video coding based on audio-visual attention

Jong-Seok Lee, Francesca De Simone, Touradj Ebrahimi
2009 2009 IEEE International Conference on Multimedia and Expo  
This paper proposes an efficient video coding method based on audio-visual attention, which is motivated by the fact that cross-modal interaction significantly affects humans' perception of multimedia content. First, we propose an audio-visual source localization method to locate the sound source in a video sequence. Then, its result is used for applying spatial blurring to video frames in order to reduce redundant high-frequency information and achieve coding efficiency. We demonstrate the
more » ... ctiveness of the proposed method for H.264/AVC coding along with the results of a subjective evaluation.
doi:10.1109/icme.2009.5202435 dblp:conf/icmcs/LeeSE09 fatcat:ulb6o6xizbb4fnnw5ddnsqph7e