Efficient and practical audio-visual rendering for games using crossmodal perception

David Grelaud, Nicolas Bonneel, Michael Wimmer, Manuel Asselot, George Drettakis
2009 Proceedings of the 2009 symposium on Interactive 3D graphics and games - I3D '09  
Interactive applications such as computer games, are inherently audio visual, requiring high-quality rendering of complex 3D audio soundscapes and graphics environments. A frequent source of audio events is impact sounds, typically generated with physics engines. In this paper, we first present an optimization allowing efficient usage of impact sounds in a unified audio rendering pipeline, also including prerecorded sounds. We also exploit a recent result on audio-visual crossmodal perception
more » ... smodal perception to introduce a new level-ofdetail selection algorithm, which jointly chooses the quality level of audio and graphics rendering. We have integrated these two techniques as a comprehensive crossmodal audio-visual rendering pipeline in a home-grown game engine, thus demonstrating the potential utility of our approach.
doi:10.1145/1507149.1507178 dblp:conf/si3d/GrelaudBWAD09 fatcat:irv4gxljtnbwdcrfa3op5jx22i