A 3-D Immersive Synthesizer for Environmental Sounds

Charles Verron, Mitsuko Aramaki, Richard Kronland-Martinet, Grégory Pallone
2010 IEEE Transactions on Audio, Speech, and Language Processing  
Nowadays, interactive 3D environments tend to include both synthesis and spatialization processes to increase the realism of virtual scenes. In typical systems, audio generation is created in two stages: first, a monophonic sound is synthesized (generation of the intrinsic timbre properties) and then it is spatialized (positioned in its environment). In this paper, we present the design of a 3D immersive synthesizer dedicated to environmental sounds, and intended to be used in the framework of
more » ... nteractive virtual reality applications. The system is based on a physical categorization of environmental sounds (vibrating solids, liquids, aerodynamics). The synthesis engine has a novel architecture combining an additive synthesis model and 3D audio modules at the prime level of sound generation. An original approach exploiting the synthesis capabilities for simulating the spatial extension of sound sources is also presented. The subjective results, evaluated with a formal listening test, are discussed. Finally, new control strategies based on a global manipulation of timbre and spatial attributes of sound sources are introduced.
doi:10.1109/tasl.2009.2037402 fatcat:ubzmvafzmreuxfwfyschwwlhsa