Gesture-based control of physical modeling sound synthesis

Jules Françoise, Norbert Schnell, Frédéric Bevilacqua
2013 Proceedings of the 21st ACM international conference on Multimedia - MM '13  
We address the issue of mapping between gesture and sound for gesture-based control of physical modeling sound synthesis. We propose an approach called mapping by demonstration, allowing users to design the mapping by performing gestures while listening to sound examples. The system is based on a multimodal model able to learn the relationships between gestures and sounds.
doi:10.1145/2502081.2502262 dblp:conf/mm/FrancoiseSB13 fatcat:itwbftotrzdp3dwbw2gof3vxfy