A Modular Tool for Automatic Soundpainting Query Recognition and Music Generation in Max/MSP

Arthur Parmentier, Ken Déguernel, Constance Frei
2021 Zenodo  
This paper presents a modular software designed for automatic recognition of Soundpainting query. Soundpainting is a musical practice and a sign language used for real-time composition with an orchestra. A series of signs is gestured by the soundpainter creating a "sentence" describing a musical idea that they want the orchestra to perform. We propose an open-source tool, for Max/MSP, able to perform every task for a computer to be part of a Soundpainting scene: motion tracking, gesture
more » ... ion, query parsing and music generation. This tool is created in a modular way so that it can be easily modified to fit the needs of the user, for instance, changing the type of inputs for the motion tracking or adapting the Soundpainting grammar. We describe the global architecture, the different components of this tool, and the currently implemented methods for each of these components. We then show examples of use for this tool, from the learning of a new sign to a performance with several virtual instruments.
doi:10.5281/zenodo.5042780 fatcat:uvhi7rkvqzhfbigzprhtnxvvfa