Animation, Sonification, and Fluid-Time: A Visual-Audioizer Prototype

Taylor J Olsen
2020 Proceedings of the International Conference on New Interfaces for Musical Expression  
The visual-audioizer is a patch created in Max in which the concept of fluid-time animation techniques, in tandem with basic computer vision tracking methods, can be used as a tool to allow the visual time-based media artist to create music. Visual aspects relating to the animator's knowledge of motion, animated loops, and auditory synchronization derived from computer vision tracking methods, allow an immediate connection between the generated audio derived from visuals—becoming a new way to
more » ... perience and create audio-visual media. A conceptual overview, comparisons of past/current audio-visual contributors, and a summary of the Max patch will be discussed. The novelty of practice-based animation methods in the field of musical expression, considerations of utilizing the visual-audioizer, and the future of fluid-time animation techniques as a tool of musical creativity will also be addressed.
doi:10.5281/zenodo.4813230 fatcat:yhi2rx6x5rbophj7heo2on7ute