Synthesis of VV Utterances from Muscle Activation to Sound with a 3D Model

Saeed Dabbaghchian, Marc Arnela, Olov Engwall, Oriol Guasch
2017 Interspeech 2017   unpublished
We propose a method to automatically generate deformable 3D vocal tract geometries from the surrounding structures in a biomechanical model. This allows us to couple 3D biomechanics and acoustics simulations. The basis of the simulations is muscle activation trajectories in the biomechanical model, which move the articulators to the desired articulatory positions. The muscle activation trajectories for a vowel-vowel utterance are here defined through interpolation between the determined
more » ... ons of the start and end vowel. The resulting articulatory trajectories of flesh points on the tongue surface and jaw are similar to corresponding trajectories measured using Electromagnetic Articulography, hence corroborating the validity of interpolating muscle activation. At each time step in the articulatory transition, a 3D vocal tract tube is created through a cavity extraction method based on first slicing the geometry of the articulators with a semi-polar grid to extract the vocal tract contour in each plane and then reconstructing the vocal tract through a smoothed 3D mesh-generation using the extracted contours. A finite element method applied to these changing 3D geometries simulates the acoustic wave propagation. We present the resulting acoustic pressure changes on the vocal tract boundary and the formant transitions for the utterance [Ai]. Index Terms: speech production, air-tight geometry, Finite Element Method, biomechanical model, acoustic model, deformable vocal tract, vowel-vowel sequences including the upper lip, maxilla, soft palate, pharynx wall, and larynx are static. A list of the jaw and tongue muscles are pre-
doi:10.21437/interspeech.2017-1614 fatcat:5pzhp7ba6jhmbe7aog7a32shfy