Animation of generic 3D head models driven by speech

Lucas Terissi, Mauricio Cerda, Juan C. Gomez, Nancy Hitschfeld-Kahler, Bernard Girau, Renato Valenzuela
2011 2011 IEEE International Conference on Multimedia and Expo  
In this paper, a system for speech-driven animation of generic 3D head models is presented. The system is based on the inversion of a joint Audio-Visual Hidden Markov Model to estimate the visual information from speech data. Estimated visual speech features are used to animate a simple face model. The animation of a more complex head model is then obtained by automatically mapping the deformation of the simple model to it. The proposed algorithm allows the animation of 3D head models of
more » ... ry complexity through a simple setup procedure. The resulting animation is evaluated in terms of intelligibility of visual speech through subjective tests, showing a promising performance.
doi:10.1109/icme.2011.6011861 dblp:conf/icmcs/TerissiCGHGV11 fatcat:hhvcmkxr4ncw5kdcfq4f3oe5l4