Controllable high-fidelity facial performance transfer

Feng Xu, Jinxiang Chai, Yilong Liu, Xin Tong
2014 ACM Transactions on Graphics  
Figure 1 : Our system transfers high-fidelity facial animation data from a source facial model to a target facial model while allowing the user to control and edit the retargeted animation sequence in the spacetime domain. Abstract Recent technological advances in facial capture have made it possible to acquire high-fidelity 3D facial performance data with stunningly high spatial-temporal resolution. Current methods for facial expression transfer, however, are often limited to large-scale
more » ... deformation. This paper introduces a novel facial expression transfer and editing technique for high-fidelity facial performance data. The key idea of our approach is to decompose high-fidelity facial performances into high-level facial feature lines, large-scale facial deformation and fine-scale motion details and transfer them appropriately to reconstruct the retargeted facial animation in an efficient optimization framework. The system also allows the user to quickly modify and control the retargeted facial sequences in the spatial-temporal domain. We demonstrate the power of our approach by transferring and editing high-fidelity facial animation data from high-resolution source models to a wide range of target models, including both human faces and non-human faces such as "monster" and "dog".
doi:10.1145/2601097.2601210 fatcat:srywyxguhnhynaymb4d4xote7m