Emotional facial expression transfer based on temporal restricted Boltzmann machines

Shuojun Liu, Dong-Yan Huang, Weisi Lin, Minghui Dong, Haizhou Li, Ee Ping Ong
2014 Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific  
Emotional facial expression transfer involves sequence-to-sequence mappings from an neutral facial expression to another emotional facial expression, which is a well-known problem in computer graphics. In the graphics community, current considered methods are typically linear (e.g., methods based on blendshape mapping) and the dynamical aspects of the facial motion itself are not taken into account. This makes it difficult to retarget the facial articulations involved in speech. In this paper,
more » ... e apply a temporal restricted Boltzmann machines based model to emotional facial expression transfer. The method can encode a complex nonlinear mapping from the motion of one neutral facial expression to another emotional facial expression which captures facial geometry and dynamics of both neutral state and emotional state.
doi:10.1109/apsipa.2014.7041738 dblp:conf/apsipa/LiuHLDLO14 fatcat:3mdrpzr7kfdr3hbctv5ixf27ay