Head2Head: Video-based Neural Head Synthesis [article]

Mohammad Rami Koujan, Michail Christos Doukas, Anastasios Roussos, Stefanos Zafeiriou
2020 arXiv   pre-print
In this paper, we propose a novel machine learning architecture for facial reenactment. In particular, contrary to the model-based approaches or recent frame-based methods that use Deep Convolutional Neural Networks (DCNNs) to generate individual frames, we propose a novel method that (a) exploits the special structure of facial motion (paying particular attention to mouth motion) and (b) enforces temporal consistency. We demonstrate that the proposed method can transfer facial expressions,
more » ... and gaze of a source actor to a target video in a photo-realistic fashion more accurately than state-of-the-art methods.
arXiv:2005.10954v1 fatcat:kw43v65lindf3oapvw7rnjxgbu