Filters








678 Hits in 4.4 sec

Pose-Guided Photorealistic Face Rotation

Yibo Hu, Xiang Wu, Bing Yu, Ran He, Zhenan Sun
2018 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition  
We propose a novel Couple-Agent Pose-Guided Generative Adversarial Network (CAPG-GAN) to generate both neutral and profile head pose face images.  ...  Face rotation provides an effective and cheap way for data augmentation and representation learning of face recognition.  ...  Towards largepose face frontalization in the wild, FF-GAN [35] is proposed to incorporate 3D face model into GAN.  ... 
doi:10.1109/cvpr.2018.00876 dblp:conf/cvpr/HuWYHS18 fatcat:trl5znmxznfg7fcyvdvspbauee

Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis [article]

Rui Huang, Shu Zhang, Tianyu Li, Ran He
2017 arXiv   pre-print
Photorealistic frontal view synthesis from a single face image has a wide range of applications in the field of face recognition.  ...  This paper proposes a Two-Pathway Generative Adversarial Network (TP-GAN) for photorealistic frontal view synthesis by simultaneously perceiving global structures and local details.  ...  Acknowledgement This work is partially funded by National Natural Science Foundation of China (Grant No. 61622310, 61473289) and the State Key Development Program (Grant No. 2016YFB1001001).  ... 
arXiv:1704.04086v2 fatcat:pwfwvnur6fejnog6i6xqqsa4ta

Automatic Generation of Photorealistic 3D Inner Mouth Animation only from Frontal Images

Masahide Kawai, Tomoyori Iwao, Akinobu Maejima, Shigeo Morishima
2015 Journal of Information Processing  
The algorithms are composed of quasi-3D model reconstruction and motion control of teeth and the tongue, and final compositing of photorealistic speech animation synthesis tailored to the original.  ...  In this paper, we propose a novel method to generate highly photorealistic three-dimensional (3D) inner mouth animation that is well-fitted to an original ready-made speech animation using only frontal  ...  Simulation: Teeth and tongue simulation is based on physical assumptions and phonetic analysis. ( 2 ) Synthesis of the photorealistic inner mouth: Photorealistic inner mouth images are created using only  ... 
doi:10.2197/ipsjjip.23.693 fatcat:thxlyldnwbbzrerpwxnt34mxrm

VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting [article]

Feitong Tan, Sean Fanello, Abhimitra Meka, Sergio Orts-Escolano, Danhang Tang, Rohit Pandey, Jonathan Taylor, Ping Tan, Yinda Zhang
2022 arXiv   pre-print
Multiple experiments and comparisons with other generative frameworks show how our model is a step forward towards photorealistic relightable 3D generative models.  ...  We propose VoLux-GAN, a generative framework to synthesize 3D-aware faces with convincing relighting.  ...  Limitations Although the proposed approach is a step forward towards generative relightable 3D faces, it still has limita- tions.  ... 
arXiv:2201.04873v1 fatcat:hkxwjzghvzanhgtw7vardumrqe

Unsupervised Face Normalization With Extreme Pose and Expression in the Wild

Yichen Qian, Weihong Deng, Jiani Hu
2019 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)  
To this end, we propose a Face Normalization Model (FNM) to generate a frontal, neutral expression, photorealistic face image for face recognition.  ...  Face recognition achieves great success thanks to the emergence of deep learning.  ...  Photorealistic frontal view synthesis from a single face image has an abundance of applications other than face recognition.  ... 
doi:10.1109/cvpr.2019.01008 dblp:conf/cvpr/QianDH19 fatcat:j2djoouupvgyhnjcuawvmyvk5a

Photorealistic Facial Synthesis in the Dimensional Affect Space [article]

Dimitrios Kollias and Shiyang Cheng and Maja Pantic and Stefanos Zafeiriou
2018 arXiv   pre-print
This paper presents a novel approach for synthesizing facial affect, which is based on our annotating 600,000 frames of the 4DFAB database in terms of valence and arousal.  ...  Given this target pair, a set of 3D facial meshes is selected, which is used to build a blendshape model and generate the new facial affect.  ...  To be able to develop the novel expression synthesis method, we annotate these dynamic 3D sequences (over 600,000 frames), in terms of valence and arousal emotion dimensions, using the tool described in  ... 
arXiv:1811.08004v1 fatcat:nevkglgwsbagxatra7gcb5bfny

Photorealistic Facial Synthesis in the Dimensional Affect Space [chapter]

Dimitrios Kollias, Shiyang Cheng, Maja Pantic, Stefanos Zafeiriou
2019 Landolt-Börnstein - Group III Condensed Matter  
This paper presents a novel approach for synthesizing facial affect, which is based on our annotating 600,000 frames of the 4DFAB database in terms of valence and arousal.  ...  Given this target pair, a set of 3D facial meshes is selected, which is used to build a blendshape model and generate the new facial affect.  ...  To be able to develop the novel expression synthesis method, we annotate these dynamic 3D sequences (over 600,000 frames), in terms of valence and arousal emotion dimensions, using the tool described in  ... 
doi:10.1007/978-3-030-11012-3_36 fatcat:3i7w5gf5djfznffcvcco6k2l34

GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis [article]

Katja Schwarz, Yiyi Liao, Michael Niemeyer, Andreas Geiger
2021 arXiv   pre-print
In this paper, we propose a generative model for radiance fields which have recently proven successful for novel view synthesis of a single scene.  ...  While 2D generative adversarial networks have enabled high-resolution image synthesis, they largely lack an understanding of the 3D world and the image formation process.  ...  for novel view synthesis [36] .  ... 
arXiv:2007.02442v4 fatcat:ml7ta2lkmvg6joiwetz7zh7hmy

Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields [article]

Yuedong Chen, Qianyi Wu, Chuanxia Zheng, Tat-Jen Cham, Jianfei Cai
2022 arXiv   pre-print
To kick-off this novel task, we propose the Sem2NeRF framework.  ...  In light of recent advances in NeRF-based 3D-aware generative models, we introduce a new task, Semantic-to-NeRF translation, that aims to reconstruct a 3D scene modelled by NeRF, conditioned on one single-view  ...  ., photorealistic images.  ... 
arXiv:2203.10821v1 fatcat:yewpaqbytjfeho3hu3gl7leec4

Learning to Deblur and Rotate Motion-Blurred Faces [article]

Givi Meishvili, Attila Szabó, Simon Jenni, Paolo Favaro
2021 arXiv   pre-print
We propose a solution to the novel task of rendering sharp videos from new viewpoints from a single motion-blurred image of a face.  ...  Thanks to this dataset, we train a neural network to reconstruct a 3D video representation from a single image and the corresponding face gaze.  ...  Face Model To perform a novel view synthesis of the reconstructed sharp frame sequence, we need to know the 3D rotation of the face.  ... 
arXiv:2112.07599v1 fatcat:tysnbsszwbfuvj7ug4jqno3x3i

ExploreMaps: Efficient construction and ubiquitous exploration of panoramic view graphs of complex 3D environments

M. Di Benedetto, F. Ganovelli, M. Balsa Rodriguez, A. Jaspe Villanueva, R. Scopigno, E. Gobbetti
2014 Computer graphics forum (Print)  
Images and videos are precomputed at construction time with off-line photorealistic rendering engines, providing a convincing 3D visualization beyond the limits of current real-time graphics techniques  ...  Abstract We introduce a novel efficient technique for automatically transforming a generic renderable 3D scene into a simple graph representation named ExploreMaps, where nodes are nicely placed point  ...  We also acknowledge the contribution of Sardinian Regional Authorities. We thank Roberto Combet for blender wizardry. See accompanying video for model credits.  ... 
doi:10.1111/cgf.12334 fatcat:e63ovnwdv5h3nfscy64xxwd2jq

FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animation [article]

ShahRukh Athar, Zhixin Shu, Dimitris Samaras
2021 arXiv   pre-print
Recent advances in volumetric neural rendering, such as neural radiance fields (NeRF), has enabled the photorealistic novel view synthesis of static scenes with impressive results.  ...  We leverage the expression space of a 3D morphable face model (3DMM) to represent the distribution of human facial expressions, and use it to condition the NeRF volumetric function.  ...  It is closely related to recent work on neural rendering and novel view synthesis, 3D face modeling, and controllable face generation. Below we discuss these related work.  ... 
arXiv:2108.04913v1 fatcat:nxqymr2g6zdpjkdugulok6tscq

Real-Time Neural Character Rendering with Pose-Guided Multiplane Images [article]

Hao Ouyang, Bo Zhang, Pan Zhang, Hao Yang, Jiaolong Yang, Dong Chen, Qifeng Chen, Fang Wen
2022 arXiv   pre-print
Our method demonstrates advantageous novel-view synthesis quality over the state-of-the-art approaches for characters with challenging motions.  ...  We propose pose-guided multiplane image (MPI) synthesis which can render an animatable character in real scenes with photorealistic quality.  ...  We show the results for novel pose combination in Fig. 9 . In this example, we want to combine the right hand of the first input with the body and the face with the second input.  ... 
arXiv:2204.11820v1 fatcat:svrgg7sr2vgdfpua74rgo6cqge

pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis [article]

Eric R. Chan, Marco Monteiro, Petr Kellnhofer, Jiajun Wu, Gordon Wetzstein
2021 arXiv   pre-print
The proposed approach obtains state-of-the-art results for 3D-aware image synthesis with multiple real and synthetic datasets.  ...  We propose a novel generative model, named Periodic Implicit Generative Adversarial Networks (π-GAN or pi-GAN), for high-quality 3D-aware image synthesis. π-GAN leverages neural representations with periodic  ...  Photorealistic 3D-aware image synthesis has many exciting applications in vision and graphics. With our work, we take a significant step towards this goal. A.  ... 
arXiv:2012.00926v2 fatcat:scgeqv3a4ngh7n4qzu2tkst5aq

Lifting AutoEncoders: Unsupervised Learning of a Fully-Disentangled 3D Morphable Model using Deep Non-Rigid Structure from Motion [article]

Mihir Sahasrabudhe, Zhixin Shu, Edward Bartrum, Riza Alp Guler, Dimitris Samaras, Iasonas Kokkinos
2019 arXiv   pre-print
The learned generative model can be controlled in terms of interpretable geometry and appearance factors, allowing us to perform photorealistic image manipulation of identity, expression, 3D pose, and  ...  We further use weak supervision to disentangle the non-rigid shape variability of human faces into identity and expression.  ...  Having established a controllable, 3D-based rendering pipeline, we turn to photorealistic synthesis.  ... 
arXiv:1904.11960v1 fatcat:ohpo2bu3rbe2hm5dwq4k55cnv4
« Previous Showing results 1 — 15 out of 678 results