4 Hits in 2.4 sec

FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality [article]

Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt, Matthias Nießner
2018 arXiv   pre-print
Based on reenactment of a prerecorded stereo video of the person without the HMD, FaceVR incorporates photo-realistic re-rendering in real time, thus allowing artificial modifications of face and eye appearances  ...  The key component of FaceVR is a robust algorithm to perform real-time facial motion capture of an actor who is wearing a head-mounted display (HMD), as well as a new data-driven approach for eye tracking  ...  ACKNOWLEDGMENTS We thank Angela Dai for the video voice over and all actors for the VR reenactment. The facial landmark tracker was kindly provided by TrueVisionSolution.  ... 
arXiv:1610.03151v2 fatcat:pnx2nfjqrrgpbcpaarsrg6ykwi

VR content creation and exploration with deep learning: A survey

Miao Wang, Xu-Quan Lyu, Yi-Jun Li, Fang-Lue Zhang
2020 Computational Visual Media  
Virtual reality (VR) offers an artificial, computer generated simulation of a real life environment.  ...  It originated in the 1960s and has evolved to provide increasing immersion, interactivity, imagination, and intelligence.  ...  [158] proposed the FaceVR system, a novel image-based method that performs real-time facial motion capture of an actor mounted with an HMD to enable VR teleconferencing based on self-reenactment.  ... 
doi:10.1007/s41095-020-0162-z fatcat:lgogzx26bvhn5f7uyefjkz7zny

VirtualCube: An Immersive 3D Video Communication System [article]

Yizhong Zhang, Jiaolong Yang, Zhen Liu, Ruicheng Wang, Guojun Chen, Xin Tong, Baining Guo
2021 arXiv   pre-print
The VirtualCube system correctly preserves the mutual eye gaze between participants, allowing them to establish eye contact and be aware of who is visually paying attention to them.  ...  To achieve real-time rendering of remote participants, we develop the V-Cube View algorithm, which uses multi-view stereo for more accurate depth estimation and Lumi-Net rendering for better rendering  ...  Facevr: Real-time gaze-aware facial reenactment in virtual reality. ACM Trans. on Graphics, 37(2), 2018. [75] E. Tola, C. Zhang, Q. Cai, and Z. Zhang.  ... 
arXiv:2112.06730v2 fatcat:ce7dls4fvbf7zbyqdn7mx4hvpe

Generative RGB-D Face Completion for Head-Mounted Display Removal

Nels Numan, Frank ter Haar, Pablo Cesar
2021 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)  
Virtual reality (VR) creates an exceptional experience in which users can explore virtual environments.  ...  This makes immersive social VR experiences possible, where people in different physical locations can be placed in the same virtual environment.  ...  1 Introduction Virtual reality (VR) creates an exceptional experience in which users can explore virtual environments.  ... 
doi:10.1109/vrw52623.2021.00028 fatcat:sbcco2znvnhvfpq3crk2xlqlza