3 Hits in 1.2 sec

Vid2Actor: Free-viewpoint Animatable Person Synthesis from Video in the Wild [article]

Chung-Yi Weng, Brian Curless, Ira Kemelmacher-Shlizerman
2020 arXiv   pre-print
Given an "in-the-wild" video of a person, we reconstruct an animatable model of the person in the video.  ...  At the core of our method is a volumetric 3D human representation reconstructed with a deep network trained on input video, enabling novel pose/view synthesis.  ...  We thank all of the photo owners for allowing us to use their photos; photo credits are given in each figure.  ... 
arXiv:2012.12884v1 fatcat:iuxduntxtnbppdobkelkqdoauy

NeuMan: Neural Human Radiance Field from a Single Video [article]

Wei Jiang, Kwang Moo Yi, Golnoosh Samei, Oncel Tuzel, Anurag Ranjan
2022 arXiv   pre-print
We propose a novel framework to reconstruct the human and the scene that can be rendered with novel human poses and views from just a single in-the-wild video.  ...  Those rough geometry estimates allow us to create a warping field from the observation space to the canonical pose-independent space, where we train the human model in.  ...  HumanNeRF [47] , a concurrent work, aims to create free-viewpoint rendering of human from a single video. While similar to our work, there are two main differences between HumanNeRF [47] and ours.  ... 
arXiv:2203.12575v1 fatcat:d5rri2gfnrh2rl5u675sj6voje

HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video [article]

Chung-Yi Weng, Brian Curless, Pratul P. Srinivasan, Jonathan T. Barron, Ira Kemelmacher-Shlizerman
2022 arXiv   pre-print
We introduce a free-viewpoint rendering method -- HumanNeRF -- that works on a given monocular video of a human performing complex body motions, e.g. a video from YouTube.  ...  Our method optimizes for a volumetric representation of the person in a canonical T-pose, in concert with a motion field that maps the estimated canonical representation to every frame of the video via  ...  Acknowledgement: We thank Marquese Scott for generously allowing us to feature his inspiring videos in this work. Special thanks to dear Lulu Chu for her enduring support.  ... 
arXiv:2201.04127v2 fatcat:dpvrw5zxdfe5zequ5wcemkoyoq