Geo-PIFu: Geometry and Pixel Aligned Implicit Functions for Single-view Human Reconstruction [article]

Tong He, John Collomosse, Hailin Jin, Stefano Soatto
<span title="2020-12-07">2020</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
We propose Geo-PIFu, a method to recover a 3D mesh from a monocular color image of a clothed person. Our method is based on a deep implicit function-based representation to learn latent voxel features using a structure-aware 3D U-Net, to constrain the model in two ways: first, to resolve feature ambiguities in query point encoding, second, to serve as a coarse human shape proxy to regularize the high-resolution mesh and encourage global shape regularity. We show that, by both encoding query
more &raquo; ... ts and constraining global shape using latent voxel features, the reconstruction we obtain for clothed human meshes exhibits less shape distortion and improved surface details compared to competing methods. We evaluate Geo-PIFu on a recent human mesh public dataset that is 10 × larger than the private commercial dataset used in PIFu and previous derivative work. On average, we exceed the state of the art by 42.7% reduction in Chamfer and Point-to-Surface Distances, and 19.4% reduction in normal estimation errors.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2006.08072v2">arXiv:2006.08072v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/7qbnswptdfapzh2e5bxygvrsgy">fatcat:7qbnswptdfapzh2e5bxygvrsgy</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20201209055022/https://arxiv.org/pdf/2006.08072v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/57/58/57588b9ca99877cae0b5776919acf3f0fdbf2a35.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2006.08072v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>