Accurate Human Body Reconstruction for Volumetric Video [article]

Decai Chen, Markus Worchel, Ingo Feldmann, Oliver Schreer, Peter Eisert
2022 arXiv   pre-print
In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate depth maps using traditional stereo matching techniques, we introduce and optimize deep learning-based multi-view stereo networks for depth map estimation in the context of professional volumetric video reconstruction. Furthermore, we propose a novel depth map post-processing
more » ... ach including filtering and fusion, by taking into account photometric confidence, cross-view geometric consistency, foreground masks as well as camera viewing frustums. We show that our method can generate high levels of geometric detail for reconstructed human bodies.
arXiv:2202.13118v1 fatcat:nz53fexmkfbifejr3f6fj2ke2e