Shading-based dynamic shape refinement from multi-view video under general illumination

Chenglei Wu, Kiran Varanasi, Yebin Liu, Hans-Peter Seidel, Christian Theobalt
2011 2011 International Conference on Computer Vision  
We present an approach to add true fine-scale spatiotemporal shape detail to dynamic scene geometry captured from multi-view video footage. Our approach exploits shading information to recover the millimeter-scale surface structure, but in contrast to related approaches succeeds under general unconstrained lighting conditions. Our method starts off from a set of multi-view video frames and an initial series of reconstructed coarse 3D meshes that lack any surface detail. In a spatio-temporal
more » ... mum a posteriori probability (MAP) inference framework, our approach first estimates the incident illumination and the spatiallyvarying albedo map on the mesh surface for every time instant. Thereafter, albedo and illumination are used to estimate the true geometric detail visible in the images and add it to the coarse reconstructions. The MAP framework uses weak temporal priors on lighting, albedo and geometry which improve reconstruction quality yet allow for temporal variations in the data.
doi:10.1109/iccv.2011.6126358 dblp:conf/iccv/WuVLST11 fatcat:kkcwh7jr7jecjggkpkm3dzujlu