Spatio-Temporal Registration Techniques for Relightable 3D Video

Naveed Ahmed, Christian Theobalt, Marcus Magnor, Hans-Peter Seidel
2007 2007 IEEE International Conference on Image Processing  
By jointly applying a model-based marker-less motion capture approach and multi-view texture generation 3D Videos of human actors can be reconstructed from multi-view video streams. If the input data were recorded under calibrated lighting, the texture information can also be used to measure time-varying surface reflectance. This way, 3D videos can be realistically displayed under novel lighting conditions. Reflectance estimation is only feasible if the multi-view textureto-surface registration
more » ... is consistent over time. In this paper, we propose two image-based warping methods that compensate registration errors due to inaccurate model geometry and shifting of apparel over the body.
doi:10.1109/icip.2007.4379202 dblp:conf/icip/AhmedTMS07 fatcat:f5iq53jbnfh5flzxrc2ranaryi