Deformable Surface 3D Reconstruction from Monocular Images

Mathieu Salzmann, Pascal Fua
2010 Synthesis Lectures on Computer Vision  
Being able to recover the shape of 3D deformable surfaces from a single video stream would make it possible to field reconstruction systems that run on widely available hardware without requiring specialized devices. However, because many different 3D shapes can have virtually the same projection, such monocular shape recovery is inherently ambiguous. In this survey, we will review the two main classes of techniques that have proved most effective so far: The template-based methods that rely on
more » ... establishing correspondences with a reference image in which the shape is already known, and non-rigid structure-from-motion techniques that exploit points tracked across the sequences to reconstruct a completely unknown shape. In both cases, we will formalize the approach, discuss its inherent ambiguities, and present the practical solutions that have been proposed to resolve them. To conclude, we will suggest directions for future research.
doi:10.2200/s00319ed1v01y201012cov003 fatcat:r4s4vpjptvfjtgj3bpgrvav2xq