Review and Preview: Disocclusion by Inpainting for Image-Based Rendering

Zinovi Tauber, Ze-Nian Li, Mark S. Drew
2007 IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews)  
Image-based rendering takes as input multiple images of an object and generates photorealistic images from novel viewpoints. This approach avoids explicitly modeling scenes by replacing the modeling phase with an object reconstruction phase. Reconstruction is achieved in two possible ways: recovering 3D point locations using multiview stereo techniques, or reasoning about consistency of each voxel in a discretized object volume space. The most challenging problem for image-based reconstruction
more » ... s the presence of occlusions. Occlusions make reconstruction ambiguous for object parts not visible in any input image. These parts must be reconstructed in a visually acceptable way. This review presents our insights for image inpainting to provide both attractive reconstruction and a framework increasing the accuracy of depth recovery. Digital image inpainting refers to any methods that fill-in holes of arbitrary topology in images so that they seem to be part of the original image. Available methods are broadly classified as structural inpainting or textural inpainting. Structural inpainting reconstructs using prior assumptions and boundary conditions, while textural inpainting only considers available data from texture exemplars or other templates. Of particular interest is research of structural inpainting applied to 3D models, impressing its effectiveness for disocclusion.
doi:10.1109/tsmcc.2006.886967 fatcat:oybycazo7bhn7gbjpsqhnb5inm