A semi-direct approach to structure from motion

Hailin Jin, Paolo Favaro, Stefano Soatto
2003 The Visual Computer  
Reconstructing three-dimensional structure and motion is often decomposed into two steps: point feature correspondence and three-dimensional reconstruction. This separation often causes gross errors since correspondence relies on the brightness constancy constraint that is local in space and time. Therefore, we advocate the necessity to integrate visual information not only in time (i.e. across different views), but also in space, by matching regionsrather than points -using explicit
more » ... deformation models. We present an algorithm that integrates 2D region tracking and 3D motion estimation into a closed loop based on an explicit geometric and photometric model, while detecting and rejecting outlier regions that do not fit the model. Our algorithm is recursive and suitable for realtime implementation. Our experiments show that it far exceeds the accuracy and robustness of point feature-based SFM algorithms. * This research is supported in part by ARO grant DAAD19-99-1-0139 and Intel grant 8029. 1 There are of course exceptions to this general scheme, as we discuss in section 1.2.
doi:10.1007/s00371-003-0202-6 fatcat:kozugtvwrvc6zdnjhckcuwxwca