3D SSD Tracking from Uncalibrated Video [chapter]

Dana Cobzas, Martin Jagersand
2006 Lecture Notes in Computer Science  
In registration-based motion tracking precise pose between a reference template and the current images is determined by warping image patches into the template coordinates and matching pixelwise intensities. Efficient such algorithms are based on relating spatial and temporal derivatives using numerical optimization algorithms. We extend this approach from planar patches into a formulation where the 3D geometry of a scene is both estimated from uncalibrated video and used in the tracking of the
more » ... same video sequence. Our tracking algorithm is different than traditional SSD tracking as it trackers a 3D pose global to all patches and not individual 2D image warps. Experimentally we compare convergence and accuracy of our uncalibrated 3D tracking to previous approaches. Notably, the 3D algorithm can successfully track over significantly larger pose changes than ones using only 2D planar regions. It also allows for the detection of occlusions and removal/insertion of tracking regions as appropriate in response.
doi:10.1007/11676959_3 fatcat:mmlcv6e6snehvfr2unvxq2df3u