Mesh-based video objects tracking combining motion and luminance discontinuities criteria

Sébastien Valette, Isabelle Magnin, Rémy Prost
2004 Signal Processing  
A new content-based mesh design algorithm for video objects segmentation and tracking is proposed. The algorithm moves the mesh nodes along motion or luminance discontinuities in order to ÿt the objects boundaries. The motion inside adjacent triangular cells is estimated by competitive forward-backward matching. This approach allows the displacements of the nodes without the remeshing of occlusion regions: uncovered background nor background to be covered. The mesh is deformed under the
more » ... tion of an objective function. This function includes a motion energy, a spatial boundary energy and a temporal regularization energy. The motion energy is e ective in textured regions while the boundary energy mainly operates in homogeneous one according to a boundary distance map. The temporal regularization energy keeps the objects tracking stable along the sequence due to its object-based approach. Experimental results with both synthetic and real-world sequences prove the e ciency of the proposed approach and the cooperative action of the three energy terms. ? 2004 Elsevier B.V. All rights reserved.
doi:10.1016/j.sigpro.2004.04.003 fatcat:dtdmrn35c5fxhnlteei74u6y7i