Finding Correspondence from Multiple Images via Sparse and Low-Rank Decomposition [chapter]

Zinan Zeng, Tsung-Han Chan, Kui Jia, Dong Xu
2012 Lecture Notes in Computer Science  
We investigate the problem of finding the correspondence from multiple images, which is a challenging combinatorial problem. In this work, we propose a robust solution by exploiting the priors that the rank of the ordered patterns from a set of linearly correlated images should be lower than that of the disordered patterns, and the errors among the reordered patterns are sparse. This problem is equivalent to find a set of optimal partial permutation matrices for the disordered patterns such
more » ... the rearranged patterns can be factorized as a sum of a low rank matrix and a sparse error matrix. A scalable algorithm is proposed to approximate the solution by solving two sub-problems sequentially: minimization of the sum of nuclear norm and l 1 norm for solving relaxed partial permutation matrices, followed by a binary integer programming to project each relaxed partial permutation matrix to the feasible solution. We verify the efficacy and robustness of the proposed method with extensive experiments with both images and videos.
doi:10.1007/978-3-642-33715-4_24 fatcat:rstmkbixubgljepryqpulqtpya