Near-Duplicate Keyframe Identification With Interest Point Matching and Pattern Learning

Wan-Lei Zhao, Chong-Wah Ngo, Hung-Khoon Tan, Xiao Wu
2007 IEEE transactions on multimedia  
This paper proposes a new approach for nearduplicate keyframe (NDK) identification by matching, filtering and learning of local interest points (LIPs) with PCA-SIFT descriptors. The issues in matching reliability, filtering efficiency and learning flexibility are novelly exploited to delve into the potential of LIP-based retrieval and detection. In matching, we propose a one-to-one symmetric matching (OOS) algorithm which is found to be highly reliable for NDK identification, due to its
more » ... ty in excluding false LIP matches compared with other matching strategies. For rapid filtering, we address two issues: speed efficiency and search effectiveness, to support OOS with a new index structure called LIP-IS. By exploring the properties of PCA-SIFT, the filtering capability and speed of LIP-IS are asymptotically estimated and compared to locality sensitive hashing (LSH). Owing to the robustness consideration, the matching of LIPs across keyframes forms vivid patterns that are utilized for discriminative learning and detection with support vector machines. Experimental results on TRECVID-2003 corpus show that our proposed approach outperforms other popular methods including the techniques with LSH in terms of retrieval and detection effectiveness. In addition, the proposed LIP-IS successfully speeds up OOS for more than 10 times and possesses several favorable properties compared to LSH.
doi:10.1109/tmm.2007.898928 fatcat:6qoj5vmi6bechnod5tvbn6stom