Keypoint detection in RGBD images based on an efficient viewpoint-covariant multiscale representation

Maxim Karpushin, Giuseppe Valenzise, Frederic Dufaux
2016 2016 24th European Signal Processing Conference (EUSIPCO)  
Texture+depth (RGBD) images provide information about the geometry of a scene, which could help improve current image matching performance, e.g., in presence of large viewpoint changes. While depth has been mainly used for processing keypoint descriptors, in this paper we focus on the keypoint detection problem. In order to produce a computationally efficient viewpoint-covariant multiscale representation, we design an image smoothing procedure which locally smooths a texture image based on the
more » ... image based on the corresponding depth. This yields an approximated scale space, where we can find keypoints using a multiscale detector approach. Our experiments on both synthetic and real-world images show substantial gains with respect to 2D and other RGBD feature extraction approaches.
doi:10.1109/eusipco.2016.7760683 dblp:conf/eusipco/KarpushinVD16 fatcat:etprrkunmfgenb64jyfttnptsa