Timing-Based Local Descriptor for Dynamic Surfaces

Tony Tung, Takashi Matsuyama
2014 2014 IEEE Conference on Computer Vision and Pattern Recognition  
In this paper, we present the first local descriptor designed for dynamic surfaces. A dynamic surface is a surface that can undergo non-rigid deformation (e.g., human body surface). Using state-of-the-art technology, details on dynamic surfaces such as cloth wrinkle or facial expression can be accurately reconstructed. Hence, various results (e.g., surface rigidity, or elasticity) could be derived by microscopic categorization of surface elements. We propose a timing-based descriptor to model
more » ... cal spatiotemporal variations of surface intrinsic properties. The lowlevel descriptor encodes gaps between local event dynamics of neighboring keypoints using timing structure of linear dynamical systems (LDS). We also introduce the bagof-timings (BoT) paradigm for surface dynamics characterization. Experiments are performed on synthesized and real-world datasets. We show the proposed descriptor can be used for challenging dynamic surface classification and segmentation with respect to rigidity at surface keypoints.
doi:10.1109/cvpr.2014.60 dblp:conf/cvpr/TungM14 fatcat:ioynxt7hkzabra2bk72ijvv2ve