Structured Streaming Skeleton -- A New Feature for Online Human Gesture Recognition

Xin Zhao, Xue Li, Chaoyi Pang, Quan Z. Sheng, Sen Wang, Mao Ye
2014 ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)  
Online human gesture recognition has a wide range of applications in computer vision, especially in humancomputer interaction applications. The recent introduction of cost-effective depth cameras brings a new trend of research on body-movement gesture recognition. However, there are two major challenges: (i) how to continuously detect gestures from unsegmented streams, and (ii) how to differentiate different styles of the same gesture from other types of gestures. In this article, we solve
more » ... two problems with a new effective and efficient feature extraction method-Structured Streaming Skeleton (SSS)-which uses a dynamic matching approach to construct a feature vector for each frame. Our comprehensive experiments on MSRC-12 Kinect Gesture, Huawei/3DLife-2013, and MSR-Action3D datasets have demonstrated superior performances than the state-of-the-art approaches. We also demonstrate model selection based on the proposed SSS feature, where the classifier of squared loss regression with l 2,1 norm regularization is a recommended classifier for best performance. . 2014. Structured Streaming Skeleton -A new feature for online human gesture recognition. ACM Trans. Multimedia Comput. Commun.
doi:10.1145/2648583 fatcat:2libmjmk4racjfr4eldtnvjy6y