Multi-Scale Locality-Constrained Spatiotemporal Coding for Local Feature Based Human Action Recognition

Bin Wang, Yu Liu, Wei Wang, Wei Xu, Maojun Zhang
2013 The Scientific World Journal  
We propose a Multiscale Locality-Constrained Spatiotemporal Coding (MLSC) method to improve the traditional bag of features (BoF) algorithm which ignores the spatiotemporal relationship of local features for human action recognition in video. To model this spatiotemporal relationship, MLSC involves the spatiotemporal position of local feature into feature coding processing. It projects local features into a sub space-time-volume (sub-STV) and encodes them with a locality-constrained linear
more » ... g. A group of sub-STV features obtained from one video with MLSC and max-pooling are used to classify this video. In classification stage, the Locality-Constrained Group Sparse Representation (LGSR) is adopted to utilize the intrinsic group information of these sub-STV features. The experimental results on KTH, Weizmann, and UCF sports datasets show that our method achieves better performance than the competing local spatiotemporal feature-based human action recognition methods.
doi:10.1155/2013/405645 pmid:24194681 pmcid:PMC3806242 fatcat:3g2upm6ovfeh3djvomp4r6r2be