Human action segmentation with hierarchical supervoxel consistency

Jiasen Lu, Ran Xu, Jason J. Corso
2015 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)  
Detailed analysis of human action, such as action classification, detection and localization has received increasing attention from the community; datasets like JHMDB have made it plausible to conduct studies analyzing the impact that such deeper information has on the greater action understanding problem. However, detailed automatic segmentation of human action has comparatively been unexplored. In this paper, we take a step in that direction and propose a hierarchical MRF model to bridge
more » ... evel video fragments with high-level human motion and appearance; novel higher-order potentials connect different levels of the supervoxel hierarchy to enforce the consistency of the human segmentation by pulling from different segment-scales. Our single layer model significantly outperforms the current state-of-the-art on actionness, and our full model improves upon the single layer baselines in action segmentation.
doi:10.1109/cvpr.2015.7299000 dblp:conf/cvpr/LuXC15 fatcat:slg3lhiiabeubdk6rky52zv6ha