Activity recognition by learning structural and pairwise mid-level features using random forest

Jie Hu, Yu Kong, Yun Fu
2013 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)  
This paper presents a novel random forest based method to build mid-level features describing spatial and tem poral structure information for activity recognition. Our model consists of two separate parts, spatial part and temporal part, which are employed to capture the distinctive characteristics in spatial and temporal domains of activity analysis. In the spatial part, densely sampled low level features are passed through the first level random forest and concatenated structurally to form
more » ... tial mid-level features. In the temporal part, we use results from the first level random forest on sparsely sampled interest points to build pairwise mid-level features. The second level random forests operate on all the mid-level features and compute scores for these two parts. Then final recognition is based on the weighted sum of these two parts. Our method smoothly fuses both spatial and temporal information and builds more descriptive models, which can better represent human activities in large variations. Experimental results show that our method achieves promising performance on three available action and facial expression datasets.
doi:10.1109/fg.2013.6553706 dblp:conf/fgr/HuKF13 fatcat:fifvvznno5hwxmvaa4r2gakocu