Exploring Fisher vector and deep networks for action spotting

Zhe Wang, Limin Wang, Wenbin Du, Yu Qiao
2015 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)  
This paper describes our method and attempt on track 2 at the ChaLearn Looking at People (LAP) challenge 2015. Our approach utilizes Fisher vector and iDT features for action spotting, and improve its performance from two aspects: (i) We take account of interaction labels into the training process; (ii) By visualizing our results on validation set, we find that our previous method [10] is weak in detecting action class 2, and improve it by introducing multiple thresholds. Moreover, we exploit
more » ... ep neural networks to extract both appearance and motion representation for this task. However, our current deep network fails to yield better performance than our Fisher vector based approach and may need further exploration. For this reason, we submit the results obtained by our Fisher vector approach which achieves a Jaccard Index of 0.5385 and ranks the 1 st place in track 2.
doi:10.1109/cvprw.2015.7301330 dblp:conf/cvpr/WangWD015 fatcat:5c7akoaambajfppowkaz7viaaa