Combining Per-frame and Per-track Cues for Multi-person Action Recognition [chapter]

Sameh Khamis, Vlad I. Morariu, Larry S. Davis
2012 Lecture Notes in Computer Science  
We propose a model to combine per-frame and per-track cues for action recognition. With multiple targets in a scene, our model simultaneously captures the natural harmony of an individual's action in a scene and the flow of actions of an individual in a video sequence, inferring valid tracks in the process. Our motivation is based on the unlikely discordance of an action in a structured scene, both at the track level and the frame level (e.g., a person dancing in a crowd of joggers). While we
more » ... n utilize sampling approaches for inference in our model, we instead devise a global inference algorithm by decomposing the problem and solving the subproblems exactly and efficiently, recovering a globally optimal joint solution in several cases. Finally, we improve on the stateof-the-art action recognition results for two publicly available datasets.
doi:10.1007/978-3-642-33718-5_9 fatcat:hji47lhygfbgvdymul2pv4fuui