Deep Residual Network with Subclass Discriminant Analysis for Crowd Behavior Recognition

Bappaditya Mandal, Jiri Fajtl, Vasileios Argyriou, Dorothy Monekosso, Paolo Remagnino
2018 2018 25th IEEE International Conference on Image Processing (ICIP)  
In this work, we extract rich representations of crowd behavior from video using a fine-tuned deep convolutional neural residual network. Using spatial partitioning trees we create subclasses within the feature maps from each of the crowd behavior attributes (classes). Features from these subclasses are then regularized using an eigen modeling scheme. This enables to model the variance appearing from the intra-subclass information. Low dimensional discriminative features are extracted after
more » ... g the total subclass scatter information. Dynamic time warping is used on the cosine distance measure to find the similarity measure between videos. A 1-nearest neighbor (NN) classifier is used to find the respective crowd behavior attribute classes from the normal videos. Experimental results on large crowd behavior video database show the superior performance of our proposed framework as compared to the baseline and current state-of-the-art methodologies for the crowd behavior recognition task. Index Terms-Crowd behavior recognition, feature extraction, discriminant analysis, residual network.
doi:10.1109/icip.2018.8451190 dblp:conf/icip/MandalFAMR18 fatcat:stmok6yslzcw3a3im6sodovjzy