Multitask Linear Discriminant Analysis for View Invariant Action Recognition

Yan Yan, Elisa Ricci, Ramanathan Subramanian, Gaowen Liu, Nicu Sebe
2014 IEEE Transactions on Image Processing  
Robust action recognition under viewpoint changes has received considerable attention recently. To this end, self-similarity matrices (SSMs) have been found to be effective view-invariant action descriptors. To enhance the performance of SSM-based methods, we propose multitask linear discriminant analysis (LDA), a novel multitask learning framework for multiview action recognition that allows for the sharing of discriminative SSM features among different views (i.e., tasks). Inspired by the
more » ... ematical connection between multivariate linear regression and LDA, we model multitask multiclass LDA as a single optimization problem by choosing an appropriate class indicator matrix. In particular, we propose two variants of graphguided multitask LDA: 1) where the graph weights specifying view dependencies are fixed a priori and 2) where graph weights are flexibly learnt from the training data. We evaluate the proposed methods extensively on multiview RGB and RGBD video data sets, and experimental results confirm that the proposed approaches compare favorably with the state-of-the-art. Index Terms-Multi-view action recognition, self-similarity matrix, multi-task learning, linear discriminant analysis.
doi:10.1109/tip.2014.2365699 pmid:25361507 fatcat:cdh5pwnt2fhgrdfedcpbe6cksi