[Invited papers] Supervised Nonparametric Multimodal Topic Models for Multi-class Video Classification

Jianfei Xue, Koji Eguchi
2019 ITE Transactions on Media Technology and Applications  
Nonparametric topic models such as hierarchical Dirichlet processes (HDP) have been attracting more and more attentions for multimedia data analysis. However, the existing models for multimedia data are unsupervised ones that purely cluster semantically or characteristically related features into a specific latent topic without considering side information such as class information. In this paper, we present a novel supervised sequential symmetric correspondence HDP (Sup-SSC-HDP) model for
more » ... -class video classification, where the empirical topic frequencies learned from multimodal video data are modeled as a predictor of video class. Qualitative and quantitative assessments demonstrate the effectiveness of Sup-SSC-HDP.
doi:10.3169/mta.7.80 fatcat:fe6wbherr5a6tc5m4ww2nvnlyu