News video classification using SVM-based multimodal classifiers and combination strategies

Wei-Hao Lin, Alexander Hauptmann
2002 Proceedings of the tenth ACM international conference on Multimedia - MULTIMEDIA '02  
Video classification is the first step toward multimedia content understanding. When video is classified into conceptual categories, it is usually desirable to combine evidence from multiple modalities. However, combination strategies in previous studies were usually ad hoc. We investigate a meta-classification combination strategy using Support Vector Machine, and compare it with probability-based strategies. Text features from closedcaptions and visual features from images are combined to
more » ... are combined to classify broadcast news video. The experimental results show that combining multimodal classifiers can significantly improve recall and precision, and our meta-classification strategy gives better precision than the approach of taking the product of the posterior probabilities.
doi:10.1145/641043.641075 fatcat:l5fihxt2kfe5najlrj3oyfffku