Online Multikernel Learning Based on a Triple-Norm Regularizer for Semantic Image Classification

Shuangping Huang, Lianwen Jin, Yunyu Li
2015 Mathematical Problems in Engineering  
Currently image classifiers based on multikernel learning (MKL) mostly use batch approach, which is slow and difficult to scale up for large datasets. In the meantime, standard MKL model neglects the correlations among examples associated with a specific kernel, which makes it infeasible to adjust the kernel combination coefficients. To address these issues, a new and efficient multikernel multiclass algorithm called TripleReg-MKL is proposed in this work. Taking the principle of strong convex
more » ... ptimization into consideration, we propose a new triple-norm regularizer (TripleReg) to constrain the empirical loss objective function, which exploits the correlations among examples to tune the kernel weights. It highlights the application of multivariate hinge loss and a conservative updating strategy to filter noisy samples, thereby reducing the model complexity. This novel MKL formulation is then solved in an online mode using a primal-dual framework. A theoretical analysis of the complexity and convergence of TripleReg-MKL is presented. It shows that the new algorithm has a complexity ofOCMTand achieves a fast convergence rate ofOlogT/T. Extensive experiments on four benchmark datasets demonstrate the effectiveness and robustness of this new approach.
doi:10.1155/2015/346496 fatcat:xu3ternfzbe5hpyqx65m4jbkam