Flexible Manifold Embedding: A Framework for Semi-Supervised and Unsupervised Dimension Reduction

Feiping Nie, Dong Xu, Ivor Wai-Hung Tsang, Changshui Zhang
2010 IEEE Transactions on Image Processing  
We propose a unified manifold learning framework for semi-supervised and unsupervised dimension reduction by employing a simple but effective linear regression function to map the new data points. For semi-supervised dimension reduction, we aim to find the optimal prediction labels for all the training samples , the linear regression function ( ) and the regression residue 0 = ( ) simultaneously. Our new objective function integrates two terms related to label fitness and manifold smoothness as
more » ... well as a flexible penalty term defined on the residue 0 . Our Semi-Supervised learning framework, referred to as flexible manifold embedding (FME), can effectively utilize label information from labeled data as well as a manifold structure from both labeled and unlabeled data. By modeling the mismatch between ( ) and , we show that FME relaxes the hard linear constraint = ( ) in manifold regularization (MR), making it better cope with the data sampled from a nonlinear manifold. In addition, we propose a simplified version (referred to as FME/U) for unsupervised dimension reduction. We also show that our proposed framework provides a unified view to explain and understand many semi-supervised, supervised and unsupervised dimension reduction techniques. Comprehensive experiments on several benchmark databases demonstrate the significant improvement over existing dimension reduction algorithms.
doi:10.1109/tip.2010.2044958 pmid:20215078 fatcat:bsf6sdcn35fotdbftotjb3ju54