Automated Model Selection (AMS) on Finite Mixtures: A Theoretical Analysis

Jinwen Ma
2006 The 2006 IEEE International Joint Conference on Neural Network Proceedings  
From the Bayesian Ying-Yang (BYY) harmony learning theory, a harmony function has been developed for finite mixtures with a novel property that its maximization can make model selection automatically during parameter learning. In this paper, we make a theoretical analysis on the harmony function and prove that the global maximization of the harmony function leads to the automated model selection property when there is no or weak overlap between the actual components in the sample data.
more » ... mple data. Moreover, it is proved that the estimates of the parameters through maximizing the harmony function are generally biased, but the deviation error is dominated by the average overlap measure between the actual components in the mixture. 0-7803-9490
doi:10.1109/ijcnn.2006.246961 dblp:conf/ijcnn/Ma06 fatcat:ia26isd7frardcw7oks4err3ja