Modified minimum classification error learning and its application to neural networks [chapter]

Hiroshi Shimodaira, Jun Rokui, Mitsuru Nakai
1998 Lecture Notes in Computer Science  
A novel method to improve the generalization performance of the Minimum Classification Error (MCE) / Generalized Probabilistic Descent (GPD) learning is proposed. The MCE/GPD learning proposed by Juang and Katagiri in 1992 results in better recognition performance than the maximum-likelihood (ML) based learning in various areas of pattern recognition. Despite its superiority in recognition performance, as well as other learning algorithms, it still suffers from the problem of "over-fitting" to
more » ... he training samples. In the present study, a regularization technique has been employed to the MCE learning to overcome this problem. Feed-forward neural networks are employed as a recognition platform to evaluate the recognition performance of the proposed method. Recognition experiments are conducted on several sorts of data sets.
doi:10.1007/bfb0033303 fatcat:55z26adtxjfqlh3dvapoq7o62a