Coupling weight elimination and genetic algorithms

G. Bebis, M. Georgiopoulos, T. Kaspalris
Proceedings of International Conference on Neural Networks (ICNN'96)  
Network size plays an important role in the generalization performance of a network. A number of approaches which try to determine an "appropriate" network size for a given problem have been developed during the last few years. Although it is usually demonstrated that such approaches are capable of finding small size networks that solve the problem at hand, it is quite remarkable that the generalization capabilities of these networks have not been thoroughly explored. In this paper, we have
more » ... idered the weight elimination technique and we propose a scheme where it is coupled with genetic algorithms. Our objective is not only to find smaller size networks that solve the problem at hand, by pruning larger size networks, but also to improve generalization. The innovation of our work relies 011 a fitness function which uses an adaptive parameter to encourage the reproduction of networks having good generalization performance and a relatively small size.
doi:10.1109/icnn.1996.549054 dblp:conf/icnn/BebisGK96 fatcat:3tuja7nzfjdylgpni3bthwrb2y