Genetic Programming of Heterogeneous Ensembles for Classification [chapter]

Hugo Jair Escalante, Niusvel Acosta-Mendoza, Alicia Morales-Reyes, Andrés Gago-Alonso
2013 Lecture Notes in Computer Science  
The ensemble classification paradigm is an effective way to improve the performance and stability of individual predictors. Many ways to build ensembles have been proposed so far, most notably bagging and boosting based techniques. Evolutionary algorithms (EAs) also have been widely used to generate ensembles. In the context of heterogeneous ensembles EAs have been successfully used to adjust weights of base classifiers or to select ensemble members. Usually, a weighted sum is used for
more » ... classifiers outputs in both classical and evolutionary approaches. This study proposes a novel genetic program that learns a fusion function for combining heterogeneous-classifiers outputs. It evolves a population of fusion functions in order to maximize the classification accuracy. Highly non-linear functions are obtained with the proposed method, subsuming the existing weighted-sum formulations. Experimental results show the effectiveness of the proposed approach, which can be used not only with heterogeneous classifiers but also with homogeneous-classifiers and under bagging/boosting based formulations.
doi:10.1007/978-3-642-41822-8_2 fatcat:s2pjq3ekjzdgvfshca6nscadgi