Dataset complexity can help to generate accurate ensembles of k-nearest neighbors

Oleg Okun, Giorgio Valentini
2008 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence)  
Gene expression based cancer classification using classifier ensembles is the main focus of this work. A new ensemble method is proposed that combines predictions of a small number of k-nearest neighbor (k-NN) classifiers with majority vote. Diversity of predictions is guaranteed by assigning a separate feature subset, randomly sampled from the original set of features, to each classifier. Accuracy of k-NNs is ensured by the statistically confirmed dependence between dataset complexity,
more » ... ing how difficult is a dataset for classification, and classification error. Experiments carried out on three gene expression datasets containing different types of cancer show that our ensemble method is superior to 1) a single best classifier in the ensemble, 2) the nearest shrunken centroids method originally proposed for gene expression data, and 3) the traditional ensemble construction scheme that does not take into account dataset complexity.
doi:10.1109/ijcnn.2008.4633831 dblp:conf/ijcnn/OkunV08 fatcat:mcttmo5inbcdbhibfchzhbhv3u