Using kNN Model for Automatic Feature Selection [chapter]

Gongde Guo, Daniel Neagu, Mark T. D. Cronin
2005 Lecture Notes in Computer Science  
This paper proposes a kNN model-based feature selection method aimed at improving the efficiency and effectiveness of the ReliefF method by: (1) using a kNN model as the starter selection, aimed at choosing a set of more meaningful representatives to replace the original data for feature selection; (2) integration of the Heterogeneous Value Difference Metric to handle heterogeneous applications -those with both ordinal and nominal features; and (3) presenting a simple method of difference
more » ... on calculation based on inductive information in each representative obtained by kNN model. We have evaluated the performance of the proposed kNN model-based feature selection method on toxicity dataset Phenols with two different endpoints. Experimental results indicate that the proposed feature selection method has a significant improvement in the classification accuracy for the trial dataset.
doi:10.1007/11551188_44 fatcat:fb6cbh3l6fg43faxnlx432h74m