Large scale feature selection using modified random mutation hill climbing

M.E. Farmer, S. Bapna, A.K. Jain
2004 Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004.  
Feature selection is a critical component of many pattern recognition applications. There are two distinct mechanisms for feature selection, namely the wrapper method and the filter methods. The filter methods are generally considered inferior to the wrapper methods since the wrapper methods directly integrate the classifier to be used, and because most filter methods do not directly address feature correlation. Wrapper methods are, however, computationally more demanding than filter methods.
more » ... n filter methods. One of the popular methods for wrapper-based feature selection is random mutation hill climbing. It performs a random search over the feature space to derive the optimal set of features. We will describe two enhancements to this algorithm, one that will improve its convergence time and the other that will allow us to bias the results towards either higher accuracy or lower feature count. We will apply the algorithm to a real-world massive-scale feature selection problem involving the image classification problem associated with suppressing airbags for children. We will provide classification results on an image database of nearly 4,000 images that indicate the advantages of the proposed method.
doi:10.1109/icpr.2004.1334169 dblp:conf/icpr/FarmerBJ04 fatcat:aemby5pfwbdmpadl4bvsusq7xq