Efficient feature selection method using contribution ratio by random forest

Ryuei Murata, Yohei Mishina, Yuji Yamauchi, Takayoshi Yamashita, Hironobu Fujiyoshi
2015 2015 21st Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV)  
In the field of image recognition, a high-dimensional feature vector is often used to construct a classifier. This presents a problem, however, since using a large number of features can slow down training and degrade model readability. To alleviate this problem, sequential backward selection (SBS) has come to be used as a method for selecting an effective number of features for classification. However, as a type of wrapper method, SBS iteratively constructs and evaluates classifiers when
more » ... ing features, which is computationally intensive. In this study, we define the contribution ratio of features by random forest and use it to create an efficient feature selection method. We performed an evaluation experiment to compare the proposed method with SBS and found that the former could significantly reduce feature selection time for the same dimension reduction rate.
doi:10.1109/fcv.2015.7103746 dblp:conf/fcv/MurataMYYF15 fatcat:sn7q3s22kraobd7i5avkas4bgu