Rule extraction using a novel gradient-based method and data dimensionality reduction

Xiuju Fu, Lipo Wang
Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290)  
Data dimensionality reduction is one of the preprocessing procedures carried out before inputting patterns to classifiers. In many cases, irrelevant or redundant attributes are included in data sets, which interfere with knowledge discovery from data sets. In this paper, we propose a novel gradientbased rule-extraction method with a separabilitycorrelation measure (SCM) ranking the importance of attributes. According to the attribute ranking results, the attribute subsets which lead to the best
more » ... classification results are selected and used as inputs to a classifier, such as an RBF neural network in our paper. The complexity of the classifier can thus be reduced and its classification performance improved. Our method uses the classification results with reduced attribute sets to extract rules. Computer simulations show that our method leads to smaller rule sets with higher accuracies compared with other methods.
doi:10.1109/ijcnn.2002.1007678 fatcat:luygxptye5fllm7s7nsi6zzocm