Evaluation of Performance Measures for SVR Hyperparameter Selection

Koen Smets, Brigitte Verdonk, Elsa M. Jordaan
2007 Neural Networks (IJCNN), International Joint Conference on  
To obtain accurate modeling results, it is of primal importance to find optimal values for the hyperparameters in the Support Vector Regression (SVR) model. In general, we search for those parameters that minimize an estimate of the generalization error. In this study, we empirically investigate different performance measures found in the literature: k-fold cross-validation, the computationally intensive, but almost unbiased leave-oneout error, its upper bounds -radius/margin and span bound -,
more » ... apnik's measure, which uses an estimate of the VC dimension, and the regularized risk functional itself. For each of the estimates we focus on accuracy, complexity and the presence of local minima. The latter significantly influences the applicability of gradient-based search techniques to determine the optimal parameters.
doi:10.1109/ijcnn.2007.4371031 dblp:conf/ijcnn/SmetsVJ07 fatcat:xvg4a7bdurgszdvszpx55nsu7e