Penalized least squares, model selection, convex hull classes and neural nets

Gerald H. L. Cheang, Andrew R. Barron
2001 The European Symposium on Artificial Neural Networks  
We d e v elop improved risk bounds for function estimation with models such as single hidden layer neural nets, using a penalized least squares criterion to select the size of the model. These results show the estimator achieves the best order of balance between approximation error and penalty relative to the sample size. Bounds are given both for the case that the target function is in the convex hull C of a class of functions of dimension d (determined through empirical l2 convering numbers)
more » ... nd for the case that the target is not in the convex hull.
dblp:conf/esann/CheangB01 fatcat:2e53mpdb3fbn5kzqkc6zfo6cci