Unsupervised nonparametric density estimation: A neural network approach

Edmondo Trentin, Antonino Freno
2009 2009 International Joint Conference on Neural Networks  
One major problem in pattern recognition is estimating probability density functions. Unfortunately, parametric techniques rely on an arbitrary assumption on the form of the underlying, unknown density function. On the other hand, nonparametric techniques, such as the popular kn-Nearest Neighbor (not to be confused with the k-Nearest Neighbor classification algorithm), allow to remove such an assumption. Albeit effective, the kn-Nearest Neighbor is affected by a number of limitations.
more » ... neural networks are, in principle, an alternative family of nonparametric models. So far, artificial neural networks have been extensively used to estimate probabilities (e.g., class-posterior probabilities). However, they have not been exploited to estimate instead probability density functions. This paper introduces a simple, neuralbased algorithm for unsupervised, nonparametric estimation of multivariate densities, relying on the kn-Nearest Neighbor technique. This approach overcomes the limitations of kn-Nearest Neighbor, possibly improving the estimation accuracy of the resulting pdf models. An experimental investigation of the algorithm behavior is offered, exploiting random samples drawn from a mixture of Fisher-Tippett density functions.
doi:10.1109/ijcnn.2009.5179010 dblp:conf/ijcnn/TrentinF09 fatcat:f6gvsc44arhp5hrn5k56xeklo4