Error Analysis of ERM Algorithm with Unbounded and Non-Identical Sampling

Weilin Nie, Cheng Wang
2016 Journal of Applied Mathematics and Physics  
A standard assumption in the literature of learning theory is the samples which are drawn independently from an identical distribution with a uniform bounded output. This excludes the common case with Gaussian distribution. In this paper we extend these assumptions to a general case. To be precise, samples are drawn from a sequence of unbounded and non-identical probability distributions. By drift error analysis and Bennett inequality for the unbounded random variables, we derive a satisfactory
more » ... rive a satisfactory learning rate for the ERM algorithm.
doi:10.4236/jamp.2016.41019 fatcat:gscb5v7lmvgdjlaq6tcsmypng4