G-maximization: an unsupervised learning procedure for discovering regularities

Barak A. Pearlmutter, Geoffrey E. Hinton
1986 AIP Conference Proceedings  
A bst ract Hill climbing is used to maximize an information theoretic measure of the difference between the actual behavior of a unit and the behavior that would be predicted by a statistician who knew the first order statistics of the inputs but believed them to be independent. This causes the unit to detect higher order correlations among its inputs. Initial simulations are presented, and seem encouraging. We describe an extension of the basic idea which makes it resemble competitive learning
more » ... ompetitive learning and which causes members of a population of these units to differentiate, each extracting different structure from the input.
doi:10.1063/1.36234 fatcat:v7icwvcmofeljjpk3qet66iutm