Multifractality and percolation in the coupling space of perceptrons

M. Weigt, A. Engel
1997 Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics  
The coupling space of perceptrons with continuous as well as with binary weights gets partitioned into a disordered multifractal by a set of p=γ N random input patterns. The multifractal spectrum f(α) can be calculated analytically using the replica formalism. The storage capacity and the generalization behaviour of the perceptron are shown to be related to properties of f(α) which are correctly described within the replica symmetric ansatz. Replica symmetry breaking is interpreted
more » ... as a transition from percolating to non-percolating cells. The existence of empty cells gives rise to singularities in the multifractal spectrum. The analytical results for binary couplings are corroborated by numerical studies.
doi:10.1103/physreve.55.4552 fatcat:wfhnqa2f45eidfwdox5csgzmda