Storage capacity of ultrametric committee machines

J P Neirotti
2014 Journal of Physics A: Mathematical and Theoretical  
The problem of computing the storage capacity of a feed-forward network, with L hidden layers, N inputs, and K units in the first hidden layer, is analyzed using techniques from statistical mechanics. We found that the storage capacity strongly depends on the network architectureα c ∼ (log K) 1−1/2 L and that the number of units K limits the number of possible hidden layers L through the relationship 2 L − 1 < 2 log K.
doi:10.1088/1751-8113/47/6/065002 fatcat:uyawkkzjjzdp3nl44ezxwg44sm