Deep Narrow Boltzmann Machines are Universal Approximators [article]

Guido Montufar
<span title="2015-04-10">2015</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
We show that deep narrow Boltzmann machines are universal approximators of probability distributions on the activities of their visible units, provided they have sufficiently many hidden layers, each containing the same number of units as the visible layer. We show that, within certain parameter domains, deep Boltzmann machines can be studied as feedforward networks. We provide upper and lower bounds on the sufficient depth and width of universal approximators. These results settle various
more &raquo; ... tions regarding undirected networks and, in particular, they show that deep narrow Boltzmann machines are at least as compact universal approximators as narrow sigmoid belief networks and restricted Boltzmann machines, with respect to the currently available bounds for those models.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1411.3784v3">arXiv:1411.3784v3</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/evzdfnmd5femrdaxrpumzi5kba">fatcat:evzdfnmd5femrdaxrpumzi5kba</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200824154450/https://arxiv.org/pdf/1411.3784v3.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/4e/35/4e353081eb7242f94737de917f508d903b599e0d.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1411.3784v3" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>