Group Equivariant Capsule Networks [article]

Jan Eric Lenssen, Matthias Fey, Pascal Libuschewski
<span title="2018-10-24">2018</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
We present group equivariant capsule networks, a framework to introduce guaranteed equivariance and invariance properties to the capsule network idea. Our work can be divided into two contributions. First, we present a generic routing by agreement algorithm defined on elements of a group and prove that equivariance of output pose vectors, as well as invariance of output activations, hold under certain conditions. Second, we connect the resulting equivariant capsule networks with work from the
more &raquo; ... eld of group convolutional networks. Through this connection, we provide intuitions of how both methods relate and are able to combine the strengths of both approaches in one deep neural network architecture. The resulting framework allows sparse evaluation of the group convolution operator, provides control over specific equivariance and invariance properties, and can use routing by agreement instead of pooling operations. In addition, it is able to provide interpretable and equivariant representation vectors as output capsules, which disentangle evidence of object existence from its pose.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1806.05086v2">arXiv:1806.05086v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/wyruvr45frbrpnypxpbmzosjyq">fatcat:wyruvr45frbrpnypxpbmzosjyq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200824201206/https://arxiv.org/pdf/1806.05086v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/64/6d/646d02f51a394ef961ef85050c5877171fb24aeb.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1806.05086v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>