Reducing Artificial Neural Network Complexity: A Case Study on Exoplanet Detection [article]

Sebastiaan Koning, Caspar Greeven, Eric Postma
<span title="2019-02-27">2019</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
Despite their successes in the field of self-learning AI, Convolutional Neural Networks (CNNs) suffer from having too many trainable parameters, impacting computational performance. Several approaches have been proposed to reduce the number of parameters in the visual domain, the Inception architecture [Szegedy et al., 2016] being a prominent example. This raises the question whether the number of trainable parameters in CNNs can also be reduced for 1D inputs, such as time-series data, without
more &raquo; ... ncurring a substantial loss in classification performance. We propose and examine two methods for complexity reduction in AstroNet [Shallue & Vanderburg, 2018], a CNN for automatic classification of time-varying brightness data of stars to detect exoplanets. The first method makes only a tactical reduction of layers in AstroNet while the second method also modifies the original input data by means of a Gaussian pyramid. We conducted our experiments with various degrees of dropout regularization. Our results show only a non-substantial loss in accuracy compared to the original AstroNet, while reducing training time up to 85 percent. These results show potential for similar reductions in other CNN applications while largely retaining accuracy.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1902.10385v1">arXiv:1902.10385v1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/ivqqnnqx3nftzohbcztmaf22bq">fatcat:ivqqnnqx3nftzohbcztmaf22bq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200825193105/https://arxiv.org/ftp/arxiv/papers/1902/1902.10385.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/e9/c7/e9c73c939ef757790f25f757e6efc9214c52b977.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1902.10385v1" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>