Coarse-to-Fine Searching for Efficient Generative Adversarial Networks [article]

Jiahao Wang, Han Shu, Weihao Xia, Yujiu Yang, Yunhe Wang
<span title="2021-04-19">2021</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
This paper studies the neural architecture search (NAS) problem for developing efficient generator networks. Compared with deep models for visual recognition tasks, generative adversarial network (GAN) are usually designed to conduct various complex image generation. We first discover an intact search space of generator networks including three dimensionalities, i.e., path, operator, channel for fully excavating the network performance. To reduce the huge search cost, we explore a
more &raquo; ... search strategy which divides the overall search process into three sub-optimization problems accordingly. In addition, a fair supernet training approach is utilized to ensure that all sub-networks can be updated fairly and stably. Experiments results on benchmarks show that we can provide generator networks with better image quality and lower computational costs over the state-of-the-art methods. For example, with our method, it takes only about 8 GPU hours on the entire edges-to-shoes dataset to get a 2.56 MB model with a 24.13 FID score and 10 GPU hours on the entire Urban100 dataset to get a 1.49 MB model with a 24.94 PSNR score.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2104.09223v1">arXiv:2104.09223v1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/u3t62uvt7nhopipjeo2vfu24ty">fatcat:u3t62uvt7nhopipjeo2vfu24ty</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210421035856/https://arxiv.org/pdf/2104.09223v1.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/29/7d/297dfac9dae99559415638622eaa43a5ba1c5072.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2104.09223v1" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>