Robust Ensembling Network for Unsupervised Domain Adaptation [article]

Han Sun, Lei Lin, Ningzhong Liu, Huiyu Zhou
<span title="2021-08-21">2021</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
Recently, in order to address the unsupervised domain adaptation (UDA) problem, extensive studies have been proposed to achieve transferrable models. Among them, the most prevalent method is adversarial domain adaptation, which can shorten the distance between the source domain and the target domain. Although adversarial learning is very effective, it still leads to the instability of the network and the drawbacks of confusing category information. In this paper, we propose a Robust Ensembling
more &raquo; ... etwork (REN) for UDA, which applies a robust time ensembling teacher network to learn global information for domain transfer. Specifically, REN mainly includes a teacher network and a student network, which performs standard domain adaptation training and updates weights of the teacher network. In addition, we also propose a dual-network conditional adversarial loss to improve the ability of the discriminator. Finally, for the purpose of improving the basic ability of the student network, we utilize the consistency constraint to balance the error between the student network and the teacher network. Extensive experimental results on several UDA datasets have demonstrated the effectiveness of our model by comparing with other state-of-the-art UDA algorithms.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2108.09473v1">arXiv:2108.09473v1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/a3p5u2lqirdj7nlosd34uzt5xi">fatcat:a3p5u2lqirdj7nlosd34uzt5xi</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210829115013/https://arxiv.org/pdf/2108.09473v1.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/39/ef/39efb108ee54a5504b44fc12ea7a799c6a1bba80.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2108.09473v1" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>