Unsupervised Representation Learning for Speaker Recognition via Contrastive Equilibrium Learning [article]

Sung Hwan Mun, Woo Hyun Kang, Min Hyun Han, Nam Soo Kim
<span title="2020-10-22">2020</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
In this paper, we propose a simple but powerful unsupervised learning method for speaker recognition, namely Contrastive Equilibrium Learning (CEL), which increases the uncertainty on nuisance factors latent in the embeddings by employing the uniformity loss. Also, to preserve speaker discriminability, a contrastive similarity loss function is used together. Experimental results showed that the proposed CEL significantly outperforms the state-of-the-art unsupervised speaker verification systems
more &raquo; ... and the best performing model achieved 8.01% and 4.01% EER on VoxCeleb1 and VOiCES evaluation sets, respectively. On top of that, the performance of the supervised speaker embedding networks trained with initial parameters pre-trained via CEL showed better performance than those trained with randomly initialized parameters.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2010.11433v1">arXiv:2010.11433v1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/nkhnvzz5vfcnhkvgh6vyrkarpe">fatcat:nkhnvzz5vfcnhkvgh6vyrkarpe</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20201024181406/https://arxiv.org/pdf/2010.11433v1.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/f6/7b/f67b1de637586ee024683c76d91fb6a7fad9de6f.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2010.11433v1" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>