Deep Speaker Embedding with Long Short Term Centroid Learning for Text-Independent Speaker Verification

Junyi Peng, Rongzhi Gu, Yuexian Zou
<span title="2020-10-25">2020</span> <i title="ISCA"> <a target="_blank" rel="noopener" href="" style="color: black;">Interspeech 2020</a> </i> &nbsp;
Recently, speaker verification systems using deep neural networks have shown their effectiveness on large scale datasets. The widely used pairwise loss functions only consider the discrimination within a mini-batch data (short-term), while either the speaker identity information or the whole training dataset is not fully exploited. Thus, these pairwise comparisons may suffer from the interferences and variances brought by speakerunrelated factors. To tackle this problem, we introduce the
more &raquo; ... identity information to form long-term speaker embedding centroids, which are determined by all the speakers in the training set. During the training process, each centroid dynamically accumulates the statistics of all samples belonging to a specific speaker. Since the long-term speaker embedding centroids are associated with a wide range of training samples, these centroids have the potential to be more robust and discriminative. Finally, these centroids are employed to construct a loss function, named long short term speaker loss (LSTSL). The proposed LSTSL constrains that the distances between samples and centroid from the same speaker are compact while those from different speakers are dispersed. Experiments are conducted on VoxCeleb1 and VoxCeleb2. Results on the VoxCeleb1 dataset demonstrate the effectiveness of our proposed LSTSL.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="">doi:10.21437/interspeech.2020-2470</a> <a target="_blank" rel="external noopener" href="">dblp:conf/interspeech/PengGZ20</a> <a target="_blank" rel="external noopener" href="">fatcat:s6sq6ix3zjbe7hhr2xsfcjt5fy</a> </span>
<a target="_blank" rel="noopener" href="" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href=""> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / </button> </a>