An Integrated Framework for Two-pass Personalized Voice Trigger [article]

Dexin Liao, Jing Li, Yiming Zhi, Song Li, Qingyang Hong, Lin Li
2021 arXiv   pre-print
In this paper, we present the XMUSPEECH system for Task 1 of 2020 Personalized Voice Trigger Challenge (PVTC2020). Task 1 is a joint wake-up word detection with speaker verification on close talking data. The whole system consists of a keyword spotting (KWS) sub-system and a speaker verification (SV) sub-system. For the KWS system, we applied a Temporal Depthwise Separable Convolution Residual Network (TDSC-ResNet) to improve the system's performance. For the SV system, we proposed a multi-task
more » ... learning network, where phonetic branch is trained with the character label of the utterance, and speaker branch is trained with the label of the speaker. Phonetic branch is optimized with connectionist temporal classification (CTC) loss, which is treated as an auxiliary module for speaker branch. Experiments show that our system gets significant improvements compared with baseline system.
arXiv:2106.15950v1 fatcat:lddjye4qf5gylnw7tvjr7534rq