Reliable accent specific unit generation with dynamic Gaussian mixture selection for multi-accent speech recognition

Chao Zhang, Yi Liu, Yunqing Xia, Thomas Fang Zheng, Jesper Olsen, JiLei Tian
2011 2011 IEEE International Conference on Multimedia and Expo  
Multiple accents are often present in Mandarin speech, as most Chinese have learned Mandarin as a second language. We propose generating reliable accent specific unit together with dynamic Gaussian mixture selection for multi-accent speech recognition. Time alignment phoneme recognition is used to generate such unit and to model accent variations explicitly and accurately. Dynamic Gaussian mixture selection scheme builds a dynamical observation density for each specified frame in decoding, and
more » ... eads to use Gaussian mixture component efficiently. This method increases the covering ability for a diversity of accent variations in multi-accent, and alleviates the performance degradation caused by pruned beam search without augmenting the model size. The effectiveness of this approach is evaluated on three typical Chinese accents Chuan, Yue and Wu. Our approach outperforms traditional acoustic model reconstruction approach significantly by 6.30%, 4.93% and 5.53%, respectively on Syllable Error Rate (SER) reduction, without degrading on standard speech.
doi:10.1109/icme.2011.6011941 dblp:conf/icmcs/ZhangLXZOT11 fatcat:2xap7g4pbrgcjh6dej6zgtvwxi