Utilization of Huge Written Text Corpora for Conversational Speech Recognition

Xinhui Hu, Hirofumi Yamamoto, Jinsong Zhang, Keiji Yasuda, Youzheng Wu, Hideki Kashioka
2008 2008 6th International Symposium on Chinese Spoken Language Processing  
In this paper, we propose a new sentence selection method using large written text corpora to augment the language model of conversational speech recognition in order to resolve the insufficiency of in-domain training data coverage in conversational speech recognition. In the proposed method, the large written text corpora are clustered by an entropybased method. Clusters similar to the target development set are selected automatically. Next, utterances are selected and mixed with the original
more » ... onversational training corpus, and language models for conversational speech recognition are built. In our experiments, a different speech style test set that is not covered by original conversational training data is used for evaluation. The perplexity of the test set was reduced from 249.6 to 210.8, and the word recognition accuracy was improved by approximately 5% by using our method.
doi:10.1109/chinsl.2008.ecp.36 dblp:conf/iscslp/HuYZYWK08 fatcat:blv5hb35rnfzzml5erksfcqm4u