On monoaural speech enhancement for automatic recognition of real noisy speech using mixture invariant training [article]

Jisi Zhang, Catalin Zorila, Rama Doddipatla, Jon Barker
<span title="2022-05-03">2022</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
In this paper, we explore an improved framework to train a monoaural neural enhancement model for robust speech recognition. The designed training framework extends the existing mixture invariant training criterion to exploit both unpaired clean speech and real noisy data. It is found that the unpaired clean speech is crucial to improve quality of separated speech from real noisy speech. The proposed method also performs remixing of processed and unprocessed signals to alleviate the processing
more &raquo; ... rtifacts. Experiments on the single-channel CHiME-3 real test sets show that the proposed method improves significantly in terms of speech recognition performance over the enhancement system trained either on the mismatched simulated data in a supervised fashion or on the matched real data in an unsupervised fashion. Between 16% and 39% relative WER reduction has been achieved by the proposed system compared to the unprocessed signal using end-to-end and hybrid acoustic models without retraining on distorted data.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2205.01751v1">arXiv:2205.01751v1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/ekpcd3bxxff23fvpvx2mym34fa">fatcat:ekpcd3bxxff23fvpvx2mym34fa</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20220506091248/https://arxiv.org/pdf/2205.01751v1.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/b5/04/b504d0f498beab581c4dc2a3047dae454132ab28.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2205.01751v1" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>