On-the-Fly Aligned Data Augmentation for Sequence-to-Sequence ASR [article]

Tsz Kin Lam, Mayumi Ohta, Shigehiko Schamoni, Stefan Riezler
<span title="2021-06-09">2021</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
We propose an on-the-fly data augmentation method for automatic speech recognition (ASR) that uses alignment information to generate effective training samples. Our method, called Aligned Data Augmentation (ADA) for ASR, replaces transcribed tokens and the speech representations in an aligned manner to generate previously unseen training pairs. The speech representations are sampled from an audio dictionary that has been extracted from the training corpus and inject speaker variations into the
more &raquo; ... raining examples. The transcribed tokens are either predicted by a language model such that the augmented data pairs are semantically close to the original data, or randomly sampled. Both strategies result in training pairs that improve robustness in ASR training. Our experiments on a Seq-to-Seq architecture show that ADA can be applied on top of SpecAugment, and achieves about 9-23% and 4-15% relative improvements in WER over SpecAugment alone on LibriSpeech 100h and LibriSpeech 960h test datasets, respectively.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2104.01393v2">arXiv:2104.01393v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/yzx6szt3dnabtif2sfa5b7blvu">fatcat:yzx6szt3dnabtif2sfa5b7blvu</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210612130254/https://arxiv.org/pdf/2104.01393v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/cf/d7/cfd7f6e375796ecc50c85cbf3e317cbb0d23a157.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2104.01393v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>