Phonetically-oriented word error alignment for speech recognition error analysis in speech translation

Nicholas Ruiz, Marcello Federico
<span title="">2015</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/nhsxk6diafcb5cix6v2tg7kcdu" style="color: black;">2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU)</a> </i> &nbsp;
We propose a variation to the commonly used Word Error Rate (WER) metric for speech recognition evaluation which incorporates the alignment of phonemes, in the absence of time boundary information. After computing the Levenshtein alignment on words in the reference and hypothesis transcripts, spans of adjacent errors are converted into phonemes with word and syllable boundaries and a phonetic Levenshtein alignment is performed. The aligned phonemes are recombined into aligned words that adjust
more &raquo; ... he word alignment labels in each error region. We demonstrate that our Phonetically-Oriented Word Error Rate (POWER) yields similar scores to WER with the added advantages of better word alignments and the ability to capture one-to-many word alignments corresponding to homophonic errors in speech recognition hypotheses. These improved alignments allow us to better trace the impact of Levenshtein error types on downstream tasks such as speech translation.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/asru.2015.7404808">doi:10.1109/asru.2015.7404808</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/asru/RuizF15.html">dblp:conf/asru/RuizF15</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/3j2xanruv5emrmzy3wlt7wsy24">fatcat:3j2xanruv5emrmzy3wlt7wsy24</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200828034044/https://arxiv.org/pdf/1904.11024v1.pdf" title="fulltext PDF download [not primary version]" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <span style="color: #f43e3e;">&#10033;</span> <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/c1/28/c1289f2a96e59c2c3df718d44b3e2184e7abd418.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/asru.2015.7404808"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>