RNN-based speech synthesis using a continuous sinusoidal model [article]

Mohammed Salah Al-Radhi, Tamás Gábor Csapó, Géza Németh
<span title="2019-04-12">2019</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
Recently in statistical parametric speech synthesis, we proposed a continuous sinusoidal model (CSM) using continuous F0 (contF0) in combination with Maximum Voiced Frequency (MVF), which was successfully giving state-of-the-art vocoders performance (e.g. similar to STRAIGHT) in synthesized speech. In this paper, we address the use of sequence-to-sequence modeling with recurrent neural networks (RNNs). Bidirectional long short-term memory (Bi-LSTM) is investigated and applied using our CSM to
more &raquo; ... del contF0, MVF, and Mel-Generalized Cepstrum (MGC) for more natural sounding synthesized speech. For refining the output of the contF0 estimation, post-processing based on time-warping approach is applied to reduce the unwanted voiced component of the unvoiced speech sounds, resulting in an enhanced contF0 track. The overall conclusion is covered by objective evaluation and subjective listening test, showing that the proposed framework provides satisfactory results in terms of naturalness and intelligibility, and is comparable to the high-quality WORLD model based RNNs.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1904.06075v1">arXiv:1904.06075v1</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/j4mexgz4gvg4ffgeyvauooygp4">fatcat:j4mexgz4gvg4ffgeyvauooygp4</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20191020102717/https://arxiv.org/pdf/1904.06075v1.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/2a/42/2a42d46e5a6731971b8d3c90f7dc2fe3d17a8b7d.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1904.06075v1" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>