A deep learning based analysis-synthesis framework for unison singing

Pritish Chandna, Helena Cuesta, Emilia Gomez
<span title="2020-10-11">2020</span> <i title="Zenodo"> Zenodo </i> &nbsp;
Unison singing is the name given to an ensemble of singers simultaneously singing the same melody and lyrics. While each individual singer in a unison sings the same principle melody, there are slight timing and pitch deviations between the singers, which, along with the ensemble of timbres, give the listener a perceived sense of "unison". In this paper, we present a study of unison singing in the context of choirs; utilising some recently proposed deep-learning based methodologies, we analyse
more &raquo; ... he fundamental frequency (F0) distribution of the individual singers in recordings of unison mixtures. Based on the analysis, we propose a system for synthesising a unison signal from an a cappella input and a single voice prototype representative of a unison mixture. We use subjective listening test to evaluate perceptual factors of our proposed system for synthesis, including quality, adherence to the melody as well the degree of perceived unison.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.5281/zenodo.4245501">doi:10.5281/zenodo.4245501</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/s7hvb56ksjgpxaul3a6tjfj5du">fatcat:s7hvb56ksjgpxaul3a6tjfj5du</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20201106181022/https://zenodo.org/record/4245502/files/259.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/d5/b2/d5b28719d6e1bb5a007937974de27117667d185a.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.5281/zenodo.4245501"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> zenodo.org </button> </a>