End-to-End Music Source Separation: Is it Possible in the Waveform Domain?

Francesc Lluís, Jordi Pons, Xavier Serra
2019 Interspeech 2019  
Most of the currently successful source separation techniques use the magnitude spectrogram as input, and are therefore by default omitting part of the signal: the phase. To avoid omitting potentially useful information, we study the viability of using end-to-end models for music source separation -which take into account all the information available in the raw audio signal, including the phase. Although during the last decades end-to-end music source separation has been considered almost
more » ... ainable, our results confirm that waveform-based models can perform similarly (if not better) than a spectrogram-based deep learning model. Namely: a Wavenet-based model we propose and Wave-U-Net can outperform DeepConvSep, a recent spectrogram-based deep learning model.
doi:10.21437/interspeech.2019-1177 dblp:conf/interspeech/LluisPS19 fatcat:y7a6jn6ftjaxvjonjhkt7zi7ye