Single channel speech music separation using nonnegative matrix factorization and spectral masks

Emad M. Grais, Hakan Erdogan
2011 2011 17th International Conference on Digital Signal Processing (DSP)  
A single channel speech-music separation algorithm based on nonnegative matrix factorization (NMF) with spectral masks is proposed in this work. The proposed algorithm uses training data of speech and music signals with nonnegative matrix factorization followed by masking to separate the mixed signal. In the training stage, NMF uses the training data to train a set of basis vectors for each source. These bases are trained using NMF in the magnitude spectrum domain. After observing the mixed
more » ... al, NMF is used to decompose its magnitude spectra into a linear combination of the trained bases for both sources. The decomposition results are used to build a mask, which explains the contribution of each source in the mixed signal. Experimental results show that using masks after NMF improves the separation process even when calculating NMF with fewer iterations, which yields a faster separation process. Index Terms-Source separation, single channel source separation, semi-blind source separation, speech music separation, speech processing, nonnegative matrix factorization, and Wiener filter.
doi:10.1109/icdsp.2011.6004924 fatcat:ghkkqhpps5fefixodba52hn7ra