On-the-fly audio source separation

Dalia El Badawy, Ngoc Q. K. Duong, Alexey Ozerov
2014 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP)  
This paper addresses the challenging task of single channel audio source separation. We introduce a novel concept of onthe-fly audio source separation which greatly simplifies the user's interaction with the system compared to the state-ofthe-art user-guided approaches. In the proposed framework, the user is only asked to listen to an audio mixture and type some keywords (e.g. "dog barking", "wind", etc.) describing the sound sources to be separated. These keywords are then used as text queries
more » ... to search for audio examples from the internet to guide the separation process. In particular, we propose several approaches to efficiently exploit these retrieved examples, including an approach based on a generic spectral model with group sparsity-inducing constraints. Finally, we demonstrate the effectiveness of the proposed framework with mixtures containing various types of sounds. Index Terms-On-the-fly source separation, user-guided, non-negative matrix factorization, group sparsity, universal spectral model.
doi:10.1109/mlsp.2014.6958922 dblp:conf/mlsp/BadawyDO14 fatcat:buz5a2kox5bjtg7vkmu7pkqq5y