Generating Expressive Summaries for Speech and Musical Audio using Self-Similarity Clues

Mustafa Sert, Buyurman Baykal, Adnan Yazici
2006 2006 IEEE International Conference on Multimedia and Expo  
We present a novel algorithm for structural analysis of audio to detect repetitive patterns that are suitable for content-based audio information retrieval systems, since repetitive patterns can provide valuable information about the content of audio, such as a chorus or a concept. The Audio Spectrum Flatness (ASF) feature of the MPEG-7 standard, although not having been considered as much as other feature types, has been utilized and evaluated as the underlying feature set. Expressive
more » ... are chosen as the longest patterns by the k-means clustering algorithm. Proposed approach is evaluated on a test bed consisting of popular song and speech clips based on the ASF feature. The well known Mel Frequency Cepstral Coefficients (MFCCs) are also considered in the experiments for the evaluation of features. Experiments show that, all the repetitive patterns and their locations are obtained with the accuracy of 93% and 78% for music and speech, respectively.
doi:10.1109/icme.2006.262675 dblp:conf/icmcs/SertBY06 fatcat:pt6miv47xjblhgttwffguz7xvq