A self-similarity approach to repairing large dropouts of streamed music
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Enjoyment of audio has now become about flexibility and personal freedom. Digital audio content can be acquired from many sources and wireless networking allows digital media devices and associated peripherals to be unencumbered by wires. However, despite recent improvements in capacity and quality of service, wireless networks are inherently unreliable communications channels for the streaming of audio, being susceptible to the effects of range, interference, and occlusion. This time-varying
... This time-varying reliability of wireless audio transfer introduces data corruption and loss, with unpleasant audible effects that can be profound and prolonged in duration. Traditional communications techniques for error mitigation perform poorly and in a bandwidth inefficient manner in the presence of such large-scale defects in a digital audio stream. A novel solution that can complement existing techniques takes account of the semantics and natural repetition of music. Through the use of self-similarity metadata, missing or damaged audio segments can be seamlessly replaced with similar undamaged segments that have already been successfully received. We propose a technology to generate relevant self-similarity metadata for arbitrary audio material and to utilize this metadata within a wireless audio receiver to provide sophisticated and real-time correction of large-scale errors. The primary objectives are to match the current section of a song being received with previous sections while identifying incomplete sections and determining replacements based on previously received portions of the song. This article outlines our approach to Forward Error Correction (FEC) technology that is used to "repair" a bursty dropout when listening to time-dependent media on a wireless network. Using self-similarity analysis on a music file, we can "automatically" repair the dropout with a similar portion of the music already received thereby minimizing a listener's discomfort. ACM Reference Format: Doherty, J., Curran, K., and McKevitt, P. 2013. A self-similarity approach to repairing large dropouts of streamed music. ACM Trans. Multimedia Comput.