Audiovisual Speech Synchrony Measure: Application to Biometrics

Hervé Bredin, Gérard Chollet
2007 EURASIP Journal on Advances in Signal Processing  
Speech is a means of communication which is intrinsically bimodal: the audio signal originates from the dynamics of the articulators. This paper reviews recent works in the field of audiovisual speech, and more specifically techniques developed to measure the level of correspondence between audio and visual speech. It overviews the most common audio and visual speech front-end processing, transformations performed on audio, visual, or joint audiovisual feature spaces, and the actual measure of
more » ... orrespondence between audio and visual speech. Finally, the use of synchrony measure for biometric identity verification based on talking faces is experimented on the BANCA database.
doi:10.1155/2007/70186 fatcat:nnyxpklkjjgh7cdtjt4qcg532e