Audio-visual speech asynchrony detection using co-inertia analysis and coupled hidden markov models

Enrique Argones Rúa, Hervé Bredin, Carmen García Mateo, Gérard Chollet, Daniel González Jiménez
2008 Pattern Analysis and Applications  
This paper addresses the subject of liveness detection, which is a test that ensures that biometric cues are acquired from a live person who is actually present at the time of capture. The liveness check is performed by measuring the degree of synchrony between the lips and the voice extracted from a video sequence. Three new methods based on co-inertia analysis and a fourth based on coupled hidden Markov models are derived and compared with several methods previously used in the literature for asynchrony detection and speaker location.
doi:10.1007/s10044-008-0121-2 fatcat:77nux4gfsvgbrahwtimtx4atwi