Modelling Spoken Signatures with Gaussian Mixture Model Adaptation

Jean Hennebert, Andreas Humm, Roif Ingold
2007 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07  
We report on our developments towards building a novel user authentication system using combined acquisition of online handwritten signature and speech modalities. In our approach, signatures are recorded by asking the user to say what she/he is writing, leading to the so-called spoken signatures. We have built a verification system composed of two Gaussian Mixture Models (GMMs) sub-systems that model independently the pen and voice signal. We report on results obtained with two algorithms used
more » ... for training the GMMs, respectively Expectation Maximization and Maximum A Posteriori Adaptation. Different algorithms are also compared for fusing the scores of each modality. The evaluations are conducted on spoken signatures taken from the MyIDea multimodal database, accordingly to the protocols provided with the database. Results are in favor of using M\AP adaptation with a simple weighted sum fusion. Results show also clearly the impact of time variability and of skilled versus unskilled forgeries attacks.
doi:10.1109/icassp.2007.366214 dblp:conf/icassp/HennebertHI07 fatcat:d7jyoeikljdbtbhqxiot6avsgy