A Study on Lip Detection based on Eye Localization for Visual Speech Recognition in Mobile Environment
모바일 환경에서의 시각 음성인식을 위한 눈 정위 기반 입술 탐지에 대한 연구

Song-Min Gyu, Thanh Trung Pham, Jin-Young Kim, Hwang-Sung Taek
2009 Journal of Korean institute of intelligent systems  
Automatic speech recognition(ASR) is attractive technique in trend these day that seek convenient life. Although many approaches have been proposed for ASR but the performance is still not good in noisy environment. Now-a-days in the state of art in speech recognition, ASR uses not only the audio information but also the visual information. In this paper, We present a novel lip detection method for visual speech recognition in mobile environment. In order to apply visual information to speech
more » ... cognition, we need to extract exact lip regions. Because eye-detection is more easy than lip-detection, we firstly detect positions of left and right eyes, then locate lip region roughly. After that we apply K-means clustering technique to devide that region into groups, than two lip corners and lip center are detected by choosing biggest one among clustered groups. Finally, we have shown the effectiveness of the proposed method through the experiments based on samsung AVSR database.
doi:10.5391/jkiis.2009.19.4.478 fatcat:fjeexfz7ozbmpf5ctopk3247wu