Lip Reading Using Convolutional Neural Networks with and without Pre-Trained Models

TAYYİP OZCAN, ALPER BASTURK
2019 Balkan Journal of Electrical and Computer Engineering  
Lip reading has become a popular topic recently. There are widespread literature studies on lip reading in human action recognition. Deep learning methods are frequently used in this area. In this paper, lip reading from video data is performed using self designed convolutional neural networks (CNNs). For this purpose, standard and also augmented AvLetters dataset is used in train and test stages. To optimize network performance, minibatchsize parameter is also tuned and its effect is
more » ... effect is investigated. Additionally, experimental studies are performed using AlexNet and GoogleNet pre-trained CNNs. Detailed experimental results are presented.
doi:10.17694/bajece.479891 fatcat:l3pqqyigdze4dbyls5vd2s462q