Towards Indian Sign Language Sentence Recognition using INSIGNVID: Indian Sign Language Video Dataset

Kinjal Mistree, Devendra Thakor, Brijesh Bhatt
2021 International Journal of Advanced Computer Science and Applications  
Sign language, a language used by Deaf community, is a fully visual language with its own grammar. The Deaf people find it very difficult to express their feelings to the other people, since the other people lack the knowledge of the sign language used by the Deaf community. Due to the differences in vocabulary and grammar of the sign languages, complete adoption of methods used for other international sign languages is not possible for Indian Sign Language (ISL) recognition. It is difficult to
more » ... handle continuous sign language sentence recognition and translation into text as no large video dataset for ISL sentences is available. INSIGNVID -the first Indian Sign Language video dataset has been proposed and with this dataset as input, a novel approach is presented that converts video of ISL sentence in appropriate English sentence using transfer learning. The proposed approach gives promising results on our dataset with MobilNetV2 as pretrained model. Keywords-Indian sign language; sign language recognition; pretrained models; transfer learning; vision-based approaches 697 | P a g e www.ijacsa.thesai.org
doi:10.14569/ijacsa.2021.0120881 fatcat:vd4a47itinf4let4sgrclqwnzy