A continuous Chinese sign language recognition system

Jiyong Ma, Wen Gao, Jiangqin Wu, Chunli Wang
Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580)  
In this paper, we describe a system for recognizing both the isolated and continuous Chinese Sign Language (CSL) using two Cybergloves and two 3SAPCE-position trackers as gesture input devices. To get robust gesture features, each joint-angle collected by Cybergloves is normalized. The relative position and orientation of the left hand to those of the right hand are proposed as the signer position independent features. To speed up the recognition process, a fast match and a frame predicting
more » ... niques are proposed. To tackle epenthesis movement problem, context-dependent models are obtained by the Dynamic Programming (DP) technique. HMMs are utilized to model basic word units. Then we describe training techniques of the bigram language model and the search algorithm used in our baseline system. The baseline system converts sentence level gestures into synthesis speech and gestures of 3D virtual human synchronously. Experiments show that these techniques are efficient both in recognition speed and recognition performance.
doi:10.1109/afgr.2000.840670 dblp:conf/fgr/MaGWW00 fatcat:4sfxkjqo7zckfo3kols6jd7aqa