FaceInput: A Hand-Free and Secure Text Entry System through Facial Vibration

Maoning Guan, Wenqiang Chen, Yandao Huang, Rukhsana Ruby, Kaishun Wu
2019 2019 16th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON)  
Wearable wristbands have become prevailing in the recent days because of their small and portable property. However, the limited size of the touch screen causes the problems of fat fingers and screen occlusion. Furthermore, it is not available for users whose hands are fully occupied with other tasks. To break this bottleneck, we propose a portable, hand-free and secure textentry system, called FaceInput, which firstly uses a single small form factor sensor to accomplish a practical user input
more » ... ia facial vibrations. To sense the tiny facial vibration signals, we design and implement a double-stage amplifier whose maximum gain is 225. To enhance the input accuracy and robustness, we design a set of novel schemes for FaceInput based on the Mel-frequency cepstral coefficient (MFCC) concept and a hidden Markov model (HMM) to process the vibration signals, and an online calibration and adaptation scheme to recover the error due to temporal instability. Extensive experiments have been conducted on 30 human subjects during the period of one month. The results demonstrate that FaceInput can be successful to sense the tiny facial vibrations and robust to fight against various confounding factors. The average recognition accuracy is 98.2%. Furthermore, by enabling the runtime calibration and adaptation scheme that updates and enlarges the training data set, the accuracy can reach 100%.
doi:10.1109/sahcn.2019.8824990 dblp:conf/secon/GuanCHRW19 fatcat:mfolkugi7rar7a7aupuma7oyoy