Estimation of human emotions using thermal facial information

Hung Nguyen, Kazunori Kotani, Fan Chen, Bac Le, Yulin Wang, Xudong Jiang, Ming Yang, David Zhang, Xie Yi
2014 Fifth International Conference on Graphic and Image Processing (ICGIP 2013)  
In recent years, research on human emotion estimation using thermal infrared (IR) imagery has appealed to many researchers due to its invariance to visible illumination changes. Although infrared imagery is superior to visible imagery in its invariance to illumination changes and appearance differences, it has difficulties in handling transparent glasses in the thermal infrared spectrum. As a result, when using infrared imagery for the analysis of human facial information, the regions of
more » ... ses are dark and eyes' thermal information is not given. We propose a temperature space method to correct eyeglasses' effect using the thermal facial information in the neighboring facial regions, and then use Principal Component Analysis (PCA), Eigen-space Method based on class-features (EMC), and PCA-EMC method to classify human emotions from the corrected thermal images. We collected the Kotani Thermal Facial Emotion (KTFE) database and performed the experiments, which show the improved accuracy rate in estimating human emotions.
doi:10.1117/12.2050206 fatcat:y4sldrbshngdrlpigdcjmiw3b4