Spatiotemporal analysis of RGB-D-T facial images for multimodal pain level recognition

Ramin Irani, Kamal Nasrollahi, Marc O. Simon, Ciprian A. Corneanu, Sergio Escalera, Chris Bahnsen, Dennis H. Lundtoft, Thomas B. Moeslund, Tanja L. Pedersen, Maria-Louise Klitgaard, Laura Petrini
2015 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)  
Pain is a vital sign of human health and its automatic detection can be of crucial importance in many different contexts, including medical scenarios. While most available computer vision techniques are based on RGB, in this paper, we investigate the effect of combining RGB, depth, and thermal facial images for pain intensity level recognition. For this purpose, we extract energies released by facial pixels using a spatiotemporal filter. Experiments on a group of 12 elderly people applying the
more » ... ultimodal approach show that the proposed method successfully detects pain and recognizes between three intensity levels in 82% of the analyzed frames, improving by more than 6% the results that only consider RGB data.
doi:10.1109/cvprw.2015.7301341 dblp:conf/cvpr/IraniNSCEBLMPKP15 fatcat:3jekokhcuzbsnmr3dasaez3kvq