Survey on Emotional Body Gesture Recognition

Fatemeh Noroozi, Dorota Kaminska, Ciprian Corneanu, Tomasz Sapinski, Sergio Escalera, Gholamreza Anbarjafari
2019 IEEE Transactions on Affective Computing  
Automatic emotion recognition has become a trending research topic in the past decade. While works based on facial expressions or speech abound, recognising affect from body gestures remains a less explored topic. We present a new comprehensive survey hoping to boost research in the field. We first introduce emotional body gestures as a component of what is commonly known as "body language" and comment general aspects as gender differences and culture dependence. We then define a complete
more » ... ork for automatic emotional body gesture recognition. We introduce person detection and comment static and dynamic body pose estimation methods both in RGB and 3D. We then comment the recent literature related to representation learning and emotion recognition from images of emotionally expressive gestures. We also discuss multi-modal approaches that combine speech or face with body gestures for improved emotion recognition. While pre-processing methodologies (e.g. human detection and pose estimation) are nowadays mature technologies fully developed for robust large scale analysis, we show that for emotion recognition the quantity of labelled data is scarce, there is no agreement on clearly defined output spaces and the representations are shallow and largely based on naive geometrical representations. Index Terms-emotional body language, emotional body gesture, emotion recognition, body pose estimation, affective computing ! • F. Noroozi was with the basis of what we see rather than what we hear [2] . At the present, most researchers agree that words serve primarily to convey information and the body movements to form relationships and sometimes even to substitute the verbal communication (e.g. lethal look). Gestures are one of the most important forms of nonverbal communication. They include movements of hands, head and other parts of the body that allow individuals to communicate a variety of feelings, thoughts and emotions. Most of the basic gestures are the same all over the world: when we are happy we smile when we are upset we frown [7], [8], [9] . According to [2] , gestures can be of the following types: • 1949-3045 (c)
doi:10.1109/taffc.2018.2874986 fatcat:zjnr2w4orje7vj2bhmia4f5qki