Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches

Mar Saneiro, Olga C. Santos, Sergio Salmeron-Majadas, Jesus G. Boticario
2014 The Scientific World Journal  
We report current findings when considering video recordings of facial expressions and body movements to provide affective personalized support in an educational context from an enriched multimodal emotion detection approach. In particular, we describe an annotation methodology to tag facial expression and body movements that conform to changes in the affective states of learners while dealing with cognitive tasks in a learning process. The ultimate goal is to combine these annotations with
more » ... tional affective information collected during experimental learning sessions from different sources such as qualitative, self-reported, physiological, and behavioral information. These data altogether are to train data mining algorithms that serve to automatically identify changes in the learners' affective states when dealing with cognitive tasks which help to provide emotional personalized support.
doi:10.1155/2014/484873 pmid:24892055 pmcid:PMC4030504 fatcat:yn4dqxah6bcm5gzkqgp3itp63u