Analysis and Modeling of Affective Audio Visual Speech Based on PAD Emotion Space

Shen Zhang, Yingjin Xu, Jia Jia, Lianhong Cai
2008 2008 6th International Symposium on Chinese Spoken Language Processing  
This paper analyzes acoustic and visual features for affective audio-visual speech based on PAD (Pleasure-Arousal-Dominance) emotion space. The selected acoustic features include F0 maximum, F0 minimum, duration and energy. A set of Partial Expression Parameters (PEP) is proposed as visual features to describe affective facial movement on talking face. This paper explores the connection between PAD emotion space and acoustic/visual features respectively. The variation of acoustic features is
more » ... dicted by PAD values, and a PAD-PEP mapping function for facial expression synthesis is built. Experimental result shows that PAD could be properly applied in describing emotional state as well as predicting the acoustic/visual features for affective audiovisual speech synthesis.
doi:10.1109/chinsl.2008.ecp.82 dblp:conf/iscslp/ZhangXJC08 fatcat:xoudfpbr5vdknoiuakdatx7em4