Audiovisual behavior descriptors for depression assessment

Stefan Scherer, Giota Stratou, Louis-Philippe Morency
2013 Proceedings of the 15th ACM on International conference on multimodal interaction - ICMI '13  
We investigate audiovisual indicators, in particular measures of reduced emotional expressivity and psycho-motor retardation, for depression within semi-structured virtual human interviews. Based on a standard self-assessment depression scale we investigate the statistical discriminative strength of the audiovisual features on a depression/no-depression basis. Within subject-independent unimodal and multimodal classification experiments we find that early feature-level fusion yields promising
more » ... sults and confirms the statistical findings. We further correlate the behavior descriptors with the assessed depression severity and find considerable correlation. Lastly, a joint multimodal factor analysis reveals two prominent factors within the data that show both statistical discriminative power as well as strong linear correlation with the depression severity score. These preliminary results based on a standard factor analysis are promising and motivate us to investigate this approach further in the future, while incorporating additional modalities.
doi:10.1145/2522848.2522886 dblp:conf/icmi/SchererSM13 fatcat:vqfgypjovzbofmxnnwhjzaqfqi