Recognizing gaze aversion gestures in embodied conversational discourse

Louis-Philippe Morency, C. Mario Christoudias, Trevor Darrell
2006 Proceedings of the 8th international conference on Multimodal interfaces - ICMI '06  
Eye gaze offers several key cues regarding conversational discourse during face-to-face interaction between people. While a large body of research results exist to document the use of gaze in humanto-human interaction, and in animating realistic embodied avatars, recognition of conversational eye gestures-distinct eye movement patterns relevant to discourse-has received less attention. We analyze eye gestures during interaction with an animated embodied agent and propose a non-intrusive
more » ... ased approach to estimate eye gaze and recognize eye gestures. In our user study, human participants avert their gaze (i.e. with "look-away" or "thinking" gestures) during periods of cognitive load. Using our approach, an agent can visually differentiate whether a user is thinking about a response or is waiting for the agent or robot to take its turn.
doi:10.1145/1180995.1181051 dblp:conf/icmi/MorencyCD06 fatcat:c23bp7uu2ja45fendocgrcijby