Incremental Coordination: Attention-Centric Speech Production in a Physically Situated Conversational Agent

Zhou Yu, Dan Bohus, Eric Horvitz
2015 Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue  
Inspired by studies of human-human conversations, we present methods for incrementally coordinating speech production with listeners' visual foci of attention. We introduce a model that considers the demands and availability of listeners' attention at the onset and throughout the production of system utterances, and that incrementally coordinates speech synthesis with the listener's gaze. We present an implementation and deployment of the model in a physically situated dialog system and discuss lessons learned.
doi:10.18653/v1/w15-4652 dblp:conf/sigdial/YuBH15 fatcat:eez74ipf2neuzfgwzm5xavmwbe