Coordination and context-dependence in the generation of embodied conversation

Justine Cassell, Matthew Stone, Hao Yan
2000 Proceedings of the first international conference on Natural language generation - INLG '00  
We describe the generation of communicative actions in an implemented embodied conversational agent. Our agent plans each utterance so that multiple communicative goals may be realized opportunistically by a composite action including not only speech but also coverbal gesture that fits the context and the ongoing speech in ways representative of natural human conversation. We accomplish this by reasoning from a grammar which describes gesture declaratively in terms of its discourse function, semantics and synchrony with speech.
doi:10.3115/1118253.1118277 dblp:conf/inlg/CassellSY00 fatcat:k3bbz2rpqrhkpbjw3vu33tmxie