Automatic Generation of Multi-Modal Dialogue from Text Based on Discourse Structure Analysis

Helmut Prendinger, Paul Piwek, Mitsuru Ishizuka
2007 International Conference on Semantic Computing (ICSC 2007)  
In this paper, we propose a novel method for generating engaging multi-modal content automatically from text. Rhetorical Structure Theory (RST) is used to decompose text into discourse units and to identify rhetorical discourse relations between them. Rhetorical relations are then mapped to question-answer pairs in an information preserving way, i.e., the original text and the resulting dialogue convey essentially the same meaning. Finally, the dialogue is "acted out" by two virtual agents. The
more » ... network of dialogue structures automatically built up during this process, called DialogueNet, can be reused for other purposes, such as personalization or question-answering.
doi:10.1109/icosc.2007.4338329 fatcat:erb64rw5xvcajn2ifszjja4i3a