D4.1: Natural Multimodal Interaction Baseline

Bernd Kiefe, Hans-Ulrich Krieger, Ivana Kruijff-Korbayov´, Stefania Raccioppa
2016 Zenodo  
The present report describes the work carried out in the first project year regarding Natural Multimodal Interaction. It summarizes the Deliverable D4.1: "Natural Multimodal Interaction Baseline". We defined a new formalism for the specification of dialogue policies that combines dialogue rules, knowledge representation and dialogue history in a unique way. We developed the first version of an ontology which specifies the data structures to be used by the dialogue specifications, dialogue
more » ... y, and information state, and adapted our reasoning components, so that this knowledge source can be used efficiently once the formalism specification is fully implemented. We implemented a prototype for the experiments in year 1, which provide us with interaction data that can be used later to develop and evaluate the components in this work package.
doi:10.5281/zenodo.1314339 fatcat:22wqr5bwdvgrjgpwydxc5fzhem