The Attention-Hesitation Model. A Non-Intrusive Intervention Strategy for Incremental Smart Home Dialogue Management

Birte Richter
2021
Smart homes are one of the most emergent research fields and provide fundamentally new means of interaction. So-called Smart Personal Assistants (SPAs) entered the household and assist us in our daily activities. Currently, these agents do not react to the attention of the smart home user. However, from Human-Human Interaction (HHI) research we know that humans coordinate their speech and adapt their behavior continuously, based on their interaction partner's actions and reactions. Therefore,
more » ... e central question I ask in this dissertation is how human attention can be incorporated into dialogue management, to improve Human-Agent Interaction (HAI) in smart homes. Research shows that speakers' hesitations are often produced as a reaction to the listener's inattentiveness in HHI. Furthermore, they can improve the listeners' comprehension. Therefore, I investigate whether it is possible to use system hesitations, based on the attention of the human interaction partner, as a communicative act for dialogue coordination in HAI within a smart-home environment. To this end, I develop a theoretical model based on observations from HHI, implement it in an autonomous agent and evaluate it in five interaction studies. This document consists of three parts. In the first part, I develop a model which allows the dialogue management to incorporate the human attention: the Attention-Hesitation Model (AHM). The model uses system hesitations as a non-intrusive intervention strategy to coordinate the human attention with system speech. This theoretical model is based on interdisciplinary literature from HHI and HAI research. In the second part, I elaborate on the technical requirements implied by the integration of the AHM in an autonomous system. A technical realization of an incremental dialogue system in presented. Two main concepts for dialogue modeling are identified: (1) the use of interaction patterns with system task descriptions for generalizability and (2) the concept of the IU model to deal with the incremental nature of [...]
doi:10.4119/unibi/2959410 fatcat:j7i7zms6abaxnn4athsxyv7vo4