Adaptivity in speech-based multilingual e-mail client

Esa-Pekka Salonen, Mikko Hartikainen, Markku Turunen, Jaakko Hakulinen, Jyrki Rissanen, Kari Kanto, Kristiina Jokinen
2004 Proceedings of the third Nordic conference on Human-computer interaction - NordiCHI '04  
domain is particularly suitable area for adaptive speech applications since dialogues tend to be more openended than structured. This is because there is no single static task that the user tries to solve. This makes speech based e-mail application very different from, e.g. timetable systems that are commonly modeled as forms. The lack of fixed goal means that the interaction model for this kind of system is user-initiated. However, users must somehow be aware of what can be done with the
more » ... . To address this issue we have implemented different adaptive features that help the users in learning how such systems can be used. These features include integrated tutoring, output generation that takes user expertise into account and context adaptive universal commands. ABSTRACT In speech interfaces users must be aware what can be done with the system -in other words, the system must provide information to help the users to know what to say. We have addressed this challenge by using adaptive techniques that support the learning and use of speech applications. We describe how adaptivity can be supported on architectural level, how user modeling can help to make the interface more adaptive, how integrated tutoring teaches the users to use speech applications and how context adaptive universal commands support cross domain learning. Specific issues concerning e-mail domain are discussed and examples from a working speech-based e-mail application are given. Author Keywords The domain of the application is one of the major issues in interface design, especially in speech interfaces. For example, a speech-based e-mail client must be adaptive to the contents of the mailbox and individual messages. In a nutshell, speech-based interaction in e-mail domain is about navigation between messages and reading of relevant ones. To make the navigation tasks easier we have implemented components that categorize the messages into semantically meaningful groups, thus adapting the structure of the mailbox suitable for speech user interfaces. Furthermore, the interaction is adapted to the mailbox structure, and the e-mail messages are presented to the user taking into account the characteristics of the user and the messages. Voice I/O, adaptation. ACM Classification Keywords H 5.2, User-centered design, Voice I/O.
doi:10.1145/1028014.1028089 dblp:conf/nordichi/SalonenHTHRKJ04 fatcat:j6xq2qpd3vgotm4a6ckl6zf7pe