In recent years HCI researchers have developed a broad range of new interfaces that diverge from the "window, icon, menu, pointing device" (WIMP) paradigm, employing a variety of novel interaction techniques and devices. Developers of these next generation user interfaces face challenges that are currently not addressed by state of the art user interface software tools. As part of the user interface software community's effort to address these challenges, the concept of a User Interface

more »

... ion Language (UIDL), reemerge as a promising approach. To date, the UIDL research area has demonstrated extensive development, mainly targeting multi-platform and multi-modal user interfaces. However, many open questions remain regarding the usefulness and effectiveness of UIDLs in supporting the development of next generation interfaces. The aim of this workshop is to bring together both developers of next generation user interfaces and UIDL researchers in an effort to identify key challenges facing this community, to jointly develop new approaches aimed at solving these challenges and finally to consider future spaces for UIDL research. Abstract Current user interfaces do not sufficiently utilize multiple modalities. We developed a new approach to modeling discourse-based interaction design inspired by theories of human communication. From such an interaction design, we envisage to generate a multimodal user interface. This paper presents our approach in the context of mixed-initiative interactions with a (semi-)autonomous robot. Approach description Our approach to multimodal communication consists of two distinct stages: the creation of the interaction