Multimodal interaction with xforms

Mikko Honkala, Mikko Pohja
2006 Proceedings of the 6th international conference on Web engineering - ICWE '06  
The increase in connected mobile computing devices has created the need for ubiquitous Web access. In many usage scenarios, it would be beneficial to interact multimodally. Current Web user interface description languages, such as HTML and VoiceXML, concentrate only on one modality. Some languages, such as SALT and X+V, allow combining aural and visual modalities, but they lack ease-of-authoring, since both modalities have to be authored separately. Thus, for ease-of-authoring and
more » ... y, it is necessary to provide a cross-modal user interface language, whose semantic level is higher. We propose a novel model, called XFormsMM, which includes XForms 1.0 combined with modality-dependent stylesheets and a multimodal interaction manager. The model separates modality-independent parts from the modality-dependent parts, thus automatically providing most of the user interface to all modalities. The model allows flexible modality changes, so that the user can decide, which modalities to use and when.
doi:10.1145/1145581.1145624 dblp:conf/icwe/HonkalaP06 fatcat:bssvnu3cgzardpx72fogqeptzm