7,851 Hits in 3.9 sec

Towards A System of Patterns for the Design of Multimodal Interfaces [chapter]

Guillaume Godet-Bar, Sophie Dupuy-Chessa, Laurence Nigay
2007 Computer-Aided Design of User Interfaces V  
efficient and usable multimodal interfaces.  ...  Bolt's seminal "Put that there" demonstrator, more and more robust and innovative modalities can be used and empirical work on the usage of multiple modalities is now available for guiding the design of  ...  ACKNOWLEDGMENTS This work is partly funded by the multidisciplinary French project VER-BATIM and by the SIMILAR network of excellence (http://www.similar. cc), the European research task force creating  ... 
doi:10.1007/978-1-4020-5820-2_3 dblp:conf/cadui/Godet-BarDN06 fatcat:davxyrhf6nftjoxjkbww2hjbzi

Designing Speech and Multimodal Interactions for Mobile, Wearable, and Pervasive Applications

Cosmin Munteanu, Keisuke Nakamura, Kazuhiro Nakadai, Pourang Irani, Sharon Oviatt, Matthew Aylett, Gerald Penn, Shimei Pan, Nikhil Sharma, Frank Rudzicz, Randy Gomez
2016 Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16  
This multidisciplinary, two-day workshop will bring together interaction designers, usability researchers, and general HCI practitioners to analyze the opportunities and directions to take in designing  ...  Very little HCI attention has been dedicated to designing and developing spoken language and multimodal interaction techniques, especially for mobile and wearable devices.  ...  to the widespread adoption of speech and natural language interaction, • Taking concrete steps toward developing a framework of user-centric design guidelines for speech-and language-based interactive  ... 
doi:10.1145/2851581.2856506 dblp:conf/chi/MunteanuIOAPPSR16 fatcat:yrr4nlfjpbdgjkfqtkzddvlgfy

Description languages for multimodal interaction: a set of guidelines and its illustration with SMUIML

Bruno Dumas, Denis Lalanne, Rolf Ingold
2010 Journal on Multimodal User Interfaces  
This article introduces the problem of modeling multimodal interaction, in the form of markup languages.  ...  After an analysis of the current state of the art in multimodal interaction description languages, nine guidelines for languages dedicated at multimodal interaction description are introduced, as well  ...  [13] also worked on the design of a multimodal framework, geared toward direct integration into a multimodal application.  ... 
doi:10.1007/s12193-010-0043-3 fatcat:j4q6einikfcivoxrk4fm46gt4i

Strengths and weaknesses of software architectures for the rapid creation of tangible and multimodal interfaces

Bruno Dumas, Denis Lalanne, Dominique Guinard, Reto Koenig, Rolf Ingold
2008 Proceedings of the 2nd international conference on Tangible and embedded interaction - TEI '08  
Finally, the article stresses the major issues associated with the development of toolkits allowing the creation of multimodal and tangible interfaces, and presents our future objectives.  ...  This paper reviews the challenges associated with the development of tangible and multimodal interfaces and exposes our experiences with the development of three different software architectures to rapidly  ...  [8] also worked on the design of a multimodal framework, geared toward direct integration into a multimodal application.  ... 
doi:10.1145/1347390.1347403 dblp:conf/tei/DumasLGKI08 fatcat:mhjpkfpj35dbvduighse3zznni

Toward Multimodal Interaction in Scalable Visual Digital Evidence Visualization Using Computer Vision Techniques and ISS [article]

Serguei A. Mokhov, Miao Song, Jashanjot Singh, Joey Paquet, Mourad Debbabi, Sudhir Mudur
2018 arXiv   pre-print
This includes an ability to arbitrarily switch between those views combined with usable multimodal interaction.  ...  link, and provide a usable interface to digital investigators that is navigable via different multimodal interaction techniques using Computer Vision techniques including gestures, as well as eye-gaze  ...  Forensic Lucid is designed to explicitly address these drawbacks and aims to be usable, expressive, sound and complete.  ... 
arXiv:1808.00118v1 fatcat:gmeaw5vomva3jaidaxdmhljpzq

Multimodal application for foreign language teaching

Teresa Magal-Royo, Jose Luis Gimenez-Lopez, Blas Pairy, Jesus Garcia-Laborda, Jimena Gonzalez-del Rio
2011 2011 14th International Conference on Interactive Collaborative Learning  
The current development of educational applications for language learning has experienced a qualitative change in the criteria of interaction between users and devices due to the technological advances  ...  This paper shows the possibility of establishing multimodal architectures within the applications for specific language learning areas with ubiquitous devices, evidencing the technical and formal aspects  ...  The experiment's design was based on three types of interaction: interaction by voice only, interaction with the stylus only, and multimodal interaction using speech and stylus.  ... 
doi:10.1109/icl.2011.6059564 fatcat:nikrqtmtf5b5tcpwoqjt763ohu

Are We There Yet? Research in Commercial Spoken Dialog Systems [chapter]

Roberto Pieraccini, David Suendermann, Krishna Dayanidhi, Jackson Liscombe
2009 Lecture Notes in Computer Science  
Finally we describe the inevitable evolution for spoken dialog applications from speech only to multimodal interaction.  ...  The availability of massive amounts of data during deployment led to the development of continuous optimization strategy pushing the design and development of spoken dialog applications from an art to  ...  Finally, we will conclude with a mention of the current trends, including the evolution of SDS towards multimodal interaction.  ... 
doi:10.1007/978-3-642-04208-9_3 fatcat:3xr2cp2tangldjrng4qgwxqxf4

Evaluation and usability of multimodal spoken language dialogue systems

Laila Dybkjær, Niels Ole Bernsen, Wolfgang Minker
2004 Speech Communication  
Considerable work has been done regarding usability evaluation of task-oriented unimodal spoken language dialogue systems (SLDSs).  ...  This paper presents a state-of-the-art in usability evaluation of these new types of SLDSs and conclusions based on the experience we have today.  ...  Usability of a Speech-Centric Multimodal Directory Assistance Service. Proceedings of the CLASS Workshop on Information Presentation and Natural Multimodal Dialogs, Verona, Italy, 2001, 65-69.  ... 
doi:10.1016/j.specom.2004.02.001 fatcat:sz3wtq27xredzpyzljevp4tt4e

Multimodal Interfaces: A Survey of Principles, Models and Frameworks [chapter]

Bruno Dumas, Denis Lalanne, Sharon Oviatt
2009 Lecture Notes in Computer Science  
The article concludes with an outline of the current state of multimodal interaction research in Switzerland, and also summarizes the major future challenges in the field.  ...  Modeling of multimodal interaction as well as tools allowing rapid creation of multimodal interfaces are then presented.  ...  But future work clearly is needed to work toward the design of usable adaptive multimodal interfaces.  ... 
doi:10.1007/978-3-642-00437-7_1 fatcat:2kpxjb4kqfcupkrxeexlvwi3su

Standardization of Design Interfaces Applied to Language Test on-line through Ubiquitous Devices

Teresa Magal-Royo, Jesus Garcia-Laborda
2018 International Journal of Interactive Mobile Technologies  
<p class="0abstractCxSpFirst">Normalization of design rules and guidelines in English language tests to help future instructors and assessment developers in the field of examination of English as a foreign  ...  be necessary in the future to establish the standards in design and vision for language tests in its online environment.  ...  While other projects have focused on the user's experience and also on the interactive environments oriented towards the development of on-line language assessment tests.  ... 
doi:10.3991/ijim.v12i4.9197 fatcat:2kmgj2wbijhndkwoxcxuttf4ry

Supporting Doctors through Mobile Multimodal Interaction and Process-Aware Execution of Clinical Guidelines

Fabrizio Cossu, Andrea Marrella, Massimo Mecella, Alessandro Russo, Stephen Kimani, Giuliano Bertazzoni, Annunziata Colabianchi, Alessandro Corona, Aldo De Luise, Francesco Grasso, Marianna Suppa
2014 2014 IEEE 7th International Conference on Service-Oriented Computing and Applications  
As a viable solution for clinicians' interaction with the system, we investigated the use of vocal and touch interfaces. Usability evaluation results indicate the feasibility of the approach.  ...  In particular, any possible solution should provide usable user interfaces, possibly deployed on mobile devices, and should be able to enact and monitor the execution of clinical guidelines.  ...  The second design prototype was considered to have had made great strides toward complying with typical design guidelines for multimodal user interface design [5] , for instance our design prototype supports  ... 
doi:10.1109/soca.2014.44 dblp:conf/soca/CossuMM0KBCCLGS14 fatcat:mhy4khbklve6xfizcxtvsspci4

Towards a Semantic Modelling Framework in Support of Multimodal User Interface Design [chapter]

Elena Tsiporkova, Tom Tourwé, Nicolás González-Deleito
2011 Lecture Notes in Computer Science  
In this paper, we propose a semantic modelling framework to capture the available domain knowledge in the field of multimodal interface design and to support designers in their daily design tasks.  ...  This research is supported by the ARTEMIS JU and IWT ( through the SMARCOS project (, and by Innoviris ( through the VariBru project (  ...  Introduction Parallel with the evolution towards multimodal applications, the research toward the establishment of formal principles and guidelines for multimodal interaction design is gaining increasing  ... 
doi:10.1007/978-3-642-23768-3_101 fatcat:qo7l65vqdbcadcrf3napu65dfy

Page 761 of Psychological Abstracts Vol. 93, Issue 2 [page]

2006 Psychological Abstracts  
The value of the ERFV as a usability testing tool was demonstrated through an exper- iment that evaluated two Web sites that were equivalent in content but that differed in terms of design.  ...  This research seeks to contribute to an understanding of the process of developing user models for group interaction and to the design and imple- mentation of multiuser interfaces based on the model.  ... 

A Step towards Adaptive Multimodal Virtual Social Interaction Platform for Children with Autism [chapter]

Esubalew Bekele, Mary Young, Zhi Zheng, Lian Zhang, Amy Swanson, Rebecca Johnston, Julie Davidson, Zachary Warren, Nilanjan Sarkar
2013 Lecture Notes in Computer Science  
It is hypothesized that endowing a technological system that can detect the feeling and state of the child and adapt its interaction accordingly is of great importance in assisting and individualization  ...  the performance of the participant.  ...  This section briefly presents the current status of these components of the system and the preparation to the usability study of this multimodal adaptive interactive virtual reality environment.  ... 
doi:10.1007/978-3-642-39191-0_51 fatcat:rnrjkdrltnh75nsbf3meg5x43m

Multimodal interaction on mobile phones

Marcos Serrano, Laurence Nigay, Rachel Demumieux, Jérôme Descos, Patrick Losquin
2006 Proceedings of the 8th conference on Human-computer interaction with mobile devices and services - MobileHCI '06  
The development and the evaluation of multimodal interactive systems on mobile phones remains a difficult task.  ...  ACICARE is dedicated to the overall iterative design process of mobile multimodal interfaces, which consists of cycles of designing, prototyping and evaluation.  ...  Thanks to Fonix Speech Inc. for allowing the use of their voice recognition SDK. Special thanks to G. Serghiou for reviewing the paper.  ... 
doi:10.1145/1152215.1152242 dblp:conf/mhci/SerranoNDDL06 fatcat:hloik76yprfrbl5nfhjho3fide
« Previous Showing results 1 — 15 out of 7,851 results