Filters








2,589 Hits in 11.6 sec

Multisensory VR interaction for protein-docking in the CoRSAIRe project

N. Férey, J. Nelson, C. Martin, L. Picinali, G. Bouyer, A. Tek, P. Bourdot, J. M. Burkhardt, B. F. G. Katz, M. Ammi, C. Etchebest, L. Autin
2009 Virtual Reality  
To this end, we conducted an ergonomic analysis of the protein-protein current docking task.  ...  During this exploration, visual, audio and haptic feedbacks are combined to render and evaluate chemical or physical properties of the current docking configuration.  ...  Acknowledgements This work is currently supported by the ANR (the french National Agency for Research) through the CoRSAIRe project of ARA MDMSA program, and by the RTRA (french Thematic Network of Advanced  ... 
doi:10.1007/s10055-009-0136-z fatcat:pmbk6tp275cubjkmrqojtozg6m

Evaluating embodied conversational agents in multimodal interfaces

Benjamin Weiss, Ina Wechsung, Christine Kühnel, Sebastian Möller
2015 Computational Cognitive Science  
Based on cross-disciplinary approaches to Embodied Conversational Agents, evaluation methods for such human-computer interfaces are structured and presented.  ...  Agents, and how these can be used for evaluation purposes.  ...  BW and IW were responsible for the Theoretical Foundations of Evaluation and analysed the data for the questionnaire in Best Practice.  ... 
doi:10.1186/s40469-015-0006-9 fatcat:3qgvabqeffbwzlx3smclvs4f4u

The State of Speech in HCI: Trends, Themes and Challenges [article]

Leigh Clark, Phillip Doyle, Diego Garaialde, Emer Gilmartin, Stephan Schlögl, Jens Edlund, Matthew Aylett, João Cabral, Cosmin Munteanu, Benjamin Cowan
2018 arXiv   pre-print
Speech interfaces are growing in popularity. Through a review of 68 research papers this work maps the trends, themes, findings and methods of empirical research on speech interfaces in HCI.  ...  We also highlight the need to improve measure reliability, validity and consistency, in the wild deployment and reduce barriers to building fully functional speech interfaces for research.  ...  Several inclusion and exclusion criteria were then applied to ensure relevance to the aims of the research.  ... 
arXiv:1810.06828v1 fatcat:ry2ac4ozkbbnpirj74kvnaptgi

Smell-O-Message

Emanuela Maggioni, Robert Cobden, Dmitrijs Dmitrenko, Marianna Obrist
2018 Proceedings of the 2018 on International Conference on Multimodal Interaction - ICMI '18  
We discuss the design implications and opportunities for future work in the domain of multimodal interactions.  ...  Here we re-validate the effectiveness of smell as notification modality and present findings on the performance of smell in conveying information.  ...  The secondary task was to press a red button when perceiving any Slack notification (any of the three modalities) while performing the primary task.  ... 
doi:10.1145/3242969.3242975 dblp:conf/icmi/MaggioniCDO18 fatcat:potqoaz35ffgbni7tynn4hmxam

Technical Report - Systematic Mapping Study

Guilherme Guerino
2020 figshare.com  
This report presents the execution of a Systematic Literature Mapping of technologies being used to evaluate the Usability and/or User Experience in Conversational Systems.  ...  It presents the mapping planning in detail as well as inclusion and exclusion criteria, information sources used, list of papers found according to the criteria defined in the mapping protocol, and complete  ...  , it is not necessary to determine a context.  ... 
doi:10.6084/m9.figshare.12840773.v4 fatcat:bwlrlfs5yzefvm3aepc2yp4pri

Multimodal Machine Translation through Visuals and Speech

Umut Sulubacak, Ozan Caglayan, Stig-Arne Grönroos, Aku Rouhe, Desmond Elliott, Lucia Specia, Jörg Tiedemann
2019 Zenodo  
This survey reviews the major data resources for these tasks, the evaluation campaigns concentrated around them, the state of the art in end-to-end and pipeline approaches, and also the challenges in performance  ...  The paper concludes with a discussion of directions for future research in these areas: the need for more expansive and challenging datasets, for targeted evaluations of model performance, and for multimodality  ...  We would also like to thank Maarit Koponen for her valuable feedback and her help in establishing our discussions of machine translation evaluation.  ... 
doi:10.5281/zenodo.3690791 fatcat:otdy5i33fzfsnnbb3xgb6zph6q

Multimodal machine translation through visuals and speech

Umut Sulubacak, Ozan Caglayan, Stig-Arne Grönroos, Aku Rouhe, Desmond Elliott, Lucia Specia, Jörg Tiedemann
2020 Machine Translation  
This survey reviews the major data resources for these tasks, the evaluation campaigns concentrated around them, the state of the art in end-to-end and pipeline approaches, and also the challenges in performance  ...  The paper concludes with a discussion of directions for future research in these areas: the need for more expansive and challenging datasets, for targeted evaluations of model performance, and for multimodality  ...  We would also like to thank Maarit Koponen for her valuable feedback and her help in establishing our discussions of machine translation evaluation.  ... 
doi:10.1007/s10590-020-09250-0 fatcat:jod3ghcsnnbipotcqp6sme4lna

A Framework for Research in Gamified Mobile Guide Applications using Embodied Conversational Agents (ECAs)

Ioannis Doumanis, Serengul Smith
2015 International Journal of Serious Games  
However, insufficient attention has been paid to the empirical evaluation of such interfaces.  ...  the potential effects of such applications to players and how to approach the concepts of player experience, cognitive accessibility and usability in this context.  ...  Competition: How players perceive and perform in tasks with gamified mobile guide applications is most likely affected by whether and how the task introduces competition.  ... 
doi:10.17083/ijsg.v2i3.79 fatcat:qq5jqyspirfindl3eqajx3nayu

GeCoAgent: A Conversational Agent for Empowering Genomic Data Extraction and Analysis

Pietro Crovari, Sara Pidò, Pietro Pinoli, Anna Bernasconi, Arif Canakoglu, Franca Garzotto, Stefano Ceri
2022 ACM Transactions on Computing for Healthcare  
Typical interactions require applying comparative data analysis to huge repositories of genomic information for building new knowledge, taking advantage of the latest findings in applied genomics for healthcare  ...  With the availability of reliable and low-cost DNA sequencing, human genomics is relevant to a growing number of end-users, including biologists and clinicians.  ...  ACKNOWLEDGEMENTS This work was supported by the ERC Advanced Grant 693174 "Data-Driven Genomic Computing (GeCo)".  ... 
doi:10.1145/3464383 fatcat:z55wpyjvhjdytkr6g53uflswyi

User-Aware Music Retrieval

Markus Schedl, Sebastian Stober, Emilia Gómez, Nicola Orio, Cynthia C.S. Liem, Marc Herbstritt
2012 Dagstuhl Publications  
A context-aware system, in contrast, takes into account dynamic aspects of the user context when processing the data (e.g., location and time where/when a user issues a query).  ...  Particularly focusing on the music domain, this article gives an overview of different aspects we deem important to build personalized music retrieval systems.  ...  The authors propose a multimodal music similarity measure and show its applicability to the task of music retrieval.  ... 
doi:10.4230/dfu.vol3.11041.135 dblp:conf/dagstuhl/SchedlSGOL12 fatcat:weo2yddzzrfwjkgmfk7zrs3apy

Situated and culturally appropriate self-directed multimodal learning [chapter]

Jako Olivier, North-West University
2021 NWU Self-Directed Learning Series  
Furthermore, this chapter is part of an ongoing research by the UNESCO Chair on Multimodal Learning and Open Educational Resources.  ...  Acknowledgements The authors would like to thank the North-West University (NWU) Faculty of Education, its executive dean, Prof.  ...  In this context, Canale (2019) states the following: Multimodality leads us to analyze how complex meanings are created in the articulation of both modal resources -or modes -and media.  ... 
doi:10.4102/aosis.2020.bk210.07 fatcat:35672vxbavdo5isfdnxsojodky

A systematic literature review to probe design guidelines for a self-directed blended learning environment [chapter]

Dorothy Laubscher, North-West University, Chantelle Bosch, North-West University
2021 NWU Self-Directed Learning Series  
Furthermore, this chapter is part of an ongoing research by the UNESCO Chair on Multimodal Learning and Open Educational Resources.  ...  Acknowledgements The authors would like to thank the North-West University (NWU) Faculty of Education, its executive dean, Prof.  ...  In this context, Canale (2019) states the following: Multimodality leads us to analyze how complex meanings are created in the articulation of both modal resources -or modes -and media.  ... 
doi:10.4102/aosis.2020.bk210.04 fatcat:42dfrwnss5eydckzpmvjzbnojy

On the Opportunities and Risks of Foundation Models [article]

Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch (+102 others)
2022 arXiv   pre-print
AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks.  ...  Despite the impending widespread deployment of foundation models, we currently lack a clear understanding of how they work, when they fail, and what they are even capable of due to their emergent properties  ...  Despite the impending widespread deployment of foundation models, we currently lack a clear understanding of how they work, when they fail, and what they are even capable of due to their emergent properties  ... 
arXiv:2108.07258v3 fatcat:kohwrwk2ybf7fd7wsuz2gp65ki

Semantic Fusion for Natural Multimodal Interfaces using Concurrent Augmented Transition Networks

Chris Zimmerer, Martin Fischbach, Marc Latoschik
2018 Multimodal Technologies and Interaction  
Semantic fusion is a central requirement of many multimodal interfaces.  ...  We identify seven fundamental requirements for the implementation of semantic fusion: Action derivation, continuous feedback, context-sensitivity, temporal relation support, access to the interaction context  ...  This, however, contradicts iterative prototyping and evaluation commonly applied in interface design to produce suitable interfaces [49] .  ... 
doi:10.3390/mti2040081 fatcat:xnatqujmufafpbtkw4fo6hsauu

Capturing emotions in voice: A comparative analysis of methodologies in psychology and digital signal processing

Daniela Hekiert, Magdalena Igras-Cybulska
2019 Roczniki Psychologiczne  
The article aims to compare these two approaches and suggest methods of combining them to achieve a more complex insight into the vocal communication of emotions.  ...  Specifically, it demonstrates the encoding (production) and decoding (recognition) of emotional sounds, including the review and comparison of strategies in database design, parameterization, and classification  ...  The rate of vocal fold oscillationfundamental frequency, F0usually determines the perceived pitch of the sound.  ... 
doi:10.18290/rpsych.2019.22.1-2 fatcat:3l4vlfiz4bab7bgkawqwfit5q4
« Previous Showing results 1 — 15 out of 2,589 results