A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2018; you can also visit the original URL.
The file type is application/pdf.
Filters
Multisensory VR interaction for protein-docking in the CoRSAIRe project
2009
Virtual Reality
Preserved Fulltext
To this end, we conducted an ergonomic analysis of the protein-protein current docking task. ...
During this exploration, visual, audio and haptic feedbacks are combined to render and evaluate chemical or physical properties of the current docking configuration. ...
Acknowledgements This work is currently supported by the ANR (the french National Agency for Research) through the CoRSAIRe project of ARA MDMSA program, and by the RTRA (french Thematic Network of Advanced ...
doi:10.1007/s10055-009-0136-z
fatcat:pmbk6tp275cubjkmrqojtozg6m
Evaluating embodied conversational agents in multimodal interfaces
2015
Computational Cognitive Science
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
Based on cross-disciplinary approaches to Embodied Conversational Agents, evaluation methods for such human-computer interfaces are structured and presented. ...
Agents, and how these can be used for evaluation purposes. ...
BW and IW were responsible for the Theoretical Foundations of Evaluation and analysed the data for the questionnaire in Best Practice. ...
doi:10.1186/s40469-015-0006-9
fatcat:3qgvabqeffbwzlx3smclvs4f4u
The State of Speech in HCI: Trends, Themes and Challenges
[article]
2018
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
Speech interfaces are growing in popularity. Through a review of 68 research papers this work maps the trends, themes, findings and methods of empirical research on speech interfaces in HCI. ...
We also highlight the need to improve measure reliability, validity and consistency, in the wild deployment and reduce barriers to building fully functional speech interfaces for research. ...
Several inclusion and exclusion criteria were then applied to ensure relevance to the aims of the research. ...
arXiv:1810.06828v1
fatcat:ry2ac4ozkbbnpirj74kvnaptgi
Smell-O-Message
2018
Proceedings of the 2018 on International Conference on Multimodal Interaction - ICMI '18
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2019; you can also visit the original URL.
The file type is application/pdf.
We discuss the design implications and opportunities for future work in the domain of multimodal interactions. ...
Here we re-validate the effectiveness of smell as notification modality and present findings on the performance of smell in conveying information. ...
The secondary task was to press a red button when perceiving any Slack notification (any of the three modalities) while performing the primary task. ...
doi:10.1145/3242969.3242975
dblp:conf/icmi/MaggioniCDO18
fatcat:potqoaz35ffgbni7tynn4hmxam
Technical Report - Systematic Mapping Study
2020
figshare.com
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
This report presents the execution of a Systematic Literature Mapping of technologies being used to evaluate the Usability and/or User Experience in Conversational Systems. ...
It presents the mapping planning in detail as well as inclusion and exclusion criteria, information sources used, list of papers found according to the criteria defined in the mapping protocol, and complete ...
, it is not necessary to determine a context. ...
doi:10.6084/m9.figshare.12840773.v4
fatcat:bwlrlfs5yzefvm3aepc2yp4pri
Multimodal Machine Translation through Visuals and Speech
2019
Zenodo
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
This survey reviews the major data resources for these tasks, the evaluation campaigns concentrated around them, the state of the art in end-to-end and pipeline approaches, and also the challenges in performance ...
The paper concludes with a discussion of directions for future research in these areas: the need for more expansive and challenging datasets, for targeted evaluations of model performance, and for multimodality ...
We would also like to thank Maarit Koponen for her valuable feedback and her help in establishing our discussions of machine translation evaluation. ...
doi:10.5281/zenodo.3690791
fatcat:otdy5i33fzfsnnbb3xgb6zph6q
Multimodal machine translation through visuals and speech
2020
Machine Translation
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf.
This survey reviews the major data resources for these tasks, the evaluation campaigns concentrated around them, the state of the art in end-to-end and pipeline approaches, and also the challenges in performance ...
The paper concludes with a discussion of directions for future research in these areas: the need for more expansive and challenging datasets, for targeted evaluations of model performance, and for multimodality ...
We would also like to thank Maarit Koponen for her valuable feedback and her help in establishing our discussions of machine translation evaluation. ...
doi:10.1007/s10590-020-09250-0
fatcat:jod3ghcsnnbipotcqp6sme4lna
A Framework for Research in Gamified Mobile Guide Applications using Embodied Conversational Agents (ECAs)
2015
International Journal of Serious Games
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2019; you can also visit the original URL.
The file type is application/pdf.
However, insufficient attention has been paid to the empirical evaluation of such interfaces. ...
the potential effects of such applications to players and how to approach the concepts of player experience, cognitive accessibility and usability in this context. ...
Competition: How players perceive and perform in tasks with gamified mobile guide applications is most likely affected by whether and how the task introduces competition. ...
doi:10.17083/ijsg.v2i3.79
fatcat:qq5jqyspirfindl3eqajx3nayu
GeCoAgent: A Conversational Agent for Empowering Genomic Data Extraction and Analysis
2022
ACM Transactions on Computing for Healthcare
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
Typical interactions require applying comparative data analysis to huge repositories of genomic information for building new knowledge, taking advantage of the latest findings in applied genomics for healthcare ...
With the availability of reliable and low-cost DNA sequencing, human genomics is relevant to a growing number of end-users, including biologists and clinicians. ...
ACKNOWLEDGEMENTS This work was supported by the ERC Advanced Grant 693174 "Data-Driven Genomic Computing (GeCo)". ...
doi:10.1145/3464383
fatcat:z55wpyjvhjdytkr6g53uflswyi
User-Aware Music Retrieval
2012
Dagstuhl Publications
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
A context-aware system, in contrast, takes into account dynamic aspects of the user context when processing the data (e.g., location and time where/when a user issues a query). ...
Particularly focusing on the music domain, this article gives an overview of different aspects we deem important to build personalized music retrieval systems. ...
The authors propose a multimodal music similarity measure and show its applicability to the task of music retrieval. ...
doi:10.4230/dfu.vol3.11041.135
dblp:conf/dagstuhl/SchedlSGOL12
fatcat:weo2yddzzrfwjkgmfk7zrs3apy
Situated and culturally appropriate self-directed multimodal learning
[chapter]
2021
NWU Self-Directed Learning Series
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf.
Furthermore, this chapter is part of an ongoing research by the UNESCO Chair on Multimodal Learning and Open Educational Resources. ...
Acknowledgements The authors would like to thank the North-West University (NWU) Faculty of Education, its executive dean, Prof. ...
In this context, Canale (2019) states the following: Multimodality leads us to analyze how complex meanings are created in the articulation of both modal resources -or modes -and media. ...
doi:10.4102/aosis.2020.bk210.07
fatcat:35672vxbavdo5isfdnxsojodky
A systematic literature review to probe design guidelines for a self-directed blended learning environment
[chapter]
2021
NWU Self-Directed Learning Series
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf.
Furthermore, this chapter is part of an ongoing research by the UNESCO Chair on Multimodal Learning and Open Educational Resources. ...
Acknowledgements The authors would like to thank the North-West University (NWU) Faculty of Education, its executive dean, Prof. ...
In this context, Canale (2019) states the following: Multimodality leads us to analyze how complex meanings are created in the articulation of both modal resources -or modes -and media. ...
doi:10.4102/aosis.2020.bk210.04
fatcat:42dfrwnss5eydckzpmvjzbnojy
On the Opportunities and Risks of Foundation Models
[article]
2022
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
Other Versions
AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks. ...
Despite the impending widespread deployment of foundation models, we currently lack a clear understanding of how they work, when they fail, and what they are even capable of due to their emergent properties ...
Despite the impending widespread deployment of foundation models, we currently lack a clear understanding of how they work, when they fail, and what they are even capable of due to their emergent properties ...
arXiv:2108.07258v3
fatcat:kohwrwk2ybf7fd7wsuz2gp65ki
Semantic Fusion for Natural Multimodal Interfaces using Concurrent Augmented Transition Networks
2018
Multimodal Technologies and Interaction
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2019; you can also visit the original URL.
The file type is application/pdf.
Semantic fusion is a central requirement of many multimodal interfaces. ...
We identify seven fundamental requirements for the implementation of semantic fusion: Action derivation, continuous feedback, context-sensitivity, temporal relation support, access to the interaction context ...
This, however, contradicts iterative prototyping and evaluation commonly applied in interface design to produce suitable interfaces [49] . ...
doi:10.3390/mti2040081
fatcat:xnatqujmufafpbtkw4fo6hsauu
Capturing emotions in voice: A comparative analysis of methodologies in psychology and digital signal processing
2019
Roczniki Psychologiczne
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2019; you can also visit the original URL.
The file type is application/pdf.
The article aims to compare these two approaches and suggest methods of combining them to achieve a more complex insight into the vocal communication of emotions. ...
Specifically, it demonstrates the encoding (production) and decoding (recognition) of emotional sounds, including the review and comparison of strategies in database design, parameterization, and classification ...
The rate of vocal fold oscillationfundamental frequency, F0usually determines the perceived pitch of the sound. ...
doi:10.18290/rpsych.2019.22.1-2
fatcat:3l4vlfiz4bab7bgkawqwfit5q4
« Previous
Showing results 1 — 15 out of 2,589 results