Filters








12,516 Hits in 9.5 sec

Music Interpretation Analysis. A Multimodal Approach To Score-Informed Resynthesis of Piano Recordings [article]

Federico Simonetta
2022 arXiv   pre-print
In the proposed framework, a distinction is made between the "performance" - the physical action of playing - and the "interpretation" - the action that the performer wishes to achieve.  ...  For this, a novel conceptual and mathematical framework named "Music Interpretation Analysis" (MIA) is presented.  ...  In the music computing literature, authors use the word multimodal in two main contexts: • in computational psychology, where modality refers to a human sensory channel; • in music information retrieval  ... 
arXiv:2205.00941v1 fatcat:nnbfvywdyjgtfcapfq4nn2c3bq

A Social Semiotic Approach to the Attitudinal Meanings in Multimodal Texts

Yong Hu, Qing Qiu
2019 Theory and Practice in Language Studies  
As a special type of multimodal text, picture books for children are highly valued in the creation of meaning by the integrative use of verbal and visual semiotic resources.  ...  In the hope of investigating the collaboration and interplay of verbal and visual semiotics to construe interpersonal meanings, it examines the attitudinal meanings inscribed or invoked in picture books  ...  Children's picture books as a typical kind of multimodal texts, often serve as a foundational part in the lives of young children.  ... 
doi:10.17507/tpls.0909.12 fatcat:xx32mhm3qng2lehjgfbhkspxee

Robotic Telemedicine for Mental Health: A Multimodal Approach to Improve Human-Robot Engagement

Maria R. Lima, Maitreyee Wairagkar, Nirupama Natarajan, Sridhar Vaitheswaran, Ravi Vaidyanathan
2021 Frontiers in Robotics and AI  
A qualitative user experience analysis indicates overall enthusiastic and engaging reception to human-robot multimodal interaction with the new framework.  ...  ., trust) demands seamless affective human-robot interactions; natural 'human-like' conversations are required in simple, inexpensive, deployable platforms.  ...  ACKNOWLEDGMENTS We thank all participants involved in the evaluation of humanrobot interactions, both at Imperial College London and SCARF India.  ... 
doi:10.3389/frobt.2021.618866 pmid:33816568 pmcid:PMC8014955 fatcat:bbnswq2o4vb57h44x5mxwdo4ce

Subtitling and its Acceptability in the Film Farewell, My Concubine: A Multimodal Approach

Nan Wan
2019 Advances in Language and Literary Studies  
Meanwhile, the multimodal approach indicates now the interdisciplinary study on subtitling is a must and a trend to explore both the translation methods and their acceptability.  ...  These findings prove the subtitling methods acceptable and the role of multimodality in subtitling essential.  ...  There are two reasons for a multimodal approach. First, audiovisual translation cannot be separated from the participation of multimodality given the property of audiovisual products.  ... 
doi:10.7575/aiac.alls.v.10n.6p.94 fatcat:gpkekozc3vb2rfzhsudt63mjrq

Context-aware computing for assistive meeting system

Peng Dai, Guangyou Xu
2008 Proceedings of the 1st ACM international conference on PErvasive Technologies Related to Assistive Environments - PETRA '08  
Thus computer understanding of human actions and intentions becomes the key. Context plays a significant role in the understanding of multi-party human interactions such as meetings.  ...  Therefore this paper presents a Dynamic Context Model to solve the problem of context awareness toward group meeting analysis and services, which includes multimodal analysis of group interaction scenarios  ...  Group meeting as a typical multi-party human interaction scenario is adopted for our research work.  ... 
doi:10.1145/1389586.1389591 dblp:conf/petra/DaiX08 fatcat:a6u6temqufafxhhnrqrnjznzcu

Joint Demand Prediction for Multimodal Systems: A Multi-task Multi-relational Spatiotemporal Graph Neural Network Approach [article]

Yuebing Liang and Guan Huang and Zhan Zhao
2021 arXiv   pre-print
To tackle these issues, this study proposes a multi-relational spatiotemporal graph neural network (ST-MRGNN) for multimodal demand prediction.  ...  Despite some recent efforts, existing approaches to multimodal demand prediction are generally not flexible enough to account for multiplex networks with diverse spatial units and heterogeneous spatiotemporal  ...  They are designed to meet diverse travel demand and provide urbanites with multiple travel options in cases of service disruptions.  ... 
arXiv:2112.08078v1 fatcat:bkfw2rhsvrbs3aig5v2inwf7a4

Applying Connectivist Principles and the Task-Based Approach to the Design of a Multimodal Didactic Unit

Yeraldine Aldana Gutiérrez, Mauro Jordan Baquero Rodríguez, Gustavo Adolfo Rivero Ortiz, Dora Cenaida Romero García
2012 HOW  
As a result, a didactic unit was designed in the form of the digital book Diverface.  ...  This one in turn displayed information through different media channels and semiotic elements to support its multimodal features.  ...  Second, they had a continuous tendency to have virtual meetings in Facebook and finally, diverse Face-groups were created by students regarding their musical interests.  ... 
doaj:47cffbbde33248a082350c4cf14faa45 fatcat:qjuls6jafzanfbgt3wklxqfihe

A Novel Approach for Drug-Target Interactions Prediction Based on Multimodal Deep Autoencoder

Huiqing Wang, Jingjing Wang, Chunlin Dong, Yuanyuan Lian, Dan Liu, Zhiliang Yan
2020 Frontiers in Pharmacology  
In this paper, we proposed a novel approach MDADTI for DTIs prediction based on MDA.  ...  In addition, we validated the predictions of the MDADTI in six drug-target interactions reference databases, and the results showed that MDADTI can effectively identify unknown DTIs.  ...  BLM-NII: BLM-NII integrated Bipartite Local Model (BLM) method with a neighbor-based interaction-profile inferring (NII) procedure to form a DTI prediction approach, where the RLS classifier with GIP kernel  ... 
doi:10.3389/fphar.2019.01592 pmid:32047432 pmcid:PMC6997437 fatcat:rlviedhhnbe7xk3elkafcrwayy

VACE Multimodal Meeting Corpus [chapter]

Lei Chen, R. Travis Rose, Ying Qiao, Irene Kimbara, Fey Parrill, Haleema Welji, Tony Xu Han, Jilin Tu, Zhongqiang Huang, Mary Harper, Francis Quek, Yingen Xiong (+3 others)
2006 Lecture Notes in Computer Science  
With our focus on multimodality, we investigate the interaction among speech, gesture, posture, and gaze in meetings. For this purpose, a high quality multimodal corpus is being produced.  ...  In this paper, we report on the infrastructure we have developed to support our research on multimodal cues for understanding meetings.  ...  Any opinions, findings, and conclusions expressed in this paper are those of the authors and do not necessarily reflect the views of NSF or ARDA.  ... 
doi:10.1007/11677482_4 fatcat:nj4vz67sorfi3f26n5jwvscu24

A Multimodal Approach to Foster the Multiliteracies Pedagogy in the Teaching of EFL through Picturebooks: The Snow Lion

Agustín Reyes-Torres, Matilde Portalés Raga
2020 Atlantis  
atención a las demandas pedagógicas multimodales de un mundo digital global.  ...  Focusing on the reading of The Snow Lion (Helmore and Jones 2017), we discuss the meaningful interaction between words and images that defines picturebooks and implement the multiliteracies pedagogy approach  ...  predisposition of human attention to exist in a state of being permanently connected.  ... 
doi:10.28914/atlantis-2020-42.1.06 fatcat:dejjdnp33nhlhag34zxjo5kovq

Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception

D. Strohmeier, S. Jumisko-Pyykkö, K. Kunze
2010 Advances in Multimedia  
OPQ is targeted for naïve participants applicable to experiments with heterogeneous and multimodal stimulus material.  ...  Finally, we conclude further recommendations of use of the method in quality evaluation research.  ...  The work of the second author is supported by the Graduate School in User-Centered Information Technology (UCIT).  ... 
doi:10.1155/2010/658980 fatcat:773jlmtvwzhv7fskdqog4qgsly

Towards smart meeting

Zhiwen Yu, Motoyuki Ozeki, Yohsuke Fujii, Yuichi Nakamura
2007 Proceedings of the ninth international conference on Multimodal interfaces - ICMI '07  
This feature is helpful in activating discussion and facilitating human communication during a meeting.  ...  In this paper, we describe the enabling technologies to develop a smart meeting system based on a three layered generic model.  ...  Systems should be able to provide interactive user interface for human-system interactions.  ... 
doi:10.1145/1322192.1322210 dblp:conf/icmi/YuOFN07 fatcat:e7hcr7b6oranhgrv3vu5okmnrq

A Multimodal Data Analysis Approach for Targeted Drug Discovery Involving Topological Data Analysis (TDA) [chapter]

Muthuraman Alagappan, Dadi Jiang, Nicholas Denko, Albert C. Koong
2016 Advances in Experimental Medicine and Biology  
In this chapter, we describe a new multimodal in silico technique for the hit identifi cation and lead generation phases of traditional drug discovery.  ...  In silico drug discovery refers to a combination of computational techniques that augment our ability to discover drug compounds from compound libraries.  ...  A range of −8 to −5 kcal/mol is displayed A Multimodal Data Analysis Approach for Targeted Drug Discovery Involving… A Multimodal Data Analysis Approach for Targeted Drug Discovery Involving…  ... 
doi:10.1007/978-3-319-26666-4_15 pmid:27325272 pmcid:PMC5519345 fatcat:nqplqbru2re7hi4njgcvkpkzj4

A generative framework for multimodal learning of spatial concepts and object categories: An unsupervised part-of-speech tagging and 3D visual perception based approach

Amir Aly, Akira Taniguchi, Tadahiro Taniguchi
2017 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob)  
manner so as to understand syntactic structure of speech -and hence to infer the meaning of a sentence -in a developmentally plausible approach.  ...  This paper discusses a multimodal framework for grounding spatial concepts and object categories of language through visual perception during interaction between a human tutor and Toyota HSR robot.  ... 
doi:10.1109/devlrn.2017.8329833 dblp:conf/icdl-epirob/AlyTT17 fatcat:4dcopu4pdffm3ly6j3v7nvhozy

From members to teams to committee-a robust approach to gestural and multimodal recognition

Lizhong Wu, S.L. Oviatt, P.R. Cohen
2002 IEEE Transactions on Neural Networks  
of the MTC approach.  ...  Traditional approaches to resolving these uncertainties typically rely either on the researcher's intuition or performance evaluation on validation data, both of which result in poor generalization and  ...  A handwritten gesture recognizer was developed to serve our Quickset multimodal human-computer interface [11] .  ... 
doi:10.1109/tnn.2002.1021897 pmid:18244492 fatcat:aimhsvelkrgu5aqcs5gotaleua
« Previous Showing results 1 — 15 out of 12,516 results