57,493 Hits in 7.3 sec

Representing Communicative Function and Behavior in Multimodal Communication [chapter]

Hannes Högni Vilhjálmsson
2009 Lecture Notes in Computer Science  
In this paper I discuss how communicative behavior can be represented at two levels of abstraction, namely the higher level of communicative intent or function, which does not make any claims about the  ...  surface form of the behavior, and the lower level of physical behavior description, which in essence instantiates intent as a particular multimodal realization.  ...  The ideas presented in this paper are drawn from collaborations with numerous researchers, especially at RU/CADIA, USC/ISI and MIT, and of course in the SAIBA community.  ... 
doi:10.1007/978-3-642-00525-1_4 fatcat:rq2ua3hj3zhjlp2wdsti3yir6i

Towards a Common Framework for Multimodal Generation: The Behavior Markup Language [chapter]

Stefan Kopp, Brigitte Krenn, Stacy Marsella, Andrew N. Marshall, Catherine Pelachaud, Hannes Pirker, Kristinn R. Thórisson, Hannes Vilhjálmsson
2006 Lecture Notes in Computer Science  
We propose a three stage model we call SAIBA where the stages represent intent planning, behavior planning and behavior realization.  ...  A Function Markup Language (FML), describing intent without referring to physical behavior, mediates between the first two stages and a Behavior Markup Language (BML) describing desired physical realization  ...  CADIA participation was made possible in part by RANNÍS grant 050013021 and a Marie Curie European Reintegration Grant within the 6th European Community Framework Programme.  ... 
doi:10.1007/11821830_17 fatcat:6mnsc2q565aydhchicbihkmvwe

A Methodology for the Automatic Extraction and Generation of Non-Verbal Signals Sequences Conveying Interpersonal Attitudes

Mathieu Chollet, Magalie Ochs, Catherine Pelachaud
2017 IEEE Transactions on Affective Computing  
The contribution of this paper is a methodology for the automatic extraction of sequences of non-verbal signals characteristic of a social phenomenon from a multimodal corpus, and a non-verbal behavior  ...  This methodology is applied to design a virtual recruiter capable of expressing social attitudes, which is then evaluated in and out of an interaction context.  ...  The standard approach in the domain of ECA behavior planning models is to define a lexicon in which the mapping between communicative function and multimodal signals is defined for all the functions considered  ... 
doi:10.1109/taffc.2017.2753777 fatcat:54cvjiwiwzhehkkhitcwjsbk2i

Contextual Factors and Adaptative Multimodal Human-Computer Interaction: Multi-level Specification of Emotion and Expressivity in Embodied Conversational Agents [chapter]

Myriam Lamolle, Maurizio Mancini, Catherine Pelachaud, Sarkis Abrilian, Jean-Claude Martin, Laurence Devillers
2005 Lecture Notes in Computer Science  
In this paper we present an Embodied Conversational Agent (ECA) model able to display rich verbal and non-verbal behaviors.  ...  We describe the representation scheme and the computational model of behavior expressivity of the Expressive Agent System that we have developed.  ...  We are very grateful to Bjoern Hartmann for implementing the expressive behavior module and to Vincent Maya for his help in this project.  ... 
doi:10.1007/11508373_17 fatcat:363bu2qhmvcffawrokmea32zzu

Chemical Communication in a Multimodal Context [chapter]

Eileen A. Hebets, Aaron Rundus
2010 Chemical Communication in Crustaceans  
the conclusions that can currently be drawn with respect to multimodal signal evolution and function in crustaceans.  ...  We suggest that future studies using a hypothesis-testing framework of multimodal signal function could greatly advance our understanding of multimodal signaling in this group.  ...  In addition, we would like to thank John Christy for pointing us in the right direction for acoustical references.  ... 
doi:10.1007/978-0-387-77101-4_17 fatcat:dpby4rtbvjgphpf6pslfk7pp6q

A Natural Conversational Virtual Human with Multimodal Dialog System

Itimad Raheem Ali, Ghazali Sulong, Ahmad Hoirul Basori
2014 Jurnal Teknologi  
More specifically, its focus is on behavior planning and developing the data control languages (DCL).  ...  The making of virtual human character to be realistic and credible in real time automated dialog animation system is necessary.  ...  Generally, multimodal signals have meaning and communicative function on one hand and their visible behavior on the other.  ... 
doi:10.11113/jt.v71.3859 fatcat:rtvoojoulrhargjk6xbrkmslwe

Levels of Representation in the Annotation of Emotion for the Specification of Expressivity in ECAs [chapter]

Jean-Claude Martin, Sarkis Abrilian, Laurence Devillers, Myriam Lamolle, Maurizio Mancini, Catherine Pelachaud
2005 Lecture Notes in Computer Science  
The basis of our approach is to study how coders perceive and annotate at several levels the emotions observed in a corpus of emotionally rich TV video interviews.  ...  In this paper we present a two-steps approach towards the creation of affective Embodied Conversational Agents (ECAs): annotation of a real-life non-acted emotional corpus and animation by copy-synthesis  ...  We are very grateful to Bjoern Hartmann for implementing the expressive behavior module and to Vincent Maya for his help.  ... 
doi:10.1007/11550617_34 fatcat:vfbnoj5rtzf2xcufcxxbgl44nm

How Can a Multimodal Approach to Primate Communication Help Us Understand the Evolution of Communication?

Bridget M. Waller, Katja Liebal, Anne M. Burrows, Katie. E. Slocombe
2013 Evolutionary Psychology  
Here, we suggest that integrating phylogenetic and functional questions can be fruitful in better understanding the evolution of communication.  ...  We also suggest that adopting a multimodal approach to communication might help to integrate phylogenetic and functional questions, and provide an interesting avenue for research into language evolution  ...  Acknowledgements: This paper is based on a chapter of the book Primate Communication: A Multimodal Approach by Liebal, Waller, Burrows, and Slocombe (2013) .  ... 
doi:10.1177/147470491301100305 fatcat:bgg4gyrbcvdnpm6fjjqjhj2tsa

Agent Communication for Believable Human-Like Interactions between Virtual Characters [chapter]

Joost van Oijen, Frank Dignum
2013 Lecture Notes in Computer Science  
A middleware approach is taken to facilitate such agents in communication, hereby making a tradeoff between efficiency and believability while taking into account the real-time requirements of games and  ...  In this paper we present a model for realizing believable human-like interaction between virtual agents situated cognitively in a MAS on one side while embodied in a virtual environment within a game engine  ...  abilities to express and perceive communicative behavior and (3) a transportation medium represented by a virtual environment.  ... 
doi:10.1007/978-3-642-36444-0_3 fatcat:qsr3pi2so5bxvhlujyawqfahgq

Aesthetic multimodality of speech and gesture: Towards its functional framework

Maria Kiose, Anna Leonteva, Olga Agafonova
2022 Languages and Modalities  
The study develops a functional multimodal approach to speech and gesture behavior to explore aestheticism in more and less staged discourse of cinema and interview.  ...  This approach allows to study the aesthetic via communicative functions frameworks in multimodal discourse.  ...  Acknowledgements This research was supported by the Ministry for Education in Russia, project No. 075-03-2020-013/3 "Multimodal analysis of communicative behavior in different types of spoken discourse  ... 
doi:10.3897/lamo.2.78840 fatcat:4fpc3vt76fgfzgjrdm7owdjmae

The integration of emotional and symbolic components in multimodal communication

Marc Mehu
2015 Frontiers in Psychology  
Human multimodal communication can be said to serve two main purposes: information transfer and social influence.  ...  In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence.  ...  The Complexity of Human Communication is Reflected in Multimodal Signals The concept of multimodal communication follows the observation that social signals are complex and cover several sensory modalities  ... 
doi:10.3389/fpsyg.2015.00961 pmid:26217280 pmcid:PMC4493318 fatcat:l5p5tcqwyfdllju5gl7ipsglty

Advanced Content and Interface Personalization through Conversational Behavior and Affective Embodied Conversational Agents [chapter]

Matej Rojc, Zdravko Kačič, Izidor Mlakar
2018 Artificial Intelligence - Emerging Trends and Applications  
Namely, co-verbal behavior represents a major source of discourse cohesion. It regulates communicative relationships and may support or even replace verbal counterparts.  ...  In this chapter, we will represent a model of generation and realization of more natural machine-generated output.  ...  Artificial Intelligence -Emerging Trends and Applications  ... 
doi:10.5772/intechopen.75599 fatcat:affcoihknvffritoujjpua3sqy

Representations for Multimodal Generation: A Workshop Report

Kristinn R. Thórisson, Hannes Högni Vilhjálmsson, Catherine Pelachaud, Stefan Kopp, Norman I. Badler, W. Lewis Johnson, Stacy Marsella, Brigitte Krenn
2006 The AI Magazine  
People produce intent without any reference to phys- ing serious games for language and culture multimodal behavior with ease in real ical behavior; the interface  ...  matics and Communication (LINC).  ... 
doi:10.1609/aimag.v27i1.1871 dblp:journals/aim/ThorissonVPKBJMK06 fatcat:imk3gmnucfagxkczvntjvrwy3i

An introduction to multimodal communication

James P. Higham, Eileen A. Hebets
2013 Behavioral Ecology and Sociobiology  
We discuss the history of the study of complexity in animal communication, issues relating to defining and classifying multimodal signals, and particular issues to consider with multimodal (as opposed  ...  This interest has culminated in the production of the present special issue on multimodal communication, which features both theoretical and empirical studies from leading researchers in the field.  ...  Acknowledgments We are very grateful to Esteban Fernandez-Juricic and two anonymous reviewers for comments on a previous draft of this manuscript.  ... 
doi:10.1007/s00265-013-1590-x fatcat:krg6qy7odzgzza42rdptzwssfa

Beyond the Blue Sky of Multimodal Interaction: A Centennial Vision of Interplanetary Virtual Spaces in Turn-based Metaverse [article]

Lik Hang Lee, Carlos Bermejo Fernandez, Ahmad Alhilal, Tristan Braud, Simo Hosio, Pan Hui, Esmée Henrieke Henrieke Anne de Haas
2022 arXiv   pre-print
Human habitation across multiple planets requires communication and social connection between planets.  ...  Nevertheless, such immersive cyberspace unavoidably encounters latency in minutes, and thus operates in a turn-taking manner.  ...  In this case, the more feedback and multimodal interactions, the more risk of users stopping trusting an entity when these are not realistic or do not represent the behavior and actions of the physical  ... 
arXiv:2208.05517v1 fatcat:5eralwq2xbforcpmfnmmeniqci
« Previous Showing results 1 — 15 out of 57,493 results