906 Hits in 5.2 sec

TTS-driven Embodied Conversation Avatar for UMB-SmartTV

Matej Rojc, Zdravko Kačič, Marko Presker, Izidor Mlakar
2021 International journal of computers and communications  
At the end, the generated speech and co-verbal behavior are animated by an embodied conversational agent (ECA) engine and represented to the user within the UMB-SmarTV user interface.  ...  In this paper a TTS-driven behavior generation system is proposed for more advanced interface used for smart IPTV platforms.  ...  In this paper an integration of TTS-driven embodied conversational agent technology into smart TV platforms is presented.  ... 
doi:10.46300/91013.2021.15.1 fatcat:6wo2rrbp3ffqdib7gsfcdvjyri

Automated Gesturing for Virtual Characters: Speech-driven and Text-driven Approaches

Goranka Zoric, Karlo Smid, Igor S. Pandzic
2006 Journal of Multimedia  
Index Terms-facial gesturing, lip sync, visual TTS, embodied conversational agent  ...  We present two methods for automatic facial gesturing of graphically embodied animated agents. In one case, conversational agent is driven by speech in automatic Lip Sync process.  ...  Research on autonomous speaker agent is partly supported by Ericsson Nikola Tesla (ETK).  ... 
doi:10.4304/jmm.1.1.62-68 fatcat:trxeqlytqrhwznx3bncn3kj2gu

Introduction to the special issue on auditory-visual expressive speech and gesture in humans and machines

Jeesun Kim, Gérard Bailly, Chris Davis
2018 Speech Communication  
However, for tasks that work better with more engaging personalization, richer feedback and more natural conversation, embodied conversational agents (ECA, see Cassell, 2000) that provide co verbal and  ...  Karras et al, 2017 , for speech driven generation of facial movements).  ... 
doi:10.1016/j.specom.2018.02.001 fatcat:b24ppr7mfbhmjorrb46nmxisa4

Towards a Multimedia Knowledge-Based Agent with Social Competence and Human Interaction Capabilities

Leo Wanner, Ioannis Kompatsiaris, Elisabeth André, Florian Lingenfelser, Gregor Mehlmann, Andries Stam, Ludo Stellingwerff, Bianca Vieru, Lori Lamel, Wolfgang Minker, Louisa Pragst, Josep Blat (+8 others)
2016 Proceedings of the 1st International Workshop on Multimedia Analysis and Retrieval for Multimodal Interaction - MARMI '16  
We present work in progress on an intelligent embodied conversation agent in the basic care and healthcare domain.  ...  It is composed of an ontology-based and reasoning-driven dialogue manager, multimodal communication analysis and generation modules and a search engine for the retrieval of multimedia background content  ...  Non-verbal communication generation The conversational agent is realized as an embodied conversational agent (ECA), which enables us to use verbal and non-verbal modi for communication.  ... 
doi:10.1145/2927006.2927011 dblp:conf/mir/WannerBDDLMSKVK16 fatcat:h5znrszjszcujenxbw7zl2w7ui

TTS-Driven Synthetic Behaviour-Generation Model for Artificial Bodies

Izidor Mlakar, Zdravko Kačič, Matej Rojc
2013 International Journal of Advanced Robotic Systems  
Embodied conversational agents (ECAs), as well as humanoid robots, are visual recreations of humans and are thus expected to be able to perform similar behaviour in communication.  ...  Visual content and content presentation is formulated based on several linguistic features that are extrapolated from arbitrary input text sequences and prosodic features (e.g., pitch, intonation, stress  ...  of coverbal gestures by using synthetic embodied conversational agents and robots.  ... 
doi:10.5772/56870 fatcat:ke7ci7srvnhnrgok62mtxsaxvi

Specifying and animating facial signals for discourse in embodied conversational agents

Doug DeCarlo, Matthew Stone, Corey Revilla, Jennifer J. Venditti
2004 Computer Animation and Virtual Worlds  
These signals represent a key challenge for animated conversational agents because they are pervasive, variable, and need to be coordinated judiciously in an effective contribution to conversation.  ...  facial movement for American English speakers.  ...  With the surge of interest in interfaces that engage in natural embodied conversation, as seen in recent surveys of embodied conversational agents 54 , we expect that RUTH will provide a helpful resource  ... 
doi:10.1002/cav.5 fatcat:hwhch5fi55dcdoadh6syx45t2u

Design of a Knowledge-Based Agent as a Social Companion

Leo Wanner, Elisabeth André, Josep Blat, Stamatia Dasiopoulou, Mireia Farrús, Thiago Fraga, Eleni Kamateri, Florian Lingenfelser, Gerard Llorach, Oriol Martínez, Georgios Meditskos, Simon Mille (+8 others)
2017 Procedia Computer Science  
The core of the agent is an ontology-based knowledge model that supports flexible reasoning-driven conversation planning strategies.  ...  We present work in progress on an intelligent embodied conversation agent that is supposed to act as a social companion with linguistic and emotional competence in the context of basic and health care.  ...  Eloquence presupposes full-fledged (multilingual) text generation, while most of the agents use predefined sentence templates for linguistic realization 1, 29 .  ... 
doi:10.1016/j.procs.2017.11.119 fatcat:ued655vt5rahfoqajlednkurl4

Towards Facial Gestures Generation by Speech Signal Analysis Using HUGE Architecture [chapter]

Goranka Zoric, Karlo Smid, Igor S. Pandzic
2009 Lecture Notes in Computer Science  
Information needed for generation of facial gestures is extracted from speech prosody by analyzing natural speech in real-time.  ...  Motivation behind this work is computer-generated human correspondent, ECA.  ...  The work was partly carried out within the research project "Embodied Conversational Agents as interface for networked and mobile services" supported by the Ministry of Science, Education and Sports of  ... 
doi:10.1007/978-3-642-00525-1_11 fatcat:tizzuzvgvfettm6622e53jxvpa

Advanced Content and Interface Personalization through Conversational Behavior and Affective Embodied Conversational Agents [chapter]

Matej Rojc, Zdravko Kačič, Izidor Mlakar
2018 Artificial Intelligence - Emerging Trends and Applications  
The CAs range from chatbots and 2D, carton-like implementations of talking heads to fully articulated embodied conversational agents performing interaction in various concepts.  ...  Conversation is becoming one of the key interaction modes in HMI. As a result, the conversational agents (CAs) have become an important tool in various everyday scenarios.  ...  Embodied conversational agents (ECAs) are nowadays the most natural selection for the generation of affective and personalized agents.  ... 
doi:10.5772/intechopen.75599 fatcat:affcoihknvffritoujjpua3sqy

EAVA: A 3D Emotive Audio-Visual Avatar

Hao Tang, Yun Fu, Jilin Tu, Thomas S. Huang, Mark Hasegawa-Johnson
2008 2008 IEEE Workshop on Applications of Computer Vision  
In this paper, the various technical approaches of a novel framework leading to a text-driven 3D Emotive Audio-Visual Avatar (EAVA) are proposed.  ...  Promising potential improvements can be expected by incorporating various data-driven statistical learning models into the framework.  ...  We have been conducting basic research leading to methodologies and algorithms for constructing a text-driven 3D Emotive Audio-Visual Avatar (EAVA).  ... 
doi:10.1109/wacv.2008.4544003 dblp:conf/wacv/TangFTHH08 fatcat:ojxu52bvjve5vj6z36fh5cgt5m

An End-to-End Conversational Style Matching Agent [article]

Rens Hoegen, Deepali Aneja, Daniel McDuff, Mary Czerwinski
2019 arXiv   pre-print
The system uses a series of deep neural network components for speech recognition, dialogue generation, prosodic analysis and speech synthesis to generate language and prosodic expression with qualities  ...  Users with high consideration conversational styles reported the agent to be more trustworthy when it matched their conversational style.  ...  REA (an embodied real-estate agent) [3] , SARA (socially-aware robot assistant) [22] and SimSensei (an embodied conversational agent used for healthcare interviews) [9] , are some examples of conversational  ... 
arXiv:1904.02760v1 fatcat:jlhwkynlbbg4hbphkwlxnbz4v4

A Review of Evaluation Practices of Gesture Generation in Embodied Conversational Agents [article]

Pieter Wolfert, Nicole Robinson, Tony Belpaeme
2021 arXiv   pre-print
Embodied Conversational Agents (ECA) take on different forms, including virtual avatars or physical agents, such as a humanoid robot.  ...  Co-speech gestures for ECAs can be created using different generation methods, such as rule-based and data-driven processes.  ...  Search Strategy This review focuses on evaluation studies of co-speech gesture generation methods for embodied conversational agents.  ... 
arXiv:2101.03769v1 fatcat:it4zzxilvfd3lfitxswzhch3ke

On creating multimodal virtual humans—real time speech driven facial gesturing

Goranka Zoric, Rober Forchheimer, Igor S. Pandzic
2010 Multimedia tools and applications  
In this paper we present a novel method for automatic speech driven facial gesturing for virtual humans capable of real time performance.  ...  Further, we test the method using an application prototype-a system for speech driven facial gesturing suitable for virtual presenters.  ...  Acknowledgments The work was partly carried out within the research project "Embodied Conversational Agents as interface for networked and mobile services" supported by the Ministry of Science, Education  ... 
doi:10.1007/s11042-010-0526-y fatcat:ipjwyqaxuneu7esmph4s4slu5a

All Together Now [chapter]

Arno Hartholt, David Traum, Stacy C. Marsella, Ari Shapiro, Giota Stratou, Anton Leuski, Louis-Philippe Morency, Jonathan Gratch
2013 Lecture Notes in Computer Science  
While virtual humans are proven tools for training, education and research, they are far from realizing their full potential.  ...  We help address this challenge by introducing the ICT Virtual Human Toolkit 1 , which offers a flexible framework for exploring a variety of different types of virtual human systems, from virtual listeners  ...  GRETA [11] is a SAIBA compliant embodied conversational agent that focuses less on natural language interaction and more on affective nonverbal behavior generation and realization.  ... 
doi:10.1007/978-3-642-40415-3_33 fatcat:2dcigna2xfbqhgiyi42233ztxu

Multilingual and Multimodal Corpus-Based Text-to-Speech System - PLATTOS - [chapter]

Matej Rojc, Izidor Mlakar
2011 Speech and Language Technologies  
If we were to have more appropriate social responses from the machine through personification of the TTS system by using embodied conversational agents (ECA), people will more readily respond with emotive  ...  In this way (at the sentence level) the text-to-speech process continues until acoustic dequeue, where the speech signal for the corresponding sentence is finally generated.  ...  Embodied conversational agents (ECA's) are widely used concepts for the visualization of conversation and are used in many spoken dialogue systems.  ... 
doi:10.5772/16245 fatcat:ga3vmxvvevcx3a4352oehbwcky
« Previous Showing results 1 — 15 out of 906 results