5,082 Hits in 9.2 sec

Modeling the Semantic Coordination of Speech and Gesture under Cognitive and Linguistic Constraints [chapter]

Kirsten Bergmann, Sebastian Kahl, Stefan Kopp
2013 Lecture Notes in Computer Science  
We present a flexible cognitive model in which both linguistic as well as cognitive constraints are considered in order to simulate natural semantic coordination across speech and gesture.  ...  This paper addresses the semantic coordination of speech and gesture, a major prerequisite when endowing virtual agents with convincing multimodal behavior.  ...  What we present in this paper is a flexible cognitive model that simulates natural semantic coordination of speech and iconic gesture, accounting for information distribution and packaging under dynamically  ... 
doi:10.1007/978-3-642-40415-3_18 fatcat:psa7p5jgmjbcbivrgoldf5s4eq

Production and Interaction between Gesture and Speech: A Review

Ying Gao, Yuqin Liu, Chunyue Zhou
2016 International Journal of English Linguistics  
Most of theories argue that gesture stems from the visual-spatial images in working memory; some models approve of the interactive relationship while others consider no interaction between gesture and  ...  Some hypotheses or models about production and interaction between gesture and speech are introduced and compared in this paper.  ...  Acknowledgments The authors acknowledge the support of Project of the NO.  ... 
doi:10.5539/ijel.v6n2p131 fatcat:rcz5wthhkbe7zi7nlavmq6phey

Ecological meaning, linguistic meaning, and interactivity

Sune Vork Steffensen, Matthew Isaac Harvey
2018 Cognitive Semiotics  
Symbols as constraints: The structuring role of dynamics and self-organization in natural language. Pragmatics and Cognition 17(3). 653–676. DOI:10.1075/pandc.17.3.09ras; Rączaszek-Leonardi, J. 2016.  ...  Oxford: Oxford University Press) semiotic view of symbols, arguing that the properties ascribed to linguistic symbols, both by Deacon and very widely throughout the cognitive sciences, are not properties  ...  for his extremely detailed and helpful critique of our position.  ... 
doi:10.1515/cogsem-2018-0005 fatcat:xtt7tekd2nadbbe7fbshpsygim


2012 Anuari de Filologia. Estudis de Lingüística  
The foundational claim of the language in motion framework is that language and gesture are manifestations of a general human expressive ability which is grounded in embodied cognition and the need for  ...  Called the language as motion framework, it relies on three broad theories: cognitive grammar, dynamic systems, and cognitive neuroscience.  ...  The same dynamic models that account for the emergence of coordinative structures in skilled movement, such as fluent fingerspelling, speech, sign, or gesture, are recruited to explain cognition.  ... 
doi:10.1344/afel2012.2.4 fatcat:lu3hs6nszbgqpmmn4qii55n64e

Linguistic embodiment and verbal constraints: human cognition and the scales of time

Stephen J. Cowley
2014 Frontiers in Psychology  
Using radical embodied cognitive science, the paper offers the hypothesis that language is symbiotic: its agent-environment dynamics arise as linguistic embodiment is managed under verbal constraints.  ...  The latter arise in making and tracking phonetic gestures that, crucially, mesh use of artifice, cultural products and impersonal experience.  ...  Human dialogicality neither reduces to conventional use of form/meaning nor to typologies of speech act. No "pure" linguistic or cognitive model can show how mother and daughter coordinate.  ... 
doi:10.3389/fpsyg.2014.01085 pmid:25324799 pmcid:PMC4183103 fatcat:qqi7ubwr75agzilesrlwp2dpee

Aligning speech and co-speech gesture in a constraint-based grammar

Katya Alahverdzhieva, Alex Lascarides, Dan Flickinger
2018 Journal of Language Modelling  
In face to face conversation, people exchange information via a range of meaningful and visibly accessible communication channels (Goffman 1963); in particular they use "visible bodily actions"  ...  , linguistic syntax and relative timing of speech and co-speech gesture.  ...  , producing ulfs of speech and gesture using standard methods of syntactic derivation and semantic composition from linguistics.  ... 
doi:10.15398/jlm.v5i3.167 fatcat:gg52yhs4mngrvmolilwvyyplee

Languaging Behaviour as Catalytic Process: Steps Towards a Theory of Living Language (PART I)

Paul J. Thibault
1970 The public journal of semiotics  
cultural norms, the modeling of speech in terms of writing, and so on.  ...  Cognition arises out of coordinated languaging behaviour as diverse factors are semantically synthesized in linguistic catalysis and integrated to core consciousness (Damasio 2010: 205-207) .  ... 
doi:10.37693/pjos.2011.3.8833 fatcat:fknp6qtxpvbndfzrr7oxhnui3u

Coordination and context-dependence in the generation of embodied conversation

Justine Cassell, Matthew Stone, Hao Yan
2000 Proceedings of the first international conference on Natural language generation - INLG '00  
We accomplish this by reasoning from a grammar which describes gesture declaratively in terms of its discourse function, semantics and synchrony with speech.  ...  the ongoing speech in ways representative of natural human conversation.  ...  Acknowledgments The research reported here was supported by NSF (award IIS-9618939), Deutsche Telekom, AT&T, and the other generous sponsors of the MIT Media Lab, and a postdoctoral fellowship from RUCCS  ... 
doi:10.3115/1118253.1118277 dblp:conf/inlg/CassellSY00 fatcat:k3bbz2rpqrhkpbjw3vu33tmxie

Beyond the sentence given

P. Hagoort, J. van Berkum
2007 Philosophical Transactions of the Royal Society of London. Biological Sciences  
co-speech gestures or the visual world.  ...  In a second step, the sentence meaning is integrated with information from prior discourse, world knowledge, information about the speaker and semantic information from extra-linguistic domains such as  ...  To determine the nature of the integration of verbal and gestural semantic information, we manipulated the semantic fit of speech (i.e. a critical verb) and/or gesture in relation to the preceding part  ... 
doi:10.1098/rstb.2007.2089 pmid:17412680 pmcid:PMC2429998 fatcat:mmatxbdacfacpfio662htheoma

The Role of Gesture in Communication and Cognition: Implications for Understanding and Treating Neurogenic Communication Disorders

Sharice Clough, Melissa C. Duff
2020 Frontiers in Human Neuroscience  
The neuroanatomical and behavioral profiles of these patient populations provide a unique opportunity to test theories of the relationship of speech and gesture and advance our understanding of their neural  ...  We review a robust literature from the field of psychology documenting the benefits of gesture for communication for both speakers and listeners, as well as its important cognitive functions for organizing  ...  The Sketch Model (de Ruiter, 2000) for gesture and speech production is an expansion of Levelt's classical speech production model and differs from McNeill's Growth Point Theory in that speech and gesture  ... 
doi:10.3389/fnhum.2020.00323 pmid:32903691 pmcid:PMC7438760 fatcat:z7vnwwzkuzdx7ehedu4bkltyly

Speakers adapt gestures to addressees' knowledge: implications for models of co-speech gesture

Alexia Galati, Susan E. Brennan
2013 Language, Cognition and Neuroscience  
We discuss the implications for models of co-speech gesture production.  ...  In an experiment, we teased apart communicative from cognitive constraints upon multiple dimensions of speech-accompanying gestures in spontaneous dialogue.  ...  We thank our colleagues from the Adaptive Spoken Dialogue Project, the Shared Gaze Project, the Dialogue Matters Network (funded by Leverhulme Trust), and the Gesture Focus Group for many helpful discussions  ... 
doi:10.1080/01690965.2013.796397 fatcat:rod7cqh7fvdxbbymysiolgn254

Page 2024 of Psychological Abstracts Vol. 81, Issue 5 [page]

1994 Psychological Abstracts  
Gestures are exposed by means of indexical uses of gaze and language. This coordination becomes visible under “microscopic” viewing of videotapes.  ...  (U Texas, Austin) Gesture as com- Its coordination gaze and speech. Commu- nication Sone 1993(Dec), Vol 60(4), 275-299.  ... 

A Formal Semantic Analysis of Gesture

A. Lascarides, M. Stone
2009 Journal of Semantics  
In this paper, we bridge the descriptive tradition with formal models of reference and discourse structure so as to articulate an approach to the interpretation of these productive gestures.  ...  Our work emphasises the commonality of the pragmatic mechanisms for interpreting both language and gesture, and the place of formal methods in discovering the principles and knowledge that those mechanisms  ...  This work has been presented at several workshops and conferences: the . We would like to thank the participants of these for their very useful comments and feedback.  ... 
doi:10.1093/jos/ffp004 fatcat:7ag5hqa45nfqdectrfyam63jiu

Evaluating Semantic Co-creation by Using a Marker as a Linguistic Constraint Tool in Shared Cognitive Representation Models [chapter]

Stefan Schneider, Andreas Nürnberger
2021 Language, Cognition, and Mind  
We assess two main factors, the teams' use of a shared marker and the two complexity levels of the cognitive representation model.  ...  Our study aims at investigating the advantage of using shared markers as a linguistic constraint tool in semantic co-creation, while moving them becomes optional.  ...  Acknowledgements The authors would like to thank Mr. Jan Ziehme for his support in developing the survey tool used to evaluate the results. Further, we thank Mrs. Lena Wiest and Mrs.  ... 
doi:10.1007/978-3-030-69823-2_6 fatcat:ib2rt6y5rbb7xknato6ahiajd4

Page 698 of Contemporary Psychology Vol. 42, Issue 8 [page]

1997 Contemporary Psychology  
This relation plays a central role in the work of several authors in the book: Saltzman on speech (articulatory gesture dynamics) production, Browman and Goldstein on articulatory gestures and speech perception  ...  Indeed, Kelso's strategy of modeling the coordi- nation of action and perception as the stable states of a dynamical system is de- veloped in the chapters by Thelen and by Carello and Turvey.  ... 
« Previous Showing results 1 — 15 out of 5,082 results