7,848 Hits in 4.5 sec

Online learning and integration of complex action and word lexicons for language grounding

Logan Niehaus, Stephen E. Levinson
2012 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL)  
This paper presents a computational framework for the development and integration of action and language capabilities through symbol grounding.  ...  Such an experimental environment requires development of techniques and algorithms suited for incremental learning and real-time processing.  ...  This enabled us to transfer meaning from basic action-word groundings to new linguistic symbols describing compositionally or hierarchically organized actions.  ... 
doi:10.1109/devlrn.2012.6400812 dblp:conf/icdl-epirob/NiehausL12 fatcat:uilx7g3bynawpofforug7nwc3i

An Embodied Model for Sensorimotor Grounding and Grounding Transfer: Experiments With Epigenetic Robots

Angelo Cangelosi, Thomas Riga
2006 Cognitive Science  
In this article, we present an embodied model for the grounding of language in action based on epigenetic robots.  ...  It uses simulated robots that learn through imitation the names of basic actions. Robots also learn higher order action concepts through the process of grounding transfer.  ...  The learning rate was 0.05 during BG learning and 0.01 during the grounding transfer process of HG1 and HG2.  ... 
doi:10.1207/s15516709cog0000_72 pmid:21702830 fatcat:uely5auctbghfpt6xfoqc4essu

Learning from Implicit Information in Natural Language Instructions for Robotic Manipulations [article]

Ozan Arkan Can and Pedro Zuidberg Dos Martires and Andreas Persson and Julian Gaal and Amy Loutfi and Luc De Raedt and Deniz Yuret and Alessandro Saffiotti
2019 arXiv   pre-print
For a robot to successfully follow instructions, a common representation of the world and objects in it should be shared between humans and the robot so that the instructions can be grounded.  ...  Achieving this representation can be done via learning, where both the world representation and the language grounding are learned simultaneously.  ...  The work is also supported by Vetenskapsrådet under the grant number: 2016-05321 and by TUBITAK under the grants 114E628 and 215E201.  ... 
arXiv:1904.13324v1 fatcat:bipl2c6ajvdbdkgf4e64h75fzi

Grounded Language Learning: Where Robotics and NLP Meet

Cynthia Matuszek
2018 Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence  
Grounded language acquisition is concerned with learning the meaning of language as it applies to the physical world.  ...  As robots become more capable and ubiquitous, there is an increasing need for non-specialists to interact with and control them, and natural language is an intuitive, flexible, and customizable mechanism  ...  Natural language is an excellent modality for end users to give instructions and teach robots about their environments.  ... 
doi:10.24963/ijcai.2018/810 dblp:conf/ijcai/Matuszek18 fatcat:zckamkyj6nch7otwqwv3ryv4vu

A Short Review of Symbol Grounding in Robotic and Intelligent Systems

Silvia Coradeschi, Amy Loutfi, Britta Wrede
2013 Künstliche Intelligenz  
The review covers a number of subtopics, that include, physical symbol grounding, social symbol grounding, symbol grounding for vision systems, anchoring in robotic systems, and learning symbol grounding  ...  The focus is in the use of symbol grounding for robotics and intelligent system.  ...  Acknowledgements We would like to thank Tony Belpaeme, Fredrik Heintz, Sven Albrecht, Angelo Cangelosi, Paul Vogt, Katerina Pastra and Sverin Lemaignan for their helpful comments to improve the article  ... 
doi:10.1007/s13218-013-0247-2 fatcat:ghimcniy6na3fk7yqf54typjiu

The use of English to offer learner support and enhance perceptual skills development in South African township schools

Nkhensani S. Thuketana, Mmamoyahabo C. Makgabo
2022 The Journal for Transdisciplinary Research in Southern Africa  
Thirdly, the use of the foreign medium of instruction affected the learners' speaking and listening skills, thus impacting language and cognitive development essential for learning.  ...  However, the inadequacy of in-service teachers' skills to assess perceptual skills development, coupled with the implementation of the teaching and learning language policy, are issues for concern, particularly  ...  The well-developed speaking skills encouraged language development and enhanced learning. Interviews The following section presents the themes that emerged from the interviews.  ... 
doi:10.4102/td.v18i1.1209 fatcat:tojljfzbn5gbbfuvgnusxiskii

Situated Action: A Neuropsychological Interpretation Response to Vera and Simon

William J. Clancey
1993 Cognitive Science  
Models involving "compiling" symbolic instructions into symbolic rules for later more-automatic processing are no better, for they still view learning as strictly linguistic manipulation.  ...  REPRESENTING AND COMPREHENDING: BREAKING OUT OF CONCEPTUAL SCHEMAS Edelman describes language in terms of symbolic categorizing, using the term "symbol" in the first-person sense as a perceptual categorization  ... 
doi:10.1207/s15516709cog1701_7 fatcat:v67el63ngrhofa7iorwcvofw2q

Language Label Learning for Visual Concepts Discovered from Video Sequences [chapter]

Prithwijit Guha, Amitabha Mukerjee
2007 Lecture Notes in Computer Science  
Computational models of grounded language learning have been based on the premise that words and concepts are learned simultaneously.  ...  The object concepts (image schemas) are abstracted from the combined appearance and motion data.  ...  Learning from Textual Narratives Data.  ... 
doi:10.1007/978-3-540-77343-6_6 fatcat:qnm2qmxskfdupmiaznkcxv43ke

Is it possible not to cheat on the Turing Test_Exploring the potential and challenges for true natural language 'understanding' by computers [article]

Lize Alberts
2022 arXiv   pre-print
In this paper, I unite all of these perspectives -- the philosophical, cognitive-linguistic, and technical -- to unpack the challenges involved in approaching true (human-like) language understanding.  ...  By unpacking the theoretical assumptions inherent in current approaches, I hope to illustrate how far we actually are from achieving this goal, if indeed it is the goal.  ...  Smit, for his support and brilliance, as well as Dr. G. Keeling, Dr. A. Kurji, and Nick for their helpful feedback and for actually reading the entire thesis.  ... 
arXiv:2206.14672v3 fatcat:tsz5l5igb5ddtdzyreisitqpru

Embodiment as a unifying perspective for psychology

Arthur M. Glenberg
2010 Wiley Interdisciplinary Reviews: Cognitive Science  
These arguments are followed by a review of approaches to embodiment, including those from cognitive linguistics, perceptual symbol theory, and action-based theories.  ...  Finally, examples are provided for how a unifying perspective might work for cognition (including language and memory), cognitive and social development, social psychology, neuroscience, clinical psychology  ...  Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author and do not necessarily reflect the views of the National Science Foundation.  ... 
doi:10.1002/wcs.55 pmid:26271505 fatcat:w56qpjs73bed3g5awlc6pqckfu

Embodiment in Mathematics Teaching and Learning: Evidence From Learners' and Teachers' Gestures

Martha W. Alibali, Mitchell J. Nathan
2012 The Journal of the Learning Sciences  
R305H060097 from the Institute of Education Sciences and by Grant No. DRL-0816406 from the National Science Foundation.  ...  We would like to thank Matthew Wolfgram, Breckie Church, and Eric Knuth for their contributions to this line of research.  ...  From this perspective, grounding in the physical, perceptual world fosters knowledge that is robust and "transportable."  ... 
doi:10.1080/10508406.2011.611446 fatcat:fhwk6hsmxjeu5lpq2nsjd3m4a4

Grounded Language Learning in a Simulated 3D World [article]

Karl Moritz Hermann, Felix Hill, Simon Green, Fumin Wang, Ryan Faulkner, Hubert Soyer, David Szepesvari, Wojciech Marian Czarnecki, Max Jaderberg, Denis Teplyashin, Marcus Wainwright, Chris Apps (+1 others)
2017 arXiv   pre-print
Trained via a combination of reinforcement and unsupervised learning, and beginning with minimal prior knowledge, the agent learns to relate linguistic symbols to emergent perceptual representations of  ...  This creates a pressing need for general means to communicate with, instruct and guide artificial agents, with human language the most compelling means for such communication.  ...  Simultaneously, we go beyond rule-based approaches to situated language understanding as our paradigm requires agents to learn end-to-end the grounding for linguistic expressions in the context of using  ... 
arXiv:1706.06551v2 fatcat:t5o6raiopjhefmrs5b4ejgf5wm

Unsupervised Alignment of Natural Language Instructions with Video Segments

Iftekhar Naim, Young Song, Qiguang Liu, Henry Kautz, Jiebo Luo, Daniel Gildea
Given a sequence of natural language instructions and an unaligned video recording, we simultaneously align each instruction to its corresponding video segment, and also align nouns in each instruction  ...  We propose an unsupervised learning algorithm for automatically inferring the mappings between English nouns and corresponding video objects.  ...  the Intel Science & Technology Center for Pervasive Computing (ISTC-PC).  ... 
doi:10.1609/aaai.v28i1.8939 fatcat:r6fht7hqizdshn5fglhql5g4ru

What Matters in Language Conditioned Robotic Imitation Learning [article]

Oier Mees, Lukas Hermann, Wolfram Burgard
2022 arXiv   pre-print
While recently substantial advances have been achieved in language-driven robotics by leveraging end-to-end learning from pixels, there is no clear and well-understood process for making various design  ...  In this paper, we conduct an extensive study of the most critical challenges in learning language conditioned policies from offline free-form imitation datasets.  ...  However, learning to follow language instructions involves addressing a difficult symbol grounding problem [5] , relating a language instruction to a robots onboard perception and actions. (2) How can  ... 
arXiv:2204.06252v1 fatcat:xnq35sp7xvelpfubinjpraec7a


2012 International journal on artificial intelligence tools  
We present the results of the system and investigate different scenarios in which we use the commonsense together with perceptual knowledge, for communication, reasoning and exchange of information.  ...  In settings where heterogenous robotic systems interact with humans, information from the environment must be systematically captured, organized and maintained in time.  ...  Also we thank Cycorp Inc. for offering their ResearchCyc platform used in this research. Finally we thank Sahar Asadi and Mathias Broxvall for their generous help with this research.  ... 
doi:10.1142/s0218213012500121 fatcat:e23fweofazfs3a6zgs4vampr34
« Previous Showing results 1 — 15 out of 7,848 results