Online learning and integration of complex action and word lexicons for language grounding

Logan Niehaus, Stephen E. Levinson
2012 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL)  
This paper presents a computational framework for the development and integration of action and language capabilities through symbol grounding. Our approach is based around the fundamental technique of building lexicons of perceptual "simulators" which link noisy sensory experiences to internal symbolic representations. These sensory representations are paired with a basic model of association, allowing for the grounding of linguistic symbols directly in action knowledge -a grounding which is
more » ... en exploited to bootstrap the development of more advanced capabilities. The performance of this computational framework is tested in the context of online tutoring scenarios using the iCub robotic platform. Such an experimental environment requires development of techniques and algorithms suited for incremental learning and real-time processing.
doi:10.1109/devlrn.2012.6400812 dblp:conf/icdl-epirob/NiehausL12 fatcat:uilx7g3bynawpofforug7nwc3i