A Modular Software Framework for Eye–Hand Coordination in Humanoid Robots

Jürgen Leitner, Simon Harding, Alexander Förster, Peter Corke
2016 Frontiers in Robotics and AI  
We describe our software system enabling a tight integration between vision and control modules on complex, high-DOF humanoid robots. This is demonstrated with the iCub humanoid robot performing visual object detection and reaching and grasping actions. A key capability of this system is reactive avoidance of obstacle objects detected from the video stream while carrying out reach-and-grasp tasks. The subsystems of our architecture can independently be improved and updated, for example, we show
more » ... that by using machine learning techniques we can improve visual perception by collecting images during the robot's interaction with the environment. We describe the task and software design constraints that led to the layered modular system architecture.
doi:10.3389/frobt.2016.00026 fatcat:ufmfl7hdfnfj3ks7zjhrjil46q