One of the major milestones to higher cognition may be the ability to shape movements that involve very complex interactions with the environment. Based on this hypothesis we argue that the study and technical replication of manual intelligence may serve as a "Rosetta Stone" for designing cognitive robot architectures. The development of such architectures will strongly benefit if improvements to their interaction capabilities in the task domain become paired with efficient modes of interaction

more »

... in the domain of configuring and restructuring such systems. We find that this "dual interaction perspective" is closely connected with the challenge of integrating holistic and symbolic aspects of representations. In the case of grasping, this requires a very tight marriage between continuous control and more discrete, symbol-like representations of contact and object states. As a concrete implementation, we propose a two layered architecture, where the lower, subsymbolic layer offers a repository of elementary dynamical processes implemented as specialised controllers for sensori-motor primitives. These controllers are represented and coordinated in the upper, symbolic layer, which employs a hierarchy of state machines. Their states represent semantically related classes of dynamic sensori-motor interaction patterns. We report on the application of the proposed architecture to a robot system comprising a 7-DOF redundant arm and a five-fingered, 20-DOF anthropomorphous manipulator. Applying the dual interaction approach, we have endowed the robot with a variety of grasping behaviours, ranging from simple grasping reflexes over visually instructed "imitation grasping" to grasping actions initiated in response to spoken commands. We conclude with a brief sketch of cognitive abilities that we now feel within close reach for the described architecture.