Integrating Context-Free and Context-Dependent Attentional Mechanisms for Gestural Object Reference [chapter]

Gunther Heidemann, Robert Rae, Holger Bekel, Ingo Bax, Helge Ritter
2003 Lecture Notes in Computer Science  
We present a vision system for human-machine interaction based on a small wearable camera mounted on glasses. The camera views the area in front of the user, especially the hands. To evaluate hand movements for pointing gestures and to recognise object references, an approach to integrating bottom-up generated feature maps and top-down propagated recognition results is introduced. Modules for contextfree focus of attention work in parallel with the hand gesture recognition. In contrast to other
more » ... approaches, the fusion of the two branches is on the sub-symbolic level. This method facilitates both the integration of different modalities and the generation of auditory feedback.
doi:10.1007/3-540-36592-3_3 fatcat:vqemcvw5ere4xmvitcxex73nwy