Integrating context-free and context-dependent attentional mechanisms for gestural object reference

Gunther Heidemann, Robert Rae, Holger Bekel, Ingo Bax, Helge Ritter
2004 Machine Vision and Applications  
We present a vision system for human-machine interaction based on a small wearable camera mounted on glasses. The camera views the area in front of the user, especially the hands. To evaluate hand movements for pointing gestures and to recognise object references, an approach to integrating bottom-up generated feature maps and top-down propagated recognition results is introduced. Modules for contextfree focus of attention work in parallel with the hand gesture recognition. In contrast to other
more » ... approaches, the fusion of the two branches is on the sub-symbolic level. This method facilitates both the integration of different modalities and the generation of auditory feedback.
doi:10.1007/s00138-004-0157-2 fatcat:hiebvzudzrclzlglksrufu5tku