Audio/video fusion for objects recognition

Loic Lacheze, Yan Guo, Ryad Benosman, Bruno Gas, Charlie Couverture
2009 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems  
In mobile robotics applications, pattern and object recognition are mainly achieved relying only on vision. Several other perceptual modalities are also available such as, touch, hearing or vestibular proprioception. They are rarely used and can provide valuable additional information within the recognition tasks. This article presents an analysis of several methods of fusion of perceptual and auditory modalitites. It relies on the use of a perspective camera and a microphone on a moving object
more » ... recognition problem. Experimental data are also provided on a database of audio/visual objects including cases of visual occlusions and audio corruptions. 978-1-4244-3804-4/09/$25.00 ©2009 IEEE
doi:10.1109/iros.2009.5354442 dblp:conf/iros/LachezeGBGC09 fatcat:q2vfillz5fagtlji5laoygaseu