Context-based indoor object detection as an aid to blind persons accessing unfamiliar environments

Xiaodong Yang, YingLi Tian, Chucai Yi, Aries Arditi
2010 Proceedings of the international conference on Multimedia - MM '10  
Independent travel is a well known challenge for blind or visually impaired persons. In this paper, we propose a computer visionbased indoor wayfinding system for assisting blind people to independently access unfamiliar buildings. In order to find different rooms (i.e. an office, a lab, or a bathroom) and other building amenities (i.e. an exit or an elevator), we incorporate door detection with text recognition. First we develop a robust and efficient algorithm to detect doors and elevators
more » ... ed on general geometric shape, by combining edges and corners. The algorithm is generic enough to handle large intra-class variations of the object model among different indoor environments, as well as small inter-class differences between different objects such as doors and elevators. Next, to distinguish an office door from a bathroom door, we extract and recognize the text information associated with the detected objects. We first extract text regions from indoor signs with multiple colors. Then text character localization and layout analysis of text strings are applied to filter out background interference. The extracted text is recognized by using off-the-shelf optical character recognition (OCR) software products. The object type, orientation, and location can be displayed as speech for blind travelers.
doi:10.1145/1873951.1874156 dblp:conf/mm/YangTYA10 fatcat:rvuxppvv4za4lafqyvxvmv6yii