RGB-D Sensor-Based Computer Vision Assistive Technology for Visually Impaired Persons [chapter]

Yingli Tian
2014 Advances in Computer Vision and Pattern Recognition  
A computer vision-based wayfinding and navigation aid can improve the mobility of blind and visually impaired people to travel independently. In this chapter, we focus on RGB-D sensor-based computer vision technologies in application to assist blind and visually impaired persons. We first briefly review the existing computer vision based assistive technology for the visually impaired. Then we provide a detailed description of the recent RGB-D sensor based assistive technology to help blind or
more » ... sually impaired people. Next, we present the prototype system to detect and recognize stairs and pedestrian crosswalks based on RGB-D images. Since both stairs and pedestrian crosswalks are featured by a group of parallel lines, Hough transform is applied to extract the concurrent parallel lines based on the RGB (Red, Green, and Blue) channels. Then, the Depth channel is employed to recognize pedestrian crosswalks and stairs. The detected stairs are further identified as stairs going up (upstairs) and stairs going down (downstairs). The distance between the camera and stairs is also estimated for blind users. The detection and recognition results on our collected datasets 2 demonstrate the effectiveness and efficiency of our developed prototype. We conclude the chapter by the discussion of the future directions.
doi:10.1007/978-3-319-08651-4_9 fatcat:wg5xd7wpf5ejheauiuccmwyvum