Clearspeech: A Display Reader for the Visually Handicapped

Tim Morris, Paul Blenkhorn, Luke Crossey, Quang Ngo, Martin Ross, David Werner, Christina Wong
2006 IEEE transactions on neural systems and rehabilitation engineering  
Many domestic appliances and much office equipment is controlled using a keypad and a small digital display. Programming such devices is problematical for the blind and visually handicapped. In this paper, we describe a device that may be used to read the displays on these devices. The device is designed to accept a description of the display being read, which specifies the types and locations of elements of the display. Images are captured using a handheld webcam. Images are processed to
more » ... the distortions due to the camera orientation. The elements of the screen are interpreted and a suitable audio output is generated. In suitably illuminated scenes, the display data is interpreted correctly in approximately 90% of the cases investigated. Index Terms-Assistive devices, audio interpretation, display reader. Paul Blenkhorn researches into speech and sight rehabilitation engineering needs for people with disabilities. Assistive devices have been developed including hand-held and head-controlled systems.
doi:10.1109/tnsre.2006.881538 pmid:17190040 fatcat:tubeap2h3bartj7oo3ojslitla