Wearable Subtitles

Alex Olwal, Kevin Balke, Dmitrii Votintcev, Thad Starner, Paula Conn, Bonnie Chinh, Benoit Corda
2020 Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology  
Figure 1 . Our Wearable Subtitles proof-of-concept shows how eyewear could benefit people who are deaf or hard of hearing. We explore hands-free access to spoken communication, situational and speaker awareness, and improved understanding while engaged in a primary task. Our lightweight (54 g) 3D-printed eyewear prototype augments the user's perception of speech and sounds in a socially acceptable form factor with an architecture that could enable up to 15 hours of continuous transcription.
more » ... RACT Mobile solutions can help transform speech and sound into visual representations for people who are deaf or hard-ofhearing (DHH). However, where handheld phones present challenges, head-worn displays (HWDs) could further communication through privately transcribed text, handsfree use, improved mobility, and socially acceptable interactions. Wearable Subtitles is a lightweight 3D-printed proof-ofconcept HWD that explores augmenting communication through sound transcription for a full workday. Using a lowpower microcontroller architecture, we enable up to 15 hours of continuous use. We describe a large survey (n=501) and three user studies with 24 deaf/hard-of-hearing participants which inform our development and help us refine our prototypes. Our studies and prior research identify critical challenges for the adoption of HWDs which we address through extended battery life, lightweight and balanced mechanical design (54 g), fitting options, and form factors that are compatible with current social norms.
doi:10.1145/3379337.3415817 dblp:conf/uist/OlwalBVSCCC20 fatcat:7uw7wwbnqreafkzup5kkixiq4q