Automatic detection and translation of text from natural scenes

Jie Yang, Xilin Chen, Jing Zhang, Ying Zhang, Alex Waibel
2002 IEEE International Conference on Acoustics Speech and Signal Processing  
Large amounts of information are embedded in natural scenes. Signs are good examples of natural objects with high information content. In this paper, we discuss problems in automatic detection and translation of text from natural scenes. We describe the challenges of automatic text detection and propose methods to address these challenges. We extend example based machine translation technology for sign translation and present a prototype system for Chinese sign translation. This system is
more » ... e of capturing images, automatically detecting and recognizing text, and translating the text into English. The translation can be displayed on a palm size PDA, or synthesized as a voice output message over the earphones.
doi:10.1109/icassp.2002.5745049 dblp:conf/icassp/YangCZZW02 fatcat:a6ief2hyqbaghi4vhtsn6jo3wy