Instant tactile-audio map: enabling access to digital maps for people with visual impairment

ABSTRACT

In this paper, we propose an automatic approach, complete with a prototype system, for supporting instant access to maps for local navigation by people with visual impairment. The approach first detects and segments texts from a map image and recreates the remaining graphical parts in a tactile form which can be reproduced immediately through a tactile printer. Then, it generates an SVG (Scalable Vector Graphics) file, which integrates both text and graphical information. The tactile hardcopy and the SVG file together are used to provide a user with interactive access to the map image through a touchpad, resulting in a tactile-audio representation of the original input image. This supports real-time access to the map without tedious conversion by a sighted professional. Evaluations with six users who are blind show that the created tactile-audio maps from our prototype system convey the most important map information and are deemed as potentially useful for local navigation.

REFERENCES

• 1: Google Map: http://maps.google.com/.
• 2: MapQuest: http://www.mapquest.com/.
• 3: Edman, P.K. 1992. Tactile Graphics. AFB Press, New York: American Foundation for the Blind.
• 4: Eriksson, Y. 1999. How to make tactile pictures understandable to the blind reader. 65th IFLA Council and General Conference, Bangkok, Thailand.
• 5: Jayant, C., M. Renzelmann, D. Wen, S. Krisnandi, R. Ladner, D. Comden. 2007. Automated Tactile Graphics Translation: In the Field. In proceedings of the 9th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS): 75--82.
• 6: Schneider, J. and T. Strothotte. 1999. Virtual Tactile Maps. In proceedings of the 8th International Conference on Human-Computer Interaction (HCI). Vol. 1: 531--535.
• 7: Michael J. Hudson. 1998. The Michigan State University Talking Tactile Map Project: Advancement Through Collaboration. CSUN.
• 8: Campin, B., W. McCurdy, L. Brunet, E. Siekierska. 2003. SVG Maps for People with Visual Impairment. SVG OPEN conference.
• 9: Liu, Y., S. Goto, T. Ikenaga. 2005. A Robust Algorithm for Text Detection in Color Images. In proceedings of the 8th International Conference on Document Analysis and Recognition (ICDAR): 399--405.
• 10: Kim, K. I., K. Jung, J. H. Kim. 2003. Texture-based approach for text detection in images using support vector machines and continuously adaptive mean shift algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI): vol. 25(12): 1631--1639.
• 11: Gonzalez, R and R. Woods. 2008. Digital Image Processing. Third Edition, Prentice Hall.
• 12: Duda, O. and P. Hart. 1972. Use of the Hough Transformation to Detect Lines and Curves in Pictures. Comm. ACM, vol. 15: 11--15.
• 13: Matlab software: http://www.mathworks.com/.
• 14: Nuance-Omnipage OCR SDK 16: http://www.nuance.com/omnipage/capturesdk/.
• 15: IVEO Viewer: http://www.viewplus.com/support/downloads/IVEOViewer/.
• 16: Adobe SVG Viwer: http://www.adobe.com/svg/viewer/install/.
• 17: IVEO touchpad and IVEO creator: http://www.viewplus.com/products/touch-audio-learning/IVEO/
• 18: Adobe Illustrator: http://tryit.adobe.com/us/cs4/illustrator_d/?sdid=EPTCQ.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.0 General

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O; Evaluation/methodology

General Terms:
Algorithms, Design, Experimentation, Human Factors

Keywords:
accessibility, multi-modal system, tactile map, visual impairment