Refreshable tactile graphics applied to schoolbook illustrations for students with visual impairment

ABSTRACT

This article presents research on making schoolbook illustrations accessible for students with visual impairment. The MaskGen system was developed to interactively transpose illustrations of schoolbooks into tactile graphics. A methodology was designed to transpose the graphics and prepare them to be displayed on the STReSS2, a refreshable tactile device. We experimented different associations of tactile rendering and audio feedbacks to find a model that children with visual impairment could use. We experimented with three scientific graphics (diagram, bar-chart and map) with forty participants: twenty sighted adults, ten adults with visual impairment, and ten children with visual impairment. Results show that the participants with visual impairment liked the tactile graphics and could use them to explore illustrations and answer questions about their content.

REFERENCES

• 1: Campion, G., Wang, Q., and Hayward, V. The pantograph MK-II: a haptic instrument. In Proc. IROS 2005, pages 193--198, 2005.
• 2: T. Ebina , S. Igi , T. Miyake , H. Takahashi, Graph Access System for the Visually Impaired, Proceedings of the Third Asian Pacific Computer and Human Interaction, p.254, July 15-17, 1998
• 3: Dufresne, A., Martial, O. and Ramstein, C. (1995). Multimodal User Interface System for blind and "visually occupied" users: Ergonomic evaluation of the Haptic and Auditive Dimensions. In Interact'95 (pp. 163--168). Lillehamer.
• 4: Edman. P. K. Tactile Graphics. AFBPress, New York, 1992.
• 5: Gapenne, O., Rovira, K., Ammar, A. Ali and Lenay, C.. Tactos: Special computer interface for the reading and writing of 2D forms in blind people, In Universal Access in HCI, Inclusive Design in the Information Society, pages 1270--1274, 2003.
• 6: Richard E. Ladner , Melody Y. Ivory , Rajesh Rao , Sheryl Burgstahler , Dan Comden , Sangyun Hahn , Matthew Renzelmann , Satria Krisnandi , Mahalakshmi Ramasamy , Beverly Slabosky , Andrew Martin , Amelia Lacenski , Stuart Olsen , Dmitri Groce, Automating tactile graphics translation, Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility, October 09-12, 2005, Baltimore, MD, USA [doi>10.1145/1090785.1090814]
• 7: Levesque, V. and Hayward, V. Tactile Graphics Rendering Using Three Laterotactile Drawing Primitives. In Proceedings of the 16th Symposium on Haptic Interfaces For Virtual Environment And Teleoperator Systems. Reno, NV, USA, March 2008.
• 8: Maucher, T., Schemmel, J. and Meier, K. The Heidelberg Tactile Vision Substitution System. In International Conference on Computers Helping People with Special Needs (ICCHP2000). Karlsruhe, Germany, July 2000.
• 9: Christophe Ramstein , Odile Martial , Aude Dufresne , Michel Carignan , Patrick Chassé , Philippe Mabilleau, Touching and hearing GUI's: design issues for the PC-Access system, Proceedings of the second annual ACM conference on Assistive technologies, p.2-9, April 11-12, 1996, Vancouver, British Columbia, Canada [doi>10.1145/228347.228349]
• 10: Roby, J. and Paradis, C. Enjeux et Découvertes, Tome 1 (manuel de l'élève), Éditions HRW -- Group Éducalivres inc., Second trimestre, 1995.
• 11: Shinohara, M., Shimizu, Y. and Mochizuki, A. Three-Dimensional Tactile Display for the Blind. In IEEE Treansactions on Rehabilitation Engineering, Vol. 6, N° 3, pages 249--256, September 1998.
• 12: Trudeau, N. Analyse visuelle du livre, de la page et de l'image du manuel de l'élève Enjeux et découvertes. Final report of quinquinal research project, Montréal, 2000--2005.
• 13: Qi Wang , Vincent Hayward, Compact, Portable, Modular, High-performance, Distributed Tactile Transducer Device Based on Lateral Skin Deformation, Proceedings of the Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, p.10, March 25-29, 2006 [doi>10.1109/HAPTICS.2006.153]
• 14: http://www.cnib.ca/fr/apropos/publications/accessibilite/droit-de-lire/Default.aspx.
• 15: http://www.techsmith.com/morae.asp

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Ergonomics

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen); Auditory (non-speech) feedback; Haptic I/O

  K. Computing Milieux
  K.3 COMPUTERS AND EDUCATION
      K.3.1 Computer Uses in Education
          Subjects: Computer-assisted instruction (CAI)

General Terms:
Design, Experimentation, Human Factors

Keywords:
accessibility, children with special needs, multimodal device, pedagogy, students with visual impairment, tactile graphics