Sketching images eyes-free: a grid-based dynamic drawing tool for the blind

ABSTRACT

In this paper we describe one method of transforming a mouse-based graphical user interface into a navigable, grid-based auditory interface. We also report the results of an experiment that tested the effectiveness of a drawing tool for the blind called IC2D that uses this interaction style. The experiment included eight visually impaired participants and eight blindfolded sighted participants. The results show that auditory interpretation of graphics is an effective interface technique for visually impaired users. Further, the experiment demonstrates that visually impaired users can develop meaningful drawings when given adequate technological support.

REFERENCES

• 1: AccesAbility, Inc. http://www.4access.com
• 2: ALVA Access. http://www.aagi.com/aagi/alva_products.html
• 3: Dragon NaturallySpeaking, 2002. ScanSoft. http://www.lhsl.com/naturallyspeaking/
• 4: Nomad Mentor, 2001. Quantum Technology. http://www.quantech.com.au/products/quantum_products/tactile/nomad.htm
• 5: Sample Lesson: Basic Drawing Using a Grid, 2002. Labyrinth Conceptions/HomeschoolArts. http://www.homeschoolarts.com/samplelesson.htm
• 6: Sewell Raised Line Drawing Kit. 2002, Sewell Metal Processing Corporation: Woodside, NY.
• 7: James L. Alty , Dimitrios I. Rigas, Communicating graphical information to blind users using music: the role of context, Proceedings of the SIGCHI conference on Human factors in computing systems, p.574-581, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274721]
• 8: Chieko Asakawa , Hironobu Takagi, Annotation-based transcoding for nonvisual web access, Proceedings of the fourth international ACM conference on Assistive technologies, p.172-179, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354588]
• 9: Sara Bly, Presenting information in sound, Proceedings of the 1982 conference on Human factors in computing systems, p.371-375, March 15-17, 1982, Gaithersburg, Maryland, United States [doi>10.1145/800049.801814]
• 10: Jacobson, R.D. Navigating Maps with Little or No Sight: A Novel Audio-Tactile Approach. In Proceedings of Content Visualization and Intermedia Representations: CVIR '98. Montreal, Quebec, Canada 1998.
• 11: Hesham M. Kamel , James A. Landay, Constructing moving pictures eyes-free: an animation tool for the blind, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506590]
• 12: Hesham M. Kamel , James A. Landay, The integrated communication 2 draw (IC2D): a drawing program for the visually impaired, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632854]
• 13: Hesham M. Kamel , James A. Landay, A study of blind drawing practice: creating graphical information without the visual channel, Proceedings of the fourth international ACM conference on Assistive technologies, p.34-41, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354334]
• 14: Hesham M. Kamel , James A. Landay, The use of labeling to communicate detailed graphics in a non-visual environment, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634212]
• 15: Kamel, H.M., P. Roth, and R.R. Sinha. Graphics and User's Exploration via Simple Sonics (GUESS): Providing Interrelational Representation of Objects in a Non-visual Environment. In Proceedings of Seventh International Conference on Auditory Display. Helsinki, Finland 2001.
• 16: Yoshihiro Kawai , Fumiaki Tomita, Interactive tactile display system: a support system for the visually disabled to recognize 3D objects, Proceedings of the second annual ACM conference on Assistive technologies, p.45-50, April 11-12, 1996, Vancouver, British Columbia, Canada [doi>10.1145/228347.228356]
• 17: Andrea R. Kennel, Audiograf: a diagram-reader for the blind, Proceedings of the second annual ACM conference on Assistive technologies, p.51-56, April 11-12, 1996, Vancouver, British Columbia, Canada [doi>10.1145/228347.228357]
• 18: Martin Kurze, TDraw: a computer-based tactile drawing tool for blind people, Proceedings of the second annual ACM conference on Assistive technologies, p.131-138, April 11-12, 1996, Vancouver, British Columbia, Canada [doi>10.1145/228347.228368]
• 19: Mikovec, Z. System for Picture Interpretation for Blind. In Proceedings of Seventh IFIP Conference on Human-Computer Interaction: INTERACT '99. Edinburgh, 1999.
• 20: Sarah Morley , Helen Petrie , Anne-Marie O'Neill , Peter McNally, Auditory navigation in hyperspace: design and evaluation of a non-visual hypermedia system for blind users, Proceedings of the third international ACM conference on Assistive technologies, p.100-107, April 15-17, 1998, Marina del Rey, California, United States [doi>10.1145/274497.274516]
• 21: Elizabeth Diane Mynatt, Transforming graphical interfaces into auditory interfaces, Georgia Institute of Technology, Atlanta, GA, 1996
• 22: Norman, D.A., The Design of Everyday Things. New York: Doubleday, 1990.
• 23: Helen Petrie , Sarah Morley , Gerhard Weber, Tactile-based direct manipulation in GUIs for blind users, Conference companion on Human factors in computing systems, p.428-429, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223769]
• 24: John Roberts , Oliver Slattery , David Kardos , Brett Swope, New technology enables many-fold reduction in the cost of refreshable Braille displays, Proceedings of the fourth international ACM conference on Assistive technologies, p.42-49, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354335]
• 25: Shneiderman, B., Direct Manipulation: A Step Beyond Programming Languages. IEEE Computer, 1983.16(8): p. 57--69.
• 26: Weiss, P., The Seeing Tongue: In-the-mouth electrodes give blind people a feel for vision, Science News Online, vol. 160(9), 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Auditory (non-speech) feedback

  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.2 Social Issues
          Subjects: Assistive technologies for persons with disabilities

General Terms:
Algorithms, Documentation, Experimentation, Human Factors

Keywords:
IC2D, auditory user interfaces, drawing, graphical semantic enhancement, graphics, grid, visually impaired