Toward accessible 3D virtual environments for the blind and visually impaired

ABSTRACT

3D virtual environments are increasingly used for education, business and recreation but are often inaccessible to users who are visually impaired, effectively creating a digital divide. Interviews with 8 visually impaired expert users were conducted to guide design proposals, and a review of current research into haptics and 3D sound for auditory displays is presented with suggestions for navigation and feedback techniques to address these accessibility issues. The diversity and volatility of the environment makes Second Life an unusually complex research object, suggesting the applicability of our work for the field of HCI and accessibility in 3D virtual environments.

REFERENCES

• 1: Audioquake. {version 0.3.0rc1 "glacier'}. Accessible Gaming Rendering Independence Possible. <http://www.agrip.org.uk/AudioQuake>, Last accessed 19th October 2007.
• 2: G. Adams-Spink. Virtual worlds open up to blind. BBC, September 18th 2007.
• 3: AudioGames.net. Audiogame.net forum. <http://forum.audiogames.net/>, Last accessed 11th May 2008.
• 4: Audyssey.org. Gamers -- gamers discussion list. <http://audyssey.org/mailman/listinfo/gamers_audyssey.org>, Last accessed 11th May 2008.
• 5: Blizzard Entertainment Inc. World of warcraft community site. <http://www.worldofwarcraft.com/index.xml>, Last accessed 12th May 2008.
• 6: British Computer Association of the Blind. British computer association of the blind website. <http://www.bcab.org.uk/>, Last accessed 11th May 2008.
• 7: B. Caldwell, M. Cooper, L. G. Reid, and G. Vanderheiden. Web content accessibility guidelines 2.0. <http://www.w3.org/TR/WCAG20/>, Last accessed 11th May 2008.
• 8: W. S. Carter and G. D. Corona. Untangling the web - exploring methods of accessing virtual worlds. AFB Access World, 9(2), March 2008. Last accessed 10th April 2008.
• 9: W. Chisholm, G. Vanderheiden, and I. Jacobs. Web content accessibility guidelines 1.0. <http://www.w3.org/TR/WCAG10/>, Last accessed 11th May 2008.
• 10: Croquet. The Croquet Consortium. <http://www.opencroquet.org/index.php/Main_Page>, Last accessed 9th April 2008.
• 11: Economist. Wonders of the metaverse. The Economist, April 20th 2006. Last accessed 19th December 2007.
• 12: E. Folmer. textsl - a blind accessible client for secondlife. <http://code.google.com/p/textsl/>, Last accessed 25th April 2008.
• 13: JAWS for windows. {version 9.0}. Freedom Scientific. <http://www.freedomscientific.com/fs_products/software_jaws.asup>, Last accessed 19th December 2007.
• 14: T. Froese and A. Spiers. Toward a phenomenological pragmatics of enactive perception, November 2007. <http://cogprints.org/5889/>.
• 15: T. Froese and A. Spiers. The enactive torch. <http://enactivetorch.wordpress.com/>, Last accessed 2nd May 2008.
• 16: T. A. Funkhouser, N. Tsingos, I. Carlbom, G. Elko, M. Sondhi, and J. West. Interactive acoustic modeling for virtual environments, July 2nd 2007. <http://www.cs.princeton.edu/~funk/acoustics.html>, Last accessed 22nd November 2007.
• 17: Game-Accessibility.com. Games accessibility forum. <http://www.game-accessibility.com/forum>, Last accessed 11th May 2008.
• 18: Google earth. {version 4.3 Beta}. Google. <http://earth.google.com/>, Last accessed 11th May 2008.
• 19: M. Grimshaw. The acoustic ecology of the first-person shooter. PhD thesis, 2007. <http://www.wikindx.com/mainsite/phd.html>.
• 20: M. Gröhn, T. Lokki, and T. Takala. Comparison of auditory, visual, and audiovisual navigation in a 3d space. In Proc. 9th Intl. Conf. Auditory Display (ICAD 2003), pages 200--203, July 6--9th 2003.
• 21: Matti Gröhn , Tapio Lokki , Tapio Takala, Author's comments on Gröhn, Lokki, and Takala, ICAD 2003, ACM Transactions on Applied Perception (TAP), v.2 n.4, p.571-573, October 2005 [doi>10.1145/1101530.1101559]
• 22: Matti Gröhn , Tapio Lokki , Tapio Takala, Comparison of auditory, visual, and audiovisual navigation in a 3D space, ACM Transactions on Applied Perception (TAP), v.2 n.4, p.564-570, October 2005 [doi>10.1145/1101530.1101558]
• 23: Wilko Heuten , Daniel Wichmann , Susanne Boll, Interactive 3D sonification for the exploration of city maps, Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, p.155-164, October 14-18, 2006, Oslo, Norway [doi>10.1145/1182475.1182492]
• 24: Quake. Id Software, Inc. (Published by GT Interactive). <http://www.idsoftware.com/games/quake/quake/>, Last accessed 25th April 2008.
• 25: International Game Developers Association. games_access -- igda games accessibility sig mailing list. <http://seven.pairlist.net/mailman/listinfo/games_access>, Last accessed 11th May 2008.
• 26: International Game Developers Association. Igda forums - accessibility. <http://www.igda.org/Forums/forumdisplay.php?forumid=189>, Last accessed 11th May 2008.
• 27: IT Accessibility & Workforce Division (ITAW). Section 508: The road to accessibility. <<http://www.section508.gov/>, Last accessed 12th May 2008.
• 28: Joint Information Systems Committee. Techdis. <http://www.techdis.ac.uk/>, Last accessed 19th April 2008.
• 29: Tapio Lokki , Matti Grohn, Navigation with Auditory Cues in a Virtual Environment, IEEE MultiMedia, v.12 n.2, p.80-86, April 2005 [doi>10.1109/MMUL.2005.33]
• 30: Maurizio Pascale , Sara Mulatto , Domenico Prattichizzo, Bringing Haptics to Second Life for Visually Impaired People, Proceedings of the 6th international conference on Haptics: Perception, Devices and Scenarios, June 10-13, 2008, Madrid, Spain [doi>10.1007/978-3-540-69057-3_112]
• 31: MIS Web Design Limited. Accessify forum: Accessible discussion forums. <http://www.accessifyforum.com/>, Last accessed 11th May 2008.
• 32: MSDN. Microsoft active accessibility. <http://msdn2.microsoft.com/en-us/library/ms697707.aspx>, Last accessed 19th December 2007.
• 33: Nintendo. Wii at nintendo. <http://www.nintendo.com/wii>, Last accessed 3rd May 2008.
• 34: Novint. Falcon. <http://home.novint.com/products/novint_falcon.php>, Last accessed 3rd May 2008.
• 35: Terraformers. Pin Interactive. <http://www.terraformers.nu/>, Last accessed 19th October 2007.
• 36: Crackdown. Real Time Worlds. (Published by Microsoft Game Studios). <http://crackdownoncrime.com/>, Last accessed 25th April 2008.
• 37: Reuben. The second half of second life: Haptics. Millions of Us, August 5th 2006.
• 38: Reuters. US dollars spent in second life over last 24 hours. <http://secondlife.reuters.com/stories/category/second-life/>, Last accessed 25th April 2008.
• 39: Torben Schou , Henry J. Gardner, A Wii remote, a game engine, five sensor bars and a virtual reality theatre, Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces, November 28-30, 2007, Adelaide, Australia [doi>10.1145/1324892.1324941]
• 40: Second Life. Economic statistics. <http://secondlife.com/whatis/economy_stats.php>, Last accessed 25th of April, 2008.
• 41: SensAble Technologies. PHANTOM premium - sensable. <http://www.sensabledental.com/haptic-phantom-premium.htm>, Last accessed 25th April 2008.
• 42: Sony Corporation. Playstationhome.com - global website. <http://playstationhome.com/>, Last accessed 12th May 2008.
• 43: Sound Foresight. Ultracane - the electronic mobility aid for blind and visually impaired. <http://www.soundforesight.co.uk/new/index.htm>, Last accessed 27th April 2008.
• 44: Half life 2. Valve Corporation. <http://www.half-life2.com/>, Last accessed 25th April 2008.
• 45: J. VanDrimmelen. Haptic education - adding the tactile sensation to virtual learning. <http://haptic.edutechie.com/research/>, Last accessed 9th April 2008.
• 46: D. Waters and H. Abulula. The virtual bat: echolocation in virtual reality. In J. Hiipakka, N. Zacharov, and T. Takala, editors, Intl. Conf. Auditory Displays (ICAD). Helsinki University of Technology, July 29th - August 1st, 2001 2001.
• 47: G. R. White. Blindsecondlife - a second life client for the visually impaired. <http://code.google.com/p/blindsecondlife/>, Last accessed 19th April 2008.
• 48: G. R. White. Second life for the visually impaired: Blind volunteers needed. <http://blindsecondlife.blogspot.com/2008/02/blind-volunteers-needed.html>, Last accessed 11th May 2008.

INDEX TERMS

Primary Classification:
  K. Computing Milieux
  K.4 COMPUTERS AND SOCIETY
      K.4.2 Social Issues
          Subjects: Assistive technologies for persons with disabilities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Haptic I/O; Auditory (non-speech) feedback; User-centered design

General Terms:
Design, Human Factors

Keywords:
3D, MUVE, Second Life, accessibility, haptics, multi-user virtual environment, multimodal feedback, sonification, visual impairment