An exploratory study on non-visual mobile phone interfaces for games

ABSTRACT

Conventional games (computer, mobile, and console) rely heavily on visual information to convey the gameplay and to drive the interaction with the player. With the rapid evolution of graphics hardware and Computer Graphics, this becomes more pronounced. An undesirable consequence of this trend is that visually-impaired people get more excluded from the play. Mobile phones are pervasive nowadays, and can reach a potentially large user base, including the visually-impaired. However, in mobile gaming there seems to be only few alternatives to serve this community. This work presents an exploratory study on non-visual mobile phone interfaces for games. It is based on Semiotic Engineering principles, and emphasizes communication through aural, tactile and gestural signs. Results include a number of issues that can be incorporated to a wider research agenda about mobile gaming accessibility.

REFERENCES

• 1: Clarisse Sieckenius deSouza, The Semiotic Engineering of Human-Computer Interaction (Acting with Technology), The MIT Press, 2005
• 2: Ernest Adams , Andrew Rollings, Fundamentals of Game Design (Game Design and Development Series), Prentice-Hall, Inc., Upper Saddle River, NJ, 2006
• 3: Pippin Barr , James Noble , Robert Biddle, Video game values: Human-computer interaction and games, Interacting with Computers, v.19 n.2, p.180-195, March, 2007 [doi>10.1016/j.intcom.2006.08.008]
• 4: Karl-Erik Bystrom , Woodrow Barfield , Claudia Hendrix, A Conceptual Model of the Sense of Presence in Virtual Environments, Presence: Teleoperators and Virtual Environments, v.8 n.2, p.241-244, April 1999 [doi>10.1162/105474699566107]
• 5: Cai, Y. The New Frontier: Portable and Mobile Gaming. Park & Associates Report. www.parksassociates.com/research/reports/tocs/2008/mobilegaming.htm.
• 6: Caillois, R. Man, Play and Games. Univ. of Illinois Press, Champaign, IL, USA, 2001.
• 7: Caldwell, N. Theoretical frameworks for analysing turn-based computer strategy games. Media International Australia Incorporating Culture and Policy 2004, 110 (2004), 42--51.
• 8: Chris Crawford, The Art of Computer Game Design, Osborne/McGraw-Hill, Berkeley, CA, 1984
• 9: Heather Desurvire , Martin Caplan , Jozsef A. Toth, Using heuristics to evaluate the playability of games, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986102]
• 10: Eco, U. A theory of semiotics. Indiana University Press, Bloomington, IN, USA, 1976.
• 11: Inger Ekman , Laura Ermi , Jussi Lahti , Jani Nummela , Petri Lankoski , Frans Mäyrä, Designing sound for a pervasive mobile game, Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology, p.110-116, June 15-17, 2005, Valencia, Spain [doi>10.1145/1178477.1178492]
• 12: Johnny Friberg , Dan Gärdenfors, Audio games: new perspectives on game audio, Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, p.148-154, June 03-05, 2005, Singapore [doi>10.1145/1067343.1067361]
• 13: Gaming with a visual disability. http://www.gameaccessibility.com/index.php?pagefile=visual.
• 14: Eitan Glinert , Lonce Wyse, AudiOdyssey: an accessible video game for both sighted and non-sighted gamers, Proceedings of the 2007 conference on Future Play, November 14-17, 2007, Toronto, Canada [doi>10.1145/1328202.1328255]
• 15: Huizinga, J. Homo Ludens: A study of the play-element in culture. Beacon Press, UK, 1966.
• 16: IGDA Game Accessbility SIG. Accessibility in Games: Motivations and Approaches. http://www.igda.org/accessibility/IGDA_Accessibility _WhitePaper.pdf, 2004.
• 17: Lakoff, G. and Johnson, M. Metaphors we live by. Chicago University Press, Chicago, IL, USA, 1980.
• 18: Mats Liljedahl , Nigel Papworth , Stefan Lindberg, Beowulf: an audio mostly game, Proceedings of the international conference on Advances in computer entertainment technology, June 13-15, 2007, Salzburg, Austria [doi>10.1145/1255047.1255088]
• 19: Jukka Linjama , Topi Kaaresoja, Novel, minimalist haptic gesture interaction for mobile devices, Proceedings of the third Nordic conference on Human-computer interaction, p.457-458, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028095]
• 20: Lombard, M., & Ditton, T. At the heart of it all: The concept of presence. Journal of Computer Mediated Communication 3, 2 (1997) {http://jcmc.indiana.edu/vol3/issue2/lombard.html}.
• 21: Thomas W. Malone, Heuristics for designing enjoyable user interfaces: Lessons from computer games, Proceedings of the 1982 conference on Human factors in computing systems, p.63-68, March 15-17, 1982, Gaithersburg, Maryland, United States [doi>10.1145/800049.801756]
• 22: Murphy, E., Kuber, R., Strain, P., McAllister, G. and Yu, W. Developing Sounds for a Multimodal Interface: Conveying Spatial Information to Visually Impaired Web Users. In Proc. ICAD 2007, Online (2007), 26--29.
• 23: David Myers, The Nature of Computer Games: Play As Semiosis (Digital Formations;, V. 16,), Peter Lang Publishing, 2003
• 24: Nintendo 64. http://en.wikipedia.org/wiki/Nintendo_64.
• 25: Nintendo Wii. http://en.wikipedia.org/wiki/Wii.
• 26: Nintendo Wiimote. http://en.wikipedia.org/wiki/Wiimote.
• 27: Nokia N95 specification. http://www.forum.nokia.com/devices/N95.
• 28: Peirce, C. S. The Essential Peirce -- Selected Philosophical Writings. N. Houser and C. J. W. Kloesel (org.). Vols. I and II. Bloomington, IN. Indiana University Press, 1992, 1998.
• 29: Pirhonen, A., Murphy, E., McAllister, G. and Yu, W. Non-Speech Sounds as Elements of a Use Scenario: A Semiotic Perspective. In Proc. ICAD 2006, Department of Computer Science, University of London (2007), 20--23.
• 30: Niklas Ravaja , Timo Saari , Marko Turpeinen , Jari Laarni , Mikko Salminen , Matias Kivikangas, Spatial Presence and Emotions during Video Game Playing: Does It Matter with Whom You Play?, Presence: Teleoperators and Virtual Environments, v.15 n.4, p.381-392, August 2006 [doi>10.1162/pres.15.4.381]
• 31: Rumble Pak. http://en.wikipedia.org/wiki/Rumble_Pak.
• 32: Katie Salen , Eric Zimmerman, Rules of Play: Game Design Fundamentals, The MIT Press, 2003
• 33: Shafiq ur-Rehman , Li Liu , Haibo Li, Vibration Soccer: Tactile Rendering of Football Game on Mobiles, Proceedings of the The 2007 International Conference on Next Generation Mobile Applications, Services and Technologies, p.9-13, September 12-14, 2007
• 34: Gregg Vanderheiden, Fundamental principles and priority setting for universal usability, Proceedings on the 2000 conference on Universal Usability, p.32-37, November 16-17, 2000, Arlington, Virginia, United States [doi>10.1145/355460.355469]
• 35: VibeTonz system. http://www.vibetonz.com.
• 36: Bob G. Witmer , Michael J. Singer, Measuring Presence in Virtual Environments: A Presence Questionnaire, Presence: Teleoperators and Virtual Environments, v.7 n.3, p.225-240, June 1998 [doi>10.1162/105474698565686]
• 37: Panayiotis Zaphiris , Chee Siang Ang, Editorial: HCI issues in computer games, Interacting with Computers, v.19 n.2, p.135-139, March, 2007 [doi>10.1016/j.intcom.2006.08.007]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.1 Applications and Expert Systems

Keywords:
accessibility, audio games, haptics and gestures, mobile games, non-visual games, semiotic engineering, visually-impaired users