Using heuristics to evaluate the playability of games

ABSTRACT

Heuristics have become an accepted and widely used adjunct method of usability evaluation in Internet and software development. This report introduces Heuristic Evaluation for Playability (HEP), a comprehensive set of heuristics for playability, based on the literature on productivity and playtesting heuristics that were specifically tailored to evaluate video, computer, and board games. These heuristics were tested on an evolving game design to assess their face validity and evaluation effectiveness compared to more standard user testing methodologies. The results suggest that HEP identified qualitative similarities and differences with user testing and that HEP is best suited for evaluating general issues in the early development phases with a prototype or mock-up. Combined with user studies, HEP offers a new method for the HCI game community that can result in a more usable and playable game.

REFERENCES

• 1: Heather W. Desurvire, Faster, cheaper!! Are usability inspection methods as effective as empirical testing?, Usability inspection methods, John Wiley & Sons, Inc., New York, NY, 1994
• 2: Heather W. Desurvire , Jim M. Kondziela , Michael E. Atwood, What is gained and lost when using evaluation methods other than empirical testing, Proceedings of the conference on People and computers VII, p.89-102, January 1993, York, United Kingdom
• 3: Falstein, N. and Barwood, H. The 400 Project. Available at http://theinspiracy.com/400_project.htm.
• 4: Federoff, M. User Testing for Games: Getting Better Data Earlier. Game Developer Magazine (June 2003).
• 5: Federoff, M. Heuristics and Usability Guidelines for the Creation and Evaluation of FUN in Video Games. Thesis at the University Graduate School of Indiana University, Dec. 2002 ([e-mail]).
• 6: Thomas W. Malone, Heuristics for designing enjoyable user interfaces: lessons from computer games, Human factors in computer systems, Ablex Publishing Corp., Norwood, NJ, 1984
• 7: Jakob Nielsen, Heuristic evaluation, Usability inspection methods, John Wiley & Sons, Inc., New York, NY, 1994

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

General Terms:
Human Factors, Measurement

Keywords:
computer games, design guidelines, evaluation, games, heuristics, playability, playtesting, usability, user testing, video games