Usability evaluation involving participants with cognitive disabilities

ABSTRACT

People with cognitive disabilities benefit from new computerized tools for maintaining social contacts. Their need for easy-to-use applications has been established. However, there is little research on improving usability evaluation methods with this user group. We conducted a case study with a group of users with cognitive disabilities. Pilot test findings indicated that a think aloud test would not work well with this user group. Therefore, instead of a conventional usability test, we conducted an informal walkthrough, in addition to classroom observation and interviews. Our study shows a need to collect data with several complementary methods, and to adjust the methods to suit the characteristics of the participants. Without observational methods, many usability problems would have been missed. Furthermore, the special characteristics of this user group have to be taken into account also in expert evaluation.

REFERENCES

• 1: Hugh Beyer , Karen Holtzblatt, Contextual design: defining customer-centered systems, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 2: Davies, D. K., Stock, S. E. & Wehmeyer, M. L. 2001. Enhancing independent Internet access for individuals with mental retardation through use of a specialized web browser: a pilot study. Education and Training in Mental Retardation and Developmental Disabilities 36 (1), 107--113.
• 3: Joseph F. Dumas , Janice C. Redish, A Practical Guide to Usability Testing, Greenwood Publishing Group Inc., Westport, CT, 1993
• 4: eEurope 2005 Action Plan. http://europa.eu.int/information_society/eeurope/
• 5: Finland as an Information Society 2000. Ministry of Finance. http://www.vm.fi/tiedostot/pdf/fi/40639.pdf
• 6: Peter Gregor , Alan F. Newell, An empirical investigation of ways in which some of the problems encountered by some dyslexics may be alleviated using computer techniques, Proceedings of the fourth international ACM conference on Assistive technologies, p.85-91, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354347]
• 7: Lepistö, A. 2004. "Siellä on ne meidän ystävät ja niitten kanssa kirjotan." Verkkopohjaisen oppimisympäristön käytettävyys kehitysvammaisten opiskelijoiden yhteydenpitovälineenä. ("That's where our friends are and with them I write." The usability of an Internet based learning environment as a means of communication by students with cognitive disabilities.) M. Sc. Thesis (in Finnish), University of Tampere.
• 8: Lepistö, A., Saranto, K., Lammintakanen, J. & Kivinen, T. 2002. Enhancing interaction in society among disabled people through information technology. In Bildt, C., Gonäs, L., Karlqvist, L. & Westberg, H. (eds.) Women, work & health. Book of abstracts. 290.
• 9: Alan F. Newell , Alex Carmichael , Peter Gregor , Norman Alm, Information technology for cognitive support, The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 2002
• 10: Jakob Nielsen, Heuristic evaluation, Usability inspection methods, John Wiley & Sons, Inc., New York, NY, 1994
• 11: David Poulson , Colette Nicolle, Making the Internet accessible for people with cognitive and communication Impairments, Universal Access in the Information Society, v.3 n.1, p.48-56, March 2004 [doi>10.1007/s10209-003-0072-8]
• 12: Riihiaho, S. 2000. Experiences with usability evaluation methods. Licentiate's thesis. Helsinki University of Technology.
• 13: Gretchen L. Robertson , Deborah Hix, Making the computer accessible to mentally retarded adults, Communications of the ACM, v.45 n.4, April 2002 [doi>10.1145/505248.506006]
• 14: The Web - Access and Inclusion for disabled People. 2004. A formal investigation conducted by the Disability Rights Commission. London. http://www.drc-gb.org/publicationsandreports/2.pdf

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

Keywords:
informal walkthrough, participant with cognitive disabilities, usability evaluation