Usability in practice: formative usability evaluations - evolution and revolution

ABSTRACT

Formative evaluation is a collection of "find-and-fix" usability engineering methods, focused on identifying usability problems before a product is completed. In this forum, four experienced usability professionals will address different aspects of formative evaluations:

• which methods are most effective,
• how to maximize the chances of effecting change and implementing the usability recommendations,
• the importance of the usability professional's relationship with the product developer, and
• the importance of developing a science of user interface design, to minimize the need for iterative evaluations.

REFERENCES

• 1: Bailey, R.W. (2001), User Interface Update - 2001.
• 2: Catani, M.B. and Biers, D.W. (1998), Usability evaluation and prototype fidelity: users and usability professionals, Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting.
• 3: CUE home page, http://www.dialogdesign.dk/cue.html
• 4: Joseph F. Dumas , Janice C. Redish, A Practical Guide to Usability Testing, Greenwood Publishing Group Inc., Westport, CT, 1993
• 5: Ivory, M.Y., Sinha, R.R., and Hearst, M.A. (2000), Preliminary findings on quantitative measures for distinguishing highly rated information-centric web pages, 6th Conference on Human Factors & the Web.
• 6: Melody Y. Ivory , Rashmi R. Sinha , Marti A. Hearst, Empirically validated web page design metrics, Proceedings of the SIGCHI conference on Human factors in computing systems, p.53-60, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365035]
• 7: Jacobsen, N.E. and John, B.E. (2000), Two case studies in using cognitive walkthroughs for interface evaluation, Computer Science Technical Report Abstracts.
• 8: Niels Ebbe Jacobsen , Morten Hertzum , Bonnie E. John, The evaluator effect in usability tests, CHI 98 conference summary on Human factors in computing systems, p.255-256, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286737]
• 9: Martin Kessner , Jo Wood , Richard F. Dillon , Robert L. West, On the reliability of usability testing, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634127]
• 10: Rolf Molich , Ann Damgaard Thomsen , Barbara Karyukina , Lars Schmidt , Meghan Ede , Wilma van Oel , Meeta Arcuri, Comparative evaluation of usability tests, CHI '99 extended abstracts on Human factors in computing systems, May 15-20, 1999, Pittsburgh, Pennsylvania [doi>10.1145/632716.632768]
• 11: Molich, R., Bevan, N., Curson, I., Butler, S., Kindlund, E., Miller, D., Kirakowski, J. (1998), Comparative evaluation of usability tests, Proceedings of the Usability Professionals' Association.
• 12: Nielsen, J. Usability Laboratories: A 1994 Survey, http://www.useit.com/papers/uselabs.html
• 13: Nielsen, J. (2000), Why you only need to test with five users, http://www.useit.com/alertbox/20000319.html
• 14: Rooden, M.J., Green, W.S., and Kanis, H. (1999), Difficulties in usage of a coffeemaker predicted on the basis of design models, Proceedings of the Human Factors and Ergonomics Society, 476--480.
• 15: Rick Spencer, The streamlined cognitive walkthrough method, working around social constraints encountered in a software development company, Proceedings of the SIGCHI conference on Human factors in computing systems, p.353-359, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332456]
• 16: Jared Spool , Will Schroeder, Testing web sites: five users is nowhere near enough, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634236]
• 17: Stanton, N.A. and Stevenage, S.V. (1998), Learning to predict human error: Issues of acceptability, reliability and validity, Ergonomics, 41(11), 1737--1747.

INDEX TERMS

Keywords:
consensus building, inspection methods, iterative design, usability engineering, usability methods, usability report, user interface design, user-centered design