Model-based heuristic evaluation of hypermedia usability

ABSTRACT

This paper presents a systematic approach to the heuristic evaluation of hypermedia that specifically addresses the peculiar features of this class of systems. We propose a set of hypermedia-specific usability attributes and define general "patterns of evaluation activities" called abstract tasks that can be performed by usability experts to check such attributes systematically. The usage of abstract tasks makes application inspection more effective, since it guides the work of evaluators and supports standardization across different evaluators. Our approach is model-based since we use a hypermedia design model (HDM) to identify the constituents of an application that represent the "focus of interest" for the evaluation, to decompose general usability principles into hypermedia-specific attributes, and finally to formulate abstract tasks in a precise way. To show the effectiveness of our method, we discuss the most significant usability problems discovered in eight commercially available hypermedia CD-ROM's.

REFERENCES

• 1: {Cos97} Costabile, M. F., Garzotto, F., Matera, M., Paolini, P., M. SUE: A Systematic Usability Evaluation Methodology. Tech. Rep. 19--97, Dept. of Electronics and Information, Politecnico di Milano, 1997.
• 2: {Dix93} Dix, A., Finlay. J., Abowd, G., Beale, R., "Human-Computer Interaction", Prentice Hall, 1993.
• 3: Franca Garzotto , Paolo Paolini , Daniel Schwabe, HDM—a model-based approach to hypertext application design, ACM Transactions on Information Systems (TOIS), v.11 n.1, p.1-26, Jan. 1993 [doi>10.1145/151480.151483]
• 4: Franca Garzotto , Luca Mainetti , Paolo Paolini, Adding multimedia collections to the Dexter Model, Proceedings of the 1994 ACM European conference on Hypermedia technology, p.70-80, September 19-23, 1994, Edinburgh, Scotland [doi>10.1145/192757.192774]
• 5: Franca Garzotto , Luca Mainetti , Paolo Paolini, Hypermedia design, analysis, and evaluation issues, Communications of the ACM, v.38 n.8, p.74-86, Aug. 1995 [doi>10.1145/208344.208349]
• 6: Franca Garzotto , Luca Mainetti , Paolo Paolini, Information reuse in hypermedia applications, Proceedings of the the seventh ACM conference on Hypertext, p.93-104, March 16-20, 1996, Bethesda, Maryland, United States [doi>10.1145/234828.234838]
• 7: Jonathan Grudin, The case against user interface consistency, Communications of the ACM, v.32 n.10, p.1164-1173, Oct. 1989 [doi>10.1145/67933.67934]
• 8: Lynda Hardman , Dick C. A. Bulterman , Guido van Rossum, The Amsterdam hypermedia model: adding time and context to the Dexter model, Communications of the ACM, v.37 n.2, p.50-62, Feb. 1994 [doi>10.1145/175235.175239]
• 9: Deborah J. Mayhew, Principles and guidelines in software user interface design, Prentice-Hall, Inc., Upper Saddle River, NJ, 1991
• 10: {Nie90} Nielsen J., Lyngbaek U., "Two field studies in hypermedia usability". In McAleese R. and Green, C. (eds.) "Hypertext: State of the Art", Ables, 1990.
• 11: Jakob Nielsen, Usability Engineering, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993
• 12: Jakob Nielsen , Robert L. Mack, Usability inspection methods, John Wiley & Sons, Inc., New York, NY, 1994
• 13: Jakob Nielsen, Multimedia and hypertext: the Internet and beyond, Academic Press Professional, Inc., San Diego, CA, 1995
• 14: {Pao97} Paolini P., Costabile F., Garzotto F., Matera M., "Abstract Tasks for Multimedia Usability Evaluation" (in Italian). Technical Report, Telemedia Lab-University of Lecce (Lecce, Italy), March 1997.
• 15: Brian Shackel, Usability—context, framework, definition, design and evaluation, Human factors for informatics usability, Cambridge University Press, New York, NY, 1991
• 16: Randall H. Trigg, Guided tours and tabletops: tools for communicating in a hypertext environment, ACM Transactions on Information Systems (TOIS), v.6 n.4, p.398-414, Oct. 1988 [doi>10.1145/58566.59299]

INDEX TERMS

Keywords:
heuristic evaluation, hypermedia evaluation, hypermedia modeling, usability