The GOMS family of user interface analysis techniques: comparison and contrast

ABSTRACT

Sine the publication of The Psychology of Human-Computer Interaction, the GOMS model has been one of the most widely known theoretical concepts in HCI. This concept has produced severval GOMS analysis techniques that differ in appearance and form, underlying architectural assumptions, and predictive power. This article compares and contrasts four popular variantsof the GOMS family (the Keystroke-Level Model, the original GOMS formulation, NGOMSL, and CPM-GOMS) by applying them to a single task example.

REFERENCES

• 1: Erik M. Altmann , Jill H. Larkin , Bonnie E. John, Display navigation by an expert programmer: a preliminary model of memory, Proceedings of the SIGCHI conference on Human factors in computing systems, p.3-10, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223905]
• 2: ANDERSON, J. R. 1993. Rules of the Mind. Lawrence Erlbaum, Hillsdale, N.J.
• 3: Malcolm I. Bauer , Bonnie E. John, Modeling time-constrained learning in a highly interactive task, Proceedings of the SIGCHI conference on Human factors in computing systems, p.19-26, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223907]
• 4: BEARD,D.V.,SMITH,D.K.,AND DENELSBECK, K. M. 1996. Quick and dirty GOMS: A case study of computed tomography interpretation. Hum. Comput. Interact. 11. To be published.
• 5: BENNETT,J.L.,LORCH,D.J.,KIERAS,D.E.,AND POLSON, P. G. 1987. Developing a user interface technology for use in industry. In Proceedings of the 2nd IFIP Conference on Human-Computer Interaction (INTERACT '87), H. J. Bullinger and B. Shackel, Eds. Elsevier Science Publishers B. V., North-Holland, Amsterdam, 21-26.
• 6: BOVAIR, S., KIERAS,D.E.,AND POLSON, P. G. 1988. The acquisition and performance of text-editing skill: A production-system analysis. Tech. Rep. No. 28. Technical Communica-tion Program, Univ. of Michigan, Ann Arbor, Mich.
• 7: BOVAIR, S., KIERAS,D.E.,AND POLSON, P. G. 1990. The acquisition and performance of text editing skill: A cognitive complexity analysis. Hum. Comput. Interact. 5, 1-48.
• 8: K. Butler , J. Bennett , P. Polson , J. Karrat, Report on the workshop on analytical models, ACM SIGCHI Bulletin, v.20 n.4, p.63-79, April 1989 [doi>10.1145/67243.67251]
• 9: Stuart K. Card , Thomas P. Moran , Allen Newell, The keystroke-level model for user performance time with interactive systems, Communications of the ACM, v.23 n.7, p.396-410, July 1980 [doi>10.1145/358886.358895]
• 10: CARD,S.K.,MORAN,T.P.,AND NEWELL, A. 1980b. Computer text-editing: An information-processing analysis of a routine cognitive skill. Cog. Psychol. 12, 32-74.
• 11: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 12: Mei C. Chuah , Bonnie E. John , John Pane, Analyzing graphic and textual layouts with GOMS: results of a preliminary analysis, Conference companion on Human factors in computing systems, p.323-325, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/259963.260393]
• 13: DOANE,S.M.,MANNES,S.M.,KINTSCH, W., AND POLSON, P. G. 1992. Modeling user action planning: A comprehension based approach. User Model. User-Adapted Interact. 2, 249-285.
• 14: Richard Jeffrey Gong, Validating and refining the GOMS model methodology for software user interface design and evaluation, University of Michigan, Ann Arbor, MI, 1993
• 15: GRAY,W.D.,JOHN,B.E.,AND ATWOOD, M. E. 1993. Project Ernestine: A validation of GOMS for prediction and explanation of real-world task performance. Hum. Comput. Interact. 8, 3, 237-209.
• 16: Peter Haunold , Werner Kuhn, A keystroke level analysis of a graphics application: manual map digitizing, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.337-343, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191779]
• 17: Andrew Howes, A model of the acquisition of menu knowledge by exploration, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.445-451, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191820]
• 18: JOHN, B. E. 1996. TYPIST: A theory of performance in skilled typing. Hum. Comput. Interact. 11. To be published.
• 19: Bonnie E. John , Wayne D. Gray, CPM-GOMS: an analysis method for tasks with parallel activities, Conference companion on Human factors in computing systems, p.393-394, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223738]
• 20: Bonnie E. John , David E. Kieras, The GOMS Family of Analysis Techniques: Tools for Design and Evaluation, Carnegie Mellon University, Pittsburgh, PA, 1994
• 21: Bonnie E. John , David E. Kieras, Using GOMS for user interface design and evaluation: which technique?, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.4, p.287-319, Dec. 1996 [doi>10.1145/235833.236050]
• 22: Bonnie E. John , Allen Newell, Predicting the time to recall computer command abbreviations, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.33-40, April 05-09, 1987, Toronto, Ontario, Canada
• 23: B. E. John , A. Newell, Cumulating the science of HCI: from s-R compatibility to transcription typing, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.109-114, March 1989
• 24: KARAT,J.AND BENNETT, J. 1991. Modeling the user interaction methods imposed by designs. In Human Factors in Information Technology. Vol. 2, Mental Models and Human-Computer Interaction, M. Tauber and D. Ackermann, Eds. North-Holland, Amsterdam.
• 25: KIERAS, D. E. 1988. Towards a practical GOMS model methodology for user interface design. In The Handbook of Human-Computer Interaction. North-Holland, Amsterdam, 135-158.
• 26: KIERAS, D. E. 1996. A Guide to GOMS model usability evaluation using NGOMSL. In The Handbook of Human-Computer Interaction. 2nd ed. North-Holland, Amsterdam. To be published.
• 27: KIERAS,D.E.AND BOVAIR, S. 1986. The acquisition of procedures from text: A production-system analysis of transfer of training. J. Mem. Lang. 25, 507-524.
• 28: KIERAS,D.E.AND MEYER, D. E. 1996. An overview of the EPIC architecture for cognition and performance with application to human-computer interaction. Hum. Comput. Interact. 11. To be published.
• 29: KIERAS,D.E.AND POLSON, P. G. 1985. An approach to the formal analysis of user complexity. Int. J. Man-Machine Stud. 22, 365-394.
• 30: David E. Kieras , Scott D. Wood , David E. Meyer, Predictive engineering models using the EPIC architecture for a high-performance task, Proceedings of the SIGCHI conference on Human factors in computing systems, p.11-18, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223906]
• 31: Muneo Kitajima , Peter G. Polson, A computational model of skilled use of a graphical user interface, Proceedings of the SIGCHI conference on Human factors in computing systems, p.241-249, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142803]
• 32: LANE,D.M.,NAPIER,H.A.,BATSELL,R.R.,AND NAMAN, J. L. 1993. Predicting the skilled use of hierarchical menus with the Keystroke-Level Model. Hum. Comput. Interact. 8, 2, 185-192.
• 33: F. J. Lerch , M. M. Mantei , J. R. Olson, Skilled financial planning: the cost of translating ideas into action, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.121-126, March 1989
• 34: NELSON,G.H.,LEHMAN,J.F.,AND JOHN, B. E. 1994. Integrating cognitive capabilities in a real-time task. In Proceedings of the 16th Annual Conference of the Cognitive Science Society. Cognitive Science Society, Pittsburgh, Pa.
• 35: Allen Newell, Human Problem Solving, Prentice-Hall, Inc., Upper Saddle River, NJ, 1972
• 36: OLSON,J.R.AND OLSON, G. M. 1990. The growth of cognitive modeling in human-computer interaction since GOMS. Hum. Comput. Interact. 5, 221-265.
• 37: POLSON, P. G. 1988. Transfer and retention. In Cognitive Science and Its Application for Human-Computer Interaction, R. Guindon, Ed. Lawrence Erlbaum, Hillsdale, N.J., 59-162.
• 38: POLSON,P.AND LEWIS, C. 1990. Theory-based design for easily learned interfaces. Hum. Comput. Interact. 5, 191-220.
• 39: John Rieman , Clayton Lewis , Richard M. Young , Peter G. Polson, Why is a raven like a writing desk?: lessons in interface consistency and analogical reasoning from two cognitive architectures, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.438-444, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191816]
• 40: STIRES,D.M.AND MURPHY, M. M. 1962. PERT (Program Evaluation and Review Technique) CPM (Critical Path Method). Materials Management Inst., Boston, Mass.
• 41: Mark David Wiesmeyer, An operator-based model of human covert visual attention, University of Michigan, Ann Arbor, MI, 1992
• 42: VERA,A.H.AND ROSENBLATT, J. K. 1995. Developing user model-based intelligent agents. In Proceedings of the 17th Annual Conference of the Cognitive Science Society, J. D. Moore and J. F. Lehman, Eds. Lawrence Erlbaum, Hillsdale, N.J., 500-505.
• 43: J. E. Ziegler , H. U. Hoppe , K. P. Fahnrich, Learning and transfer for text and graphics editing with a direct manipulation interface, Proceedings of the SIGCHI conference on Human factors in computing systems, p.72-77, April 13-17, 1986, Boston, Massachusetts, United States

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing

General Terms:
Human Factors

Keywords:
GOMS, cognitive modeling, usability engineering