Automating CPM-GOMS

ABSTRACT

CPM-GOMS is a modeling method that combines the task decomposition of a GOMS analysis with a model of human resource usage at the level of cognitive, perceptual, and motor operations. CPM-GOMS models have made accurate predictions about skilled user behavior in routine tasks, but developing such models is tedious and error-prone. We describe a process for automatically generating CPM-GOMS models from a hierarchical task decomposition expressed in a cognitive modeling tool called Apex. Resource scheduling in Apex automates the difficult task of interleaving the cognitive, perceptual, and motor resources underlying common task operators (e.g. mouse move-and-click). Apex's UI automatically generates PERT charts, which allow modelers to visualize a model's complex parallel behavior. Because interleaving and visualization is now automated, it is feasible to construct arbitrarily long sequences of behavior. To demonstrate the process, we present a model of automated teller interactions in Apex and discuss implications for user modeling

REFERENCES

• 1: Joel D. Baskin , Bonnie E. John, Comparison of GOMS analysis methods, CHI 98 conference summary on Human factors in computing systems, p.261-262, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286742]
• 2: Lynn K. Baumeister , Bonnie E. John , Michael D. Byrne, A comparison of tools for building GOMS models, Proceedings of the SIGCHI conference on Human factors in computing systems, p.502-509, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332485]
• 3: Beard, David V., Smith, Dana K. & Denelsbeck, Kevin M. (1996). Quick and Dirty GOMS: A Case Study of Computed Tomography, Human-Computer Interaction, 11 (2) p.157--180.
• 4: Michael D. Byrne , Scott D. Wood , James D. Foley , David E. Kieras , Piyawadee Noi Sukaviriya, Automating interface evaluation, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.232-237, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191752]
• 5: Stuart K. Card , Thomas P. Moran , Allen Newell, The keystroke-level model for user performance time with interactive systems, Communications of the ACM, v.23 n.7, p.396-410, July 1980 [doi>10.1145/358886.358895]
• 6: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 7: Mei C. Chuah , Bonnie E. John , John Pane, Analyzing graphic and textual layouts with GOMS: results of a preliminary analysis, Conference companion on Human factors in computing systems, p.323-325, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/259963.260393]
• 8: Robert James Firby, Adaptive execution in complex dynamic worlds, 1989
• 9: Michael Freed, Managing multiple tasks in complex, dynamic environments, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.921-927, July 1998, Madison, Wisconsin, United States
• 10: Michael Alan Freed , Lawrence Birnbaum, Simulating human performance in complex, dynamic environments, 1998
• 11: Freed, M. & Remington, R. (2000a) GOMS, GOMS+ and PDL. In Working Notes of the AAAI Fall Symposium on Simulating Human Agents. Falmouth, Massachusetts.
• 12: Freed, M. & Remington, R. (2000b) Making human-machine system simulation a practical engineering tool: An Apex overview. In Proceedings of the Third International Conference on Cognitive Modeling. Veenendaal, The Netherlands: Universal Press. pp. 110--117.
• 13: Richard Gong , David Kieras, A validation of the GOMS model methodology in the development of a specialized, commercial software application, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.351-357, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191782]
• 14: Gray, W. D., & Boehm-Davis, D. A. (2000). Milliseconds matter: An introduction to microstrategies and to their use in describing and predicting interactive behavior. Journal of Experimental Psychology: Applied, 6(4), 322--335.
• 15: Gray, W. D., John, B. E. & Atwood, M. E. (1993) Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-World Task Performance, Human-Computer Interaction, 8 (3), pp. 237--309.
• 16: Scott E. Hudson , Bonnie E. John , Keith Knudsen , Michael D. Byrne, A tool for creating predictive performance models from user interface demonstrations, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.93-102, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322590]
• 17: Bonnie Elizabeth John, Contributions to engineering models of human-computer interaction. (volumes i and ii), 1988
• 18: Bonnie E. John, Extensions of GOMS analyses to expert performance requiring perception of dynamic visual and auditory information, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.107-116, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97262]
• 19: John, B. E. (1996) TYPIST: A Theory of Performance In Skilled Typing. Human-Computer Interaction , 11 (4), pp.321--355.
• 20: Bonnie E. John , Wayne D. Gray, GOMS analysis for parallel activities, Conference companion on Human factors in computing systems, p.395-396, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/259963.260522]
• 21: Bonnie E. John , David E. Kieras, The GOMS family of user interface analysis techniques: comparison and contrast, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.4, p.320-351, Dec. 1996 [doi>10.1145/235833.236054]
• 22: Bonnie E. John , David E. Kieras, Using GOMS for user interface design and evaluation: which technique?, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.4, p.287-319, Dec. 1996 [doi>10.1145/235833.236050]
• 23: Kieras, D. E. (1996) Guide to GOMS model usability evaluations using NGOMSL, The Handbook of Human-Computer Interaction, M. Helander and T.Landauer (Eds.), 2nd ed. North-Holland Amsterdam.
• 24: Kieras, D. E., Wood, S. D., Abotel, K., & Hornof, A. (1995). GLEAN: A Computer-Based Tool for Rapid GOMS Model Usability Evaluation of User Interface Designs. International Journal of Man-Machine Studies, 22, 365--394.
• 25: Muneo Kitajima , Peter G. Polson, A comprehension-based model of correct performance and errors in skilled, display-based, human-computer interaction, International Journal of Human-Computer Studies, v.43 n.1, p.65-99, July 1995 [doi>10.1006/ijhc.1995.1036]
• 26: Kosbie, D. S. & John, B. E. (1994). Hierarchical Event Histories and GOMS, Poster at the Human-Computer Interaction Consortium Winter Workshop (January, 1994, Frasier, Colorado.)
• 27: A. Y. Lee , P. G. Polson , W. A. Bailey, Learning and transfer of measurement tasks, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.115-120, March 1989
• 28: F. J. Lerch , M. M. Mantei , J. R. Olson, Skilled financial planning: the cost of translating ideas into action, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.121-126, March 1989
• 29: Pirolli, P. and Card, S. K. (1999). Information foraging. Psychological Review, 106, 643--675.
• 30: Williams, K. E. (1993) Automating the cognitive task modeling process: An extension to GOMS for HCI. In Proceedings of the Fifth International Conference on Human-Computer Interaction Poster Sessions: Abridged Proceedings (vol 3. p. 182).
• 31: R. M. Young , T. R. G. Green , T. Simon, Programmable user models for predictive evaluation of interface designs, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.15-19, March 1989
• 32: Richard M. Young , Joyce Whittington, Using a knowledge analysis to predict conceptual errors in text-editor usage, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.91-98, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97260]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing

General Terms:
Design, Human Factors, Performance, Theory

Keywords:
Apex, GOMS, task/user modeling, tool support for usability evaluation