A computational model of skilled use of a graphical user interface

ABSTRACT

This paper describes a computational model of skilled use of a graphical user interface based on Kintsch's construction-integration theory [4, 8]. The model uses knowledge of a detailed representation of information on the display, a user's goals and expectations, knowledge about the interface, and knowledge about the application domain to compute actions necessary to accomplish the user's current goal. The model provides a well-motivated account of one kind of errors, action slips [14], made by skilled users. We show how information about the intermediate state of a task on the display plays a critical role in skilled performance, i.e., display-based problem solving.

REFERENCES

• 1: Anderson, J. R. Skill acquisition: Compilation of we~-me~od solutions. Psychological Review, 94 (1987), 192-21 I.
• 2: Bovair, A. S., Kieras, D. E., and Poison, P. G. The acquisition and performance of text-editing skill: a cognitive complexity analysis. Human Computer Interaction, 5, 1 (1990), 1-48.
• 3: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 4: Doane, S. M., Kintsch, W., and Poison, P. G. Modeling UNIX command production: What experts must know. ICS Technical Report #90-1. Institute of Cognitive Science, University of Colorado, Boulder CO., 1990.
• 5: Andrew Howes , Stephen J. Payne, Display-based competence: towards user models for menu-driven interfaces, International Journal of Man-Machine Studies, v.33 n.6, p.637-655, Dec. 1990 [doi>10.1016/S0020-7373(05)80067-7]
• 6: Kieras, D. E. Towards a Practical GOMS Model Methodology for User Interface Design. In M. Helander (Ed.) The Handbook of Human-Computer Interaction. Amsterdam, NV: North-Holland, 1988.
• 7: Kieras, D., and Poison, P. G. An approach to the formal analysis of user complexity. Int. J. of Man- Machine Studies, 22 (1985), 365-394.
• 8: Kintsch, W. The role of knowledge in discourse comprelaension: A construction-integration model. Psychological Review, 95 (1988), 163-182.
• 9: M. Kitajima, A formal representation system for the human-computer interaction process, International Journal of Man-Machine Studies, v.30 n.6, p.669-696, June 1989
• 10: Larkin, J. H. Display-based problem solving. In D. Klahr and K. Kotovsky (Eds.). Complex Information Processing: The impact of Herbert A. Simon. Lawrence Erlbaum Assoc, Hillsdale, New Jersey, 1989, 319-342.
• 11: Larkin, J.H., and Simon, H.A. Why a diagram is (sometimes) worth 10,000 words. Cognitive Sc&nce, 11 (1987), 65-100.
• 12: Mannes, S. M., and Kintsch, W. Routine computing tasks: Planning as Understanding. Cognitive Science, 15 (1991), 305-342.
• 13: J. Terry Mayes , Stephen W. Draper , Alison M. McGregor , Keith Oatley, Information flow in a user interface: the effect of experience and context on the recall of MacWrite screens, Proceedings of the Fourth Conference of the British Computer Society on People and computers IV, p.275-289, October 1988, Univ. of Manchester, United Kingdom
• 14: Norman, D.A. Categorization of action slips. Psychological Review, 88 (1981), 1-15.
• 15: Stephen J. Payne, Display-based action at the user interface, International Journal of Man-Machine Studies, v.35 n.3, p.275-289, Sept. 1991 [doi>10.1016/S0020-7373(05)80129-4]
• 16: Raaijmaker, J. G., and Shiffrin, R. M. Search of associative memory. Psychological Review, 88, 1981, 93-134.
• 17: Selz, O. The laws of cognitive activity, productive and reproductive: A condensed version. In Frijda, N.H. and De Groot, A. Otto Selz: His Contribution to Psychology. Mouton Publishers, The Hague, The Net!aerlands, 1990, 20-75.
• 18: Wharton, C., and Lewis, C. Soar and constructionintegration model: Pressing a button in two cognitive architectures. Technical Report #CU-CS-466-90. Department of Computer Science, University of Colorado, Boulder CO., 1990.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Theory and methods

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.0 General
          Subjects: Cognitive simulation

General Terms:
Design, Experimentation, Human Factors, Theory

Keywords:
action slips, display-based problem solving, graphical user interfaces, user models