The growth of software skill: a longitudinal look at learning & performance

ABSTRACT

This research follows a group of users over time (16 months) as they progress from novice towards expert in their use of Lotus 1-2-3. Quantitative and qualitative measures of performance are compared with expert users having over three years of experience. The results indicate that the motor aspects of performance are relatively stable over time, while improvement in the cognitive components of the skill are dependent on aspects of the menu structure and how many things must be retrieved from memory, among other things. These results imply extensions to the Keystroke Level Model of skilled performance as well as suggest ways to design the user interfaces so as to speed the acquisition of expertise.

REFERENCES

• 1: Anderson, J.R. (1982) Acquisition of cognitive skill Psychological Review, 89(4), 369-406.
• 2: Stuart K. Card , Allen Newell , Thomas P. Moran, The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, Inc., Mahwah, NJ, 1983
• 3: Ericsson, K. A. and Smith, J. E. (Eds) (1991) Toward a general theory of expertise: Prospects and limits. Cambridge, UK: Cambridge University Press.
• 4: Doane, S. M., Pelligrino, J. W., and Klatzky, R. L. (1990) Expertise in a computer operating system: Conceptualization and performance. Human Computer interaction, 5, 267-304.
• 5: Kieras, D. E. and Poison, P. G. (1985) An approach to the formal analysis of user complexity. international Journal of Man-Machine Studies, 22, 365-394.
• 6: John E. Laird , Allen Newell , Paul S. Rosenbloom, SOAR: an architecture for general intelligence, Artificial Intelligence, v.33 n.1, p.1-64, Sept. 1987 [doi>10.1016/0004-3702(87)90050-6]
• 7: Lane, D. M., Napier, H. A., Batsell, R. R., and Naman, J. L. (1991) The application of Card, Moran, and Newell's keystroke-level model to the operation of hierarchical menu systems. Unpublished manuscript under review, Rice University.
• 8: Neves, D.M., and Anderson, J.R. (1981) Knowledge compilation: Mechanisms for the automatization of cognitive skills. In J.R. Anderson (Ed.) Cognitive skills and their acquisition. Hillsdale, NJ: John Wiley and Sons, 57-84.
• 9: Newell, A., and Rosenbloom, P. S. (1981) Mechanisms of skill acquisition and the law of practice. In J.R. Anderson (Ed.) Cognitive skills and their acquisition. Hillsdale, NJ: John Wiley and Sons, 1-55.
• 10: Erik Nilsen , Hee Sen Jong , Judith S. Olson , Peter G. Polson, Method engineering: from data to model to practice, Proceedings of the SIGCHI conference on Human factors in computing systems, p.313-320, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142822]
• 11: Olson, J. R. and Nilsen, E. (1987-1988) Analysis of the cognition involved in spreadsheet software interaction. Human-Computer Interaction, 3,309- 349.
• 12: Olson, J. R. and Olson, G.M. (1990) The growth of cognitive modelling in human-computer interaction since GOMS. Human-Computer Interaction, 5, 221- 265.
• 13: Poison, P.G. and Lewis, C.H. (1991) Theory-based design for easily learned interfaces. Human-Computer Interaction, 15, 191-220.
• 14: Rosson, M. B. (1984) Effects of experience on learning, using, and evaluating a text editor. Human Factors, 26, 463-475.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.1 Office Automation

          Nouns: Lotus 1-2-3
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.1 Project and People Management
          Subjects: Training

General Terms:
Design, Human Factors, Management

Keywords:
GOMS, menu design, models of the user, user-interface design issues