Automatic chunk detection in human-computer interaction

ABSTRACT

This paper describes an algorithm to detect user's mental chunks by analysis of pause lengths in goal-directed human-computer interaction. Identifying and characterizing users' chunks can help in gauging the users' level of expertise. The algorithm described in this paper works with information collected by an automatic logging mechanism. Therefore, it is applicable to situations in which no human intervention is required to perform the analysis, such as adaptive interfaces. An empirical study was conducted to validate the algorithm, showing that mental chunks and their characteristics can indeed be inferred from analysis of human-computer interaction logs. Users performing a variety of goal-directed tasks were monitored. Using an automated logging tool, every command invoked, every operation performed with the input devices, as well as all system responses were recorded. Analysis of the interaction logs was performed by a program that implements a chunk detection algorithm that looks at command sequences and timings. The results support the hypothesis that a significant number of user mental chunks can be detected by our algorithm.

REFERENCES

• 1: Anderson, J.R., Acquisition of cognitive skill. Psychological Review 89,4 (1982). 369406.
• 2: John R. Anderson, The Architecture of Cognition, Harvard University Press, Cambridge, MA, 1983
• 3: Anderson, J.R., Problem solving and learning, American Psychologist 48, 1 (Jan 1993), 35-44.
• 4: Badre, A.N., Designing chunks for seqluentially displayed information. In Badre, A. and Shneiderman, B. IEds.), Directions in Human/Computer Interaction., Ablex, pp. 179-193, Norwood, New Jersey, 1982.
• 5: Badre, A.N., Selecting and representing information structures for visual presentation. IEEE Transactions on Systems, Man, and Cybernetics 12, 4 (Jul/Aug 1982) 495-504.
• 6: Badre, A.N. and Santos, P.J., CHIME: a knowledgebased computer-human interaction monitoring engine, Technical report no. GIT-GVU-91-06, Atlanta, Georgia, Jul 1991.
• 7: Barfield, W., Expert-novice differences for software: implications for problem-solving and knowledge acquisition. Behaviour and Information Technology 5, 1 (1986), 15-29.
• 8: Bovair, S., Kieras, D.E., and Polson, F'.G., The acquisition and performance of text-editing skill: a cognitive complexity analysis. Human Computer Interaction 5(1990), 148.
• 9: Card, S.K., English, W.K.. and Burr, B., Evaluation of mouse, rate controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics 21(1978), 601-613.
• 10: Card, S.K., Moran, T.P., and Newell, A., Computer text-editing: an information-processing analysis of a routine cognitive skill. Cognitive Psychology 12(1980), 32-74.
• 11: Stuart K. Card , Thomas P. Moran , Allen Newell, The keystroke-level model for user performance time with interactive systems, Communications of the ACM, v.23 n.7, p.396-410, July 1980 [doi>10.1145/358886.358895]
• 12: Chase, W.G. and Simon, H.A.. Perception in chess. Cognitive Psychology 4(1973), 55-81.
• 13: Cypher. A., The structure of users' activities. In Norman, D. and Draper, S. (Eds.), User Centered System Design: New Perspectives on Human- Computer Interaction, Lawrence Erlbaum Associates, pp. 243-263, Hillsdale, New Jersey, 1986.
• 14: Ericsson, K.A. and Simon, H.A. Protocol analysis.' Verbal reports as data, MIT Press, Cambridge, Massachusetts, Bradford Books(1984).
• 15: Fitts, P.M., Perceptual motor skill learning. In Melton, A.W. (Ed.), Categories of human learning. Academic Press, pp. 243-285, New York, 1964.
• 16: Kieras, D.E. and Polson, P.G., An approach to the formal analysis of user complexity. International Journal of Man-Machine Studies 22, 4 (Apr 1985), 365-394.
• 17: Thomas Kühme , Hartmut Dieterich , Uwe Malinowski , Matthias Schneider-Hufschmidt, Approaches to Adaptivity in User Interface Technology: Survey and Taxonomy, Proceedings of the IFIP TC2/WG2.7 Working Conference on Engineering for Human-Computer Interaction, p.225-252, August 10-12, 1992
• 18: John E. Laird , Allen Newell , Paul S. Rosenbloom, SOAR: an architecture for general intelligence, Artificial Intelligence, v.33 n.1, p.1-64, Sept. 1987 [doi>10.1016/0004-3702(87)90050-6]
• 19: Newell, A. and Rosenbloom. P.S., Mechanisms of skill acquisition and the law of practice. In Anderaon, J.R. (Ed.), Cognitive skills and their acquisition. Lawrence Erlbaum Associates, Ch. 1, pp. l-55, Hillsdale, New Jersey, 1981.
• 20: D. R. Olsen, Jr., A programming language basis for user interface, Proceedings of the SIGCHI conference on Human factors in computing systems: Wings for the mind, p.171-176, March 1989
• 21: Reitman, J.S.. Skilled perception in Go: Deducing memory structures from inter-response times. Cognitive Psychology 8( 1976), 336-356.
• 22: Shiffrin, R.M. and Schneider, W., Controlled and automatic human information processing: II. Perceptual learning, automatic attending, and a general theory. Psychological Review 84(1977), 127-190.
• 23: Shneiderman, B., Exploratory experiments in programmer behavior. International Journal of Computer and Information Sciences 5, 2 (1976). 123-143.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Theory and methods

General Terms:
Algorithms, Design, Human Factors, Theory, Verification

Keywords:
chunk detection, chunking, event logging, human-computer interaction, models of the user, novice/expert differences, user study