An interactive model-based environment for eye-movement protocol analysis and visualization

ABSTRACT

This paper describes EyeTracer, an interactive environment for manipulating, viewing, and analyzing eye-movement protocols. EyeTracer augments the typical functionality of such systems by incorporating model-based tracing algorithms that interpret protocols with respect to the predictions of a cognitive process model. These algorithms provide robust strategy classification and fixation assignment that help to alleviate common difficulties with eye-movement data, such as equipment noise and individual variability. Using the tracing algorithms for analysis and visualization, EyeTracer facilitates both exploratory analysis for initial understanding of behavior and confirmatory analysis for model evaluation and refinement.

REFERENCES

• 1: Bhaskar, R., & Simon, H. A. (1977). Problem solving in semantically rich domains: An example from engineering thermodynamics. Cognitive Science, 1, 193-215.
• 2: Michael D. Byrne , John R. Anderson , Scott Douglass , Michael Matessa, Eye tracking the visual search of click-down menus, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.402-409, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303118]
• 3: DenBuurman, R., Boersma, T., & Gerrisen, J. F. (1981). Eye movements and the perceptual span in reading. Reading Research Quarterly, 16, 227-235.
• 4: Erkelens, C. J., & Vogels, I. M. L. C. (1995). The initial direction and landing position of saccades. In J. M. Findiay, R. Walker, & R. W. Kentridge (Eds.), Eye Movement Research: Mechanisms, Processes, and Applications (pp. 133-144). New York: Elsevier Science Publishing.
• 5: James Gips, On Building Intelligence into EagleEyes, Assistive Technology and Artificial Intelligence, Applications in Robotics, User Interfaces and Natural Language Processing, p.50-58, January 1998
• 6: Goldberg, J. H., & Schryver, J. C. (1995). Eye-gaze determination of user intent at the computer interface. In J. M. Findiay, R. Walker, & R. W. Kentridge (Eds.), Eye Movement Research: Mechanisms, Processes, and Applications (pp. 491-502). New York: Elsevier Science Publishing.
• 7: Hegarty, M., Mayer, R. E., & Green, C. E. (1992). Comprehension of arithmetic word problems: Evidence from students' eye fixations. Journal of Educational Psychology, 84, 76-84.
• 8: Robert J. K. Jacob, Eye tracking in advanced interface design, Virtual environments and advanced interface design, Oxford University Press, Inc., New York, NY, 1995
• 9: Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87, 329-354.
• 10: Karsh, R., & Breitenbach, F. W. (1983). Looking at looking: The amorphous fixation measure. In R. Groner, C. Menz, D. F. Fisher, & R. A. Monty (Eds.), Eye Movements and Psychological Functions: International Views (pp. 53-64). Hillsdale, NJ: Erlbaum.
• 11: McDowell, E. D., & Rockwell, T. H. (1978). An exploratory investigation of the stochastic nature of the drivers' eye movements and their relationship to roadway geometry. In J. W. Senders, D. F. Fisher, & R. A. Monty (Eds.), Eye Movements and the Higher Psychological Processes (pp. 329-345). Hillsdale, NJ: Erlbaum.
• 12: Rabiner, L. R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77, 257-286.
• 13: Ritter, F. E., & Larkin, J. H. (1994). Developing process models as summaries of HCI action sequences. Human- Computer Interaction, 9, 345-383.
• 14: Dario D. Salvucci, Inferring intent in eye-based interfaces: tracing eye movements with process models, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.254-261, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303055]
• 15: Dario Dino Salvucci , John R. Anderson, Mapping eye movements to cognitive processes, 1999
• 16: Salvucci, D. D., & Anderson, J. R. (1998). Tracing eye movement protocols with cognitive process models. In Proceedings of the Twentieth Annual Conference of the Cognitive Science Society (pp. 923-928). Hillsdale, NJ: Erlbaum.
• 17: Dario D. Salvucci , Joseph H. Goldberg, Identifying fixations and saccades in eye-tracking protocols, Proceedings of the 2000 symposium on Eye tracking research & applications, p.71-78, November 06-08, 2000, Palm Beach Gardens, Florida, United States [doi>10.1145/355017.355028]
• 18: Penelope Sanderson , Jay Scott , Tom Johnston , John Mainzer , Larry Watanabe , Jeff James, MacSHAPA and the enterprise of exploratory sequential data analysis (ESDA), International Journal of Human-Computer Studies, v.41 n.5, p.633-681, Nov. 1994 [doi>10.1006/ijhc.1994.1077]
• 19: Sen, T., & Megaw, T. (1984). The effects of task variables and prolonged performance on saccadic eye movement parameters, In A. G. Gale & F. Johnson (Eds.), Theoretical and Applied Aspects of Eye Movement Research (pp. 103-111). Amsterdam: Elsevier.
• 20: Tole, J. R., & Young, L. R. (1981). Digital filters for saccade and fixation detection. In D. F. Fisher, R. A. Monty, & J. W. Senders (Eds.), Eye Movements: Cognition and Visual Perception (pp. 247-256). Hillsdale, NJ: Erlbaum.
• 21: Waterman, D. A., & Newell, A. (1971). Protocol analysis as a task for artificial intelligence. Artificial Intelligence, 2, 285-318.
• 22: Widdel, H. (1984). Operational problems in analysing eye movements. In A. G. Gale & F. Johnson (Eds.), Theoretical and Applied Aspects of Eye Movement Research (pp. 21-29). New York: Elsevier.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

  J. Computer Applications
  J.3 LIFE AND MEDICAL SCIENCES
      Subjects: Health

General Terms:
Algorithms, Design, Management, Measurement, Performance, Theory

Keywords:
eye movements, protocol analysis, tracing, visualization