A gaze-responsive self-disclosing display

ABSTRACT

An information display system is described which uses eye-tracking to monitor user looking about its graphics screen. The system analyzes the user's patterns of eye movements and fixations in real-time to make inferences about what item or collection of items shown holds most relative interest for the user. Material thus identified is zoomed-in for a closer look, and described in more detail via synthesized speech.

REFERENCES

• 1: Berlyne, D. E. Curiosity and explanation. Scier~ce, 153 (1966), 25-33.
• 2: Berlyne, 13. E. The influence of complexity and novelty in visual figures on orienting responses. Journal of Experimental Psychology, 55 (1958}, 289-296.
• 3: Bolt, R. A. The human interface. Van Nostrand Reinhold, New York, 1984.
• 4: Richard A. Bolt, Gaze-orchestrated dynamic windows, Proceedings of the 8th annual conference on Computer graphics and interactive techniques, p.109-119, August 03-07, 1981, Dallas, Texas, United States
• 5: Chandler, D. L. "Breaking the shackles of disability." Bosto~ Globe newspaper, Boston MA, Technology Section, February 6, 1989, p. 31-32.
• 6: Elmer-DeWitt, P. Into the wild blue (digital) yonder. TIME, August 1, 1988, 62-3.
• 7: Jonides, J. Voluntary versus automatic control over the mind's eye's movement. In John Long and Alan Baddeley (Eds.), Attention and Performance IX. Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1981.
• 8: Just, M. A. and P. A. Carpenter. The role of eye-fixation research in cognitive psychology. Behavior Research Methods and Instrumentation, 8, 2 (1976), 139-143.
• 9: Kahneman, D.. Attention and effort. Prentice- Hall, Englewood Cliffs, New Jersey, 1973.
• 10: Kleinke, G. L. Gaze and eye contact: a research review. Psychological Bulletin, 100, 1 (1986}, 78-100.
• 11: Loftus, G. R. and N. H. Macworth. Cognitive determinants of fixation location during picture viewing. Journal of Experimental Psychology, $, 4 (1978), 565-572.
• 12: McGonkie, G. W., D. Zola, G. S. Wolverton, and D. D. Burns. Eye movement contingent display control in studying reading. Behavior Research Methods ?~ Instrumentation, 10, 2 (1978), 154-166.
• 13: McGowa~a, J. The eyegaze computer. Occupational Therapy Forum (Atlantic Edition), Vol. III, No. 47, week of November 21, 1988, 1-5.
• 14: K McKeown, Discourse strategies for generating natural-language text, Readings in natural language processing, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1986
• 15: Posner, Michael I. Orienting of attention. Quarterly Journal of Experimental Psychology, S~ (1980), 3-25.
• 16: Rinard, G. A. and E. E. Rugg. Current state of development and testing of an ocular control device. Proceedings of S th Conference on Systems and Devices for the Disabled, Seattle, Washington, June 1977.
• 17: Rogers, M. "More than wheelchairs." Newsweek magazine, April 24, 1989, p. 66-67.
• 18: Starker, B. E. I. A Gaze-Directed Graphic~ World with Synthesized Narration. Unpublished master's thesis, Massachusetts Institute of Tech. nology, 1989.
• 19: Steinman, R. Role of eyemovements in m~inraining a phenomenally clear and stable world. In Richard A. Monty and John W. Senders (Eds.), Eyemovements and psychological processes. Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1976.
• 20: Ernest R. Tello, Between man and machine, BYTE, v.13 n.9, p.288-293, Sept. 1988
• 21: Vaughn, J. Control of visual fLxations in visual search. In: Senders, John W., Dennis F. Fisher, and Richard A. Monty (eds.), Eye Movements and the Higher Psychological Functions. Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1978.
• 22: Colin Ware , Harutune H. Mikaelian, An evaluation of an eye tracker as a device for computer input2, Proceedings of the SIGCHI/GI conference on Human factors in computing systems and graphics interface, p.183-188, April 05-09, 1987, Toronto, Ontario, Canada
• 23: Y~rbus, A. L. Eyemovements and vision. Translated by B. Haigh. Plenum Press, New York, 1967.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

General Terms:
Human Factors