Binocular eye tracking in virtual reality for inspection training

ABSTRACT

This paper describes the development of a binocular eye tracking Virtual Reality system for aircraft inspection training. The aesthetic appearance of the environment is driven by standard graphical techniques augmented by realistic texture maps of the physical environment. A “virtual flashlight” is provided to simulate a tool used by inspectors. The user's gaze direction, as well as head position and orientation, are tracked to allow recording of the user's gaze locations within the environment. These gaze locations, or scanpaths, are calculated as gaze/polygon intersections, enabling comparison of fixated points with stored locations of artificially generated defects located in the environment interior. Recorded scanpaths provide a means of comparison of the performance of experts to novices, thereby gauging the effects of training.

REFERENCES

• 1: DANFORTH, R., DUCHOWSKI, A., GEIST, R., AND MCALILEY, E. A Platform for Gaze-Contingent Virtual Environments. In Smart Graphics (Papers from the 2000 AAA1 Spring Symposium, Technical Report SS- 00-04) (Menlo Park, CA, 2000), AAAI, pp. 66-70.
• 2: DUCHOWSKI, A. T., AND VERTEGAAL, R. Course 05: Eye-Based Interaction in Graphical Systems: Theory & Practice. ACM SIGGRAPH, New York, NY, July 2000. SIGGRAPH 2000 Course Notes.
• 3: Andrew S. Glassner, An introduction to ray tracing, Academic Press Ltd., London, UK, 1989
• 4: GRAMOPADHYE, A., BHAGWAT, S., KIMBLER, D., AND GREENSTEIN, J. The Use of Advanced Technology for Visual Inspection Training. Applied Ergonomics 29, 5 (1998), 361-375.
• 5: GRAMOPADHYE, A. K., MELLOY, B., CHEN, S., AND BINGHAM, J. Use of Computer Based Training for Aircraft Inpsectors: Findings and Recommendations. In Proceedings of the HFES/1EA Annual Meeting (San Diego, CA, August 2000).
• 6: Richard Held , Nathaniel Durlach, Telepresence, time delay and adaptation, Pictorial communication in virtual and real environments (2nd ed.), Taylor & Francis, Inc., Bristol, PA, 1993
• 7: Robert J. K. Jacob, What you look at is what you get: eye movement-based interaction techniques, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.11-18, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97246]
• 8: Toshikazu Ohshima , Hiroyuki Yamamoto , Hideyuki Tamura, Gaze-directed Adaptive Rendering for Interacting with Virtual Space, Proceedings of the 1996 Virtual Reality Annual International Symposium (VRAIS 96), p.103, March 30-April 03, 1996
• 9: India Starker , Richard A. Bolt, A gaze-responsive self-disclosing display, Proceedings of the SIGCHI conference on Human factors in computing systems: Empowering people, p.3-10, April 01-05, 1990, Seattle, Washington, United States [doi>10.1145/97243.97245]
• 10: Vildan Tanriverdi , Robert J. K. Jacob, Interacting with eye movements in virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.265-272, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332443]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

  J. Computer Applications
  J.3 LIFE AND MEDICAL SCIENCES
      Subjects: Health
  J.4 SOCIAL AND BEHAVIORAL SCIENCES
      Subjects: Psychology

General Terms:
Design, Human Factors, Management, Performance, Theory

Keywords:
eye tracking, virtual reality, visual inspection