On-road driver eye movement tracking using head-mounted devices

ABSTRACT

It is now evident from anecdotal evidence and preliminary research that distractions can hinder the task of operating a vehicle, and consequently reduce driver safety. However with increasing wireless connectivity and the portability of office devices, the vehicle of the future is visualized as an extension of the static work place - i.e. an office-on-the-move, with a phone, a fax machine and a computer all within the reach of the vehicle operator. For this research a Head mounted Eye-tracking Device (HED), is used for tracking the eye movements of a driver navigating a test route in an automobible while completing various driving tasks. Issues arising from data collection of eye movements during the completion of various driving tasks as well as the analysis of this data are discussed. Methods for collecting video and scan-path data, as well as difficulties and limitations are also reported.

REFERENCES

• 1: Bobick, A. 1996. Computers seeing action. In Proceedings of BMVC, , 12-22.
• 2: Brown, I., Tickner, A., and Simmonds, D. 1969. Interference between concurrent tasks of driving and telephoning. Journal of Applied Psychology 53, 5, 419-424.
• 3: Cain, A., and Burris, M. 1999. Investigation of the use of mobile phones while driving. Center for Urban Transportation Research.
• 4: Chapman, P., and Underwood, G. 1998. Eye Guidance in Reading, Driving, and Scene Perception. G. Underwood, Elsevier, ch. Visual search of dynamic scenes: event types and the role of experience in viewing driving situations, 369-393.
• 5: Crundall, D., Underwood, G., and Chapman, P. 1997. Peripheral detection rates in drivers. In Paper presented at the Seventh International Conference on Vision in Vehicles, .
• 6: Crundall, D., Underwood, G., and Chapman, P. 1998. Eye Guidance in Reading, Driving, and Scene Perception. G. Underwood, Elsevier, ch. How much do novice drivers see? The effects of demand on visual search strategies in novice and experienced drivers, 395-417.
• 7: Hankey, J., Dingus, T., Hanowski, R., Wierwille, W., Monk, C., and Moyer, M. 2000. The development of a design evaluation tool and model of attention demand.
• 8: Harms, L. 1991. Variation in drivers' cognitive load: Effects of driving through village areas and rural junctions. Ergonomics 34, 151-160.
• 9: Henderson, J. 1993. Perception and cognition. Advances in eye-movement research. G. d'Ydewalle and J. van Rensbergen, North-Holland, ch. Visual attention and saccadic eye-movements, 37-50.
• 10: Just, M., and Carpenter, P. 1976. Eye fixations and cognitive processes. Cognitive Psychology 8, 441-480.
• 11: Land, M., and Horwood, J. 1996. Vision in vehicles. AG. Gale and ID. Brown and CM. Haslegrave and SP. Taylor, North-Holland, ch. The relations between head and eye movements during driving, 153-160.
• 12: Land, M. 1992. Predictable eye-head coordination during driving. Nature 359, 319-320.
• 13: Laya, O. 1998. Vision in Vehicles VI. AG. Gale and ID. Brown and CM. Haslegrave and SP. Taylor, Elsevier, ch. Analysis system for eye movements in driving situations, 33-40.
• 14: Lee, J., Caven, B., Haake, S., and Brown, T. 2000. Speech-based interaction with in-vehicle computers: The effect of speech-based e-mail on drivers' attention to the roadway.
• 15: Yoshio Matsumoto , Alexander Zelinsky, An Algorithm for Real-Time Stereo Vision Implementation of Head Pose and Gaze Direction Measurement, Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000, p.499, March 26-30, 2000
• 16: Matthews, G., and Sparkes, T. 1996. The role of general attentional resources in simulated driving performance. In Proceedings of The Fifth International Conference on Vision in Vehicles, .
• 17: McKnight, J., and Mcknight, A. 1991. The effect of cellular phone use upon driver attention. National Public Services Research Instatute Landover MD.
• 18: Miura, T. 1990. From eye to mind. Information acquisition in perception. Search, and reading. R. Groner and G. d'Ydewalle and R. Parham, ch. Active function of eye movement and useful field of view in a realistic setting, 119-127.
• 19: Moray, N. 1990. Designing for transportation safety in the light of perception, attention, and mental models. Ergonomics 33, 1201-1213.
• 20: Pachiaudi, G., and Chapon, A. 1994. Car phone and road safety. In XIVth International Technical Conference on the Enhanced Safety of Vehicles No 94-S2-0-09, .
• 21: K. S. Park , C. J. Lim, A simple vision-based head tracking method for eye-controlled human/computer interface, International Journal of Human-Computer Studies, v.54 n.3, p.319-332, March 2001 [doi>10.1006/ijhc.2000.0444]
• 22: Ranney, T., Mazzae, E., Garrott, R., and Goodman, M. 2000. Nhtsa driver distraction research: past, present and future.
• 23: Rantanen, E., and Goldberg, J. 1999. The effect of mental workload on the visual field size and shape. Ergonomics 42, 816-834.
• 24: Rayner, K. 1992. Eyemovements and Visual Cognition: Scene Perception and Reading. K. Rayner, Springer-Verlag, ch. Eye movements and visual cognition: Introduction, 1-7.
• 25: Recarte, M., and Nunes, L. 2000. Effects of verbal and spatial-imagery tasks on eye fixations while driving. Journal of Experimental Psychology: Applied 6, 1, 31-43.
• 26: Redelmeier, D., and Tibshirani, R. 1997. Association between cellular-telephone calls and motor vehicle collisions. The New England Journal of Medicine 336, 7.
• 27: Reimer, B., and Sodhi, M. 2002. A survey of driver eye movement studies and data analysis. Working Paper, IME Dept., University of Rhode Island.
• 28: Rockwell, T. 1988. Vision and Vehicles II. AG. Gale and MH. Freeman and CM. Haslegrave and P. Smith and SP. Taylor, Elsevier, ch. Spare visual capacity in driving revisited, 317-324.
• 29: Rumar, K. 1988. In-vehicle information systems. International Journal of Vehicle Design 9, 548-556.
• 30: Saarinen, J. 1993. Shifts of visual attention at fixation and away from fixation. Vision research 33, 1113-1117.
• 31: Salvucci, D., and Anderson, J. 1998. Tracing eye movement protocols with cognitive process models. In Proceedings of the Twentieth Annual Conference of the Cognitive Science Society, , 923-928.
• 32: Dario Dino Salvucci , John R. Anderson, Mapping eye movements to cognitive processes, 1999
• 33: Salvucci, D. 2000. A model of eye movements and visual attention. In Proceedings of the International Conference on Cognitive Modeling, .
• 34: Sauter, D., Martin, B., Renzo, N. D., and Vomscheid, C. 1991. Analysis of eye tracking movemenets using innovations generated by a kalman filter. Medical and Biological Engineering and Computing, 63-69.
• 35: Schill, K., Umkehrer, E., Beinlich, S., Krieger, G., and Zetzsche, C. 2001. Scene analysis with saccadic eye movements: Top-down and bottom-up modeling. Journal of electronic imaging 10, 1, 152-160.
• 36: Schumacher, W., and Korn, A. 1983. Eye Movements and Psychological Functions: International Views. R. Groner and C. Menz and DF. Fisher and RA. Monty, Lawrence Erlbaum Associates, ch. Automatic evaluation of eye or head movements for visual information selection, 31-42.
• 37: Serafin, C., Wen, C., Paelke, G., and Green, P. 1993. Car phone usability: A human factors laboratory test. In Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting, , 220-224.
• 38: Stark, L., and Ellis, S. 1981. Eye Movements: Cognition and Visual Perception. DF. Fisher et al., Erlbaum, ch. Scan-paths revisited: cognitive models direct active looking, 193-226.
• 39: Stern, A., and Ranney, T. 1999. Ocular based measures of driver alertness. In Ocular Measures of Driver Alertness: Technical Conference Proceedings, , 4-23.
• 40: Vollrath, M., and Totzke, I. 2000. In-vehicle communication and driving: an attempt to overcome their interference. Center for Traffic Sciences University of Wuerzburg.
• 41: Wierwille, W., and Tijerina, L. 1998. Vision in Vehicles VI. AG. Gale and ID. Brown and CM. Haslegrave and SP. Taylor, Elsevier, ch. Modelling the relationship between driver in-vehicle visual demands and accident occurrence, 233-244.
• 42: Wierwille, W. 1993. Automotive Ergonomics. B. Peacock and W. Karwowski, Taylor and Francis, ch. Visual and manual demands of in-car controls and displays, 299-320.
• 43: Williams, L. 1988. Tunnel vision or general interference? cognitive load and attentional bias are both important. American Journal of Psychology 101, 171-191.

INDEX TERMS

Keywords:
Camera calibration, Ergonomics, Perceptual reasoning, Tracking