Eye tracking in web search tasks: design implications

ABSTRACT

An eye tracking study was conducted to evaluate specific design features for a prototype web portal application. This software serves independent web content through separate, rectangular, user-modifiable portlets on a web page. Each of seven participants navigated across multiple web pages while conducting six specific tasks, such as removing a link from a portlet. Specific experimental questions included (1) whether eye tracking-derived parameters were related to page sequence or user actions preceding page visits, (2) whether users were biased to traveling vertically or horizontally while viewing a web page, and (3) whether specific sub-features of portlets were visited in any particular order. Participants required 2-15 screens, and from 7-360+ seconds to complete each task. Based on analysis of screen sequences, there was little evidence that search became more directed as screen sequence increased. Navigation among portlets, when at least two columns exist, was biased towards horizontal search (across columns) as opposed to vertical search (within column). Within a portlet, the header bar was not reliably visited prior to the portlet's body, evidence that header bars are not reliably used for navigation cues. Initial design recommendations emphasized the need to place critical portlets on the left and top of the web portal area, and that related portlets do not need to appear in the same column. Further experimental replications are recommended to generalize these results to other applications.

REFERENCES

• 1: Antti Aaltonen , Aulikki Hyrskykari , Kari-Jouko Räihä, 101 spots, or how do users read menus?, Proceedings of the SIGCHI conference on Human factors in computing systems, p.132-139, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274664]
• 2: Benel, D. C. R., Ottens, D. & Horst, R. (1991). Use of an eyetracking system in the usability laboratory. Proceedings of the Human Factors Society 35th Annual Meeting, 461-465.
• 3: Michael D. Byrne , John R. Anderson , Scott Douglass , Michael Matessa, Eye tracking the visual search of click-down menus, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.402-409, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303118]
• 4: Crosby, M. and Peterson, W., (1991). Using eye movements to classify search strategies, Proceedings of the Human Factors Society 35th Annual Meeting, 1476 - 1480.
• 5: Ellis, S. H., Candrea, R., Misner, J., Craig, C. S., Lankford, C., and Hutchinson, T. E. (1998). Windows to the Soul? What Eye Movements Tell Us About Software Usability. Proceedings of the 7th Annual Conference of the Usability Professionals Association, Washington, D.C., June 1998.
• 6: Goldberg, J. H. and Kotval, X. P. (1998), Eye Movement-Based Evaluation of the Computer Interface. In Kumar, S. K. (Ed.), Advances in Occupational Ergonomics and Safety, Amsterdam: IOS Press, pp. 529-532.
• 7: Goldberg, J. H. (2000), "Eye Movement-Based Interface Evaluation: What Can and Cannot be Assessed?" Proceedings of the IEA 2000/HFES 2000 Congress (44th Annual Meeting of the Human Factors and Ergonomics Society), Santa Monica: HFES, pp. 6/625 - 6/628.
• 8: Goldberg, J. H., and Kotval, X. P. (1999), "Computer Interface Evaluation Using Eye Movements: Methods and Constructs," International Journal of Industrial Ergonomics, 24: 631-645.
• 9: Goldberg, J. H., and Schryver, J. C. (1995), Eye-Gaze Contingent Control of the Computer Interface: Methodology and Example for Zoom Detection, Behavior Research Methods, Instruments & Computers, 27(3): 338-350.
• 10: Goldberg, J. H., Probart, C. K., and Zak, R. E. (1999), "Visual Search of Food Nutrition Labels," Human Factors, 41(3): 425-437.
• 11: Kotval, X. P., and Goldberg, J. H. (1998), Eye Movements and Interface Components Grouping: An Evaluation Method, Proceedings of the 42nd Annual Meeting of the Human Factors and Ergonomics Society, Santa Monica: HFES, pp. 486-490.
• 12: Loftus, G. R. & Mackworth, N. H. (1978). Cognitive determinants of fixation location during picture viewing. Journal of Experimental Psychology: Human Perception and Performance, 4, 565-572.
• 13: Noton, D., and Stark, L. (1971), "Scanpaths in Saccadic Eye Movements While Viewing and Recognizing Patterns," Vision Research, 11: 929-942.
• 14: Ponsoda, V., Scott, D., & Findlay, J. M. (1995). A probability vector and transition matrix analysis of eye movements during visual search. Acta Psychologica, 88, 167-185.
• 15: Dario D. Salvucci , Joseph H. Goldberg, Identifying fixations and saccades in eye-tracking protocols, Proceedings of the 2000 symposium on Eye tracking research & applications, p.71-78, November 06-08, 2000, Palm Beach Gardens, Florida, United States [doi>10.1145/355017.355028]
• 16: Schryver, J. C., and Goldberg, J. H. (1993), Eye-Gaze and Intent: Application in 3D Interface Control, in Salvendy, G., and Smith, M. J. (Eds.), Human-Computer Interaction: Software and Hardware Interfaces, New York: Elsevier, pp. 573-578.

INDEX TERMS

Keywords:
Eye Tracking, Software, Usability Evaluation, World Wide Web