Detecting low usability web pages using quantitative data of users' behavior

ABSTRACT

The purpose of this research is to detect low usability web pages from the behavior of users, such as browsing time, mouse movement and eye movement. We experimented to investigate the relation between the quantitative data viewing behavior of users and web usability evaluation by subjects. We analyzed the data to detect low usability web pages using discriminant analysis. Low usability web pages, 94.4% (17pages / 18pages = detectable pages / low usability pages) were detectable from the moving speed of gazing points and the amount of wheel rolling of a mouse. Moreover, this detection reduced the number of web pages which should be evaluated by half (46% = 89 pages / 192 pages = detected pages / all pages).

REFERENCES

• 1: Mon Chu Chen , John R. Anderson , Myeong Ho Sohn, What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634234]
• 2: Andrew T. Duchowski, Eye Tracking Methodology: Theory and Practice, Springer-Verlag New York, Inc., Secaucus, NJ, 2003
• 3: Joseph F. Dumas , Janice C. Redish, A Practical Guide to Usability Testing, Greenwood Publishing Group Inc., Westport, CT, 1993
• 4: Kelly Goto, Emily Cotler. Web ReDesign. Pearson Education, 2002.
• 5: Masatoshi Mori, Tetsuo Ui. Research on effectiveness of gazing point movement analysis in screen design, Japan Society for the Study of Office Automation (JSSOA), Vol.16, No.3, 1995, 49--56. (In Japanese).
• 6: Jakob Nielsen. Designing Web usability. New Riders, 2000.
• 7: Hidehiko Okada. Usability and its evaluation technique. The Institute of Systems, Control and Information Engineers, Vol.45 No.5, 2001, pp.269--276. (In Japanese)
• 8: Hidehiko Okada, Toshiyuki Asahi. GUITESTER: a log-based usability testing tool for graphical user interfaces. IEICETrans. on Information and systems, Vol.E82-D No.6, 1999, 1030--1041.
• 9: Laila Paganelli , Fabio Paternò, Intelligent analysis of user interactions with web applications, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA [doi>10.1145/502716.502735]
• 10: Makoto Sakai, Noboru Nakamichi, Jian Hu, Kazuyuki Shima, Masahide Nakamura. Webtracer: A New Integrated Environment for Web Usability Testing. In 10th Int'l Conference on Human - Computer Interaction (HCI International 2003), Crete, Greece, Adjunct Proceeding, June 2003, 289--290.
• 11: Melody Y. Ivory , Marti A Hearst, The state of the art in automating usability evaluation of user interfaces, ACM Computing Surveys (CSUR), v.33 n.4, p.470-516, December 2001 [doi>10.1145/503112.503114]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Performance measures

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology
      H.5.4 Hypertext/Hypermedia
          Subjects: User issues

General Terms:
Experimentation, Human Factors, Measurement, Performance

Keywords:
evaluation, eye information, gazing point, performance, web usability