Knowing the user's every move: user activity tracking for website usability evaluation and implicit interaction

ABSTRACT

In this paper, we investigate how detailed tracking of user interaction can be monitored using standard web technologies. Our motivation is to enable implicit interaction and to ease usability evaluation of web applications outside the lab. To obtain meaningful statements on how users interact with a web application, the collected information needs to be more detailed and fine-grained than that provided by classical log files. We focus on tasks such as classifying the user with regard to computer usage proficiency or making a detailed assessment of how long it took users to fill in fields of a form. Additionally, it is important in the context of our work that usage tracking should not alter the user's experience and that it should work with existing server and browser setups. We present an implementation for detailed tracking of user actions on web pages. An HTTP proxy modifies HTML pages by adding JavaScript code before delivering them to the client. This JavaScript tracking code collects data about mouse movements, keyboard input and more. We demonstrate the usefulness of our approach in a case study.

REFERENCES

• 1: Vinod Anupam , Juliana Freire , Bharat Kumar , Daniel Lieuwen, Automating Web navigation with the WebVCR, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.503-517, June 2000, Amsterdam, The Netherlands
• 2: Mon Chu Chen , John R. Anderson , Myeong Ho Sohn, What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634234]
• 3: Jeremy Goecks , Jude Shavlik, Learning users' interests by unobtrusively observing their normal behavior, Proceedings of the 5th international conference on Intelligent user interfaces, p.129-132, January 09-12, 2000, New Orleans, Louisiana, United States [doi>10.1145/325737.325806]
• 4: WebQuilt: A proxy-based approach to remote web usability testing, ACM Transactions on Information Systems (TOIS), v.19 n.3, p.263-285, July 2001 [doi>10.1145/502115.502118]
• 5: Florian Mueller , Andrea Lockerd, Cheese: tracking mouse movement activity on websites, a tool for user modeling, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634233]
• 6: Robert W. Reeder , Peter Pirolli , Stuart K. Card, WebEyeMapper and WebLogger: tools for analyzing eye tracking data collected in web-use studies, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634082]
• 7: Daniel Salber , Anind K. Dey , Gregory D. Abowd, The context toolkit: aiding the development of context-enabled applications, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.434-441, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303126]
• 8: A. Schmidt: Implicit Human Computer Interaction Through Context. Personal Technologies, Volume 4(2&3), June 2000, pages 191--199
• 9: A. Schmidt, M. Beigl, H. W. Gellersen: There is more to context than location. Computers & Graphics Journal, Elsevier, Volume 23, No. 6, December 1999, pages 893--902.
• 10: P. Tarasewich, S. Fillion: Discount Eye Tracking: The Enhanced Restricted Focus Viewer. In Proceedings of the Americas Conference on Information Systems AMCIS 2004, New York, NY, USA, August 2004
• 11: C. Ullrich, E. Melis: The Poor Man's Eyetracker Tool of ActiveMath. In Proceedings of the World Conference on E-Learning in Corporate Government Healthcare and Higher Education eLearn-2002, pages 2313--2316, Montreal, Canada, 2002

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)
      H.5.4 Hypertext/Hypermedia
          Subjects: User issues

General Terms:
Experimentation, Human Factors

Keywords:
HTTP proxy, implicit interaction, mouse tracking, user activity tracking, website usability evaluation