Tracking the interaction of users with AJAX applications for usability testing

ABSTRACT

In this paper, we introduce an implementation for detailed monitoring of user actions on web pages. It addresses the problem that the log data recorded by standard web servers is not sufficient for the tracking of users on AJAX websites, e.g. to conduct a usability test. Using standard web technologies, our HTTP proxy can record very detailed usage information, such as mouse movements, clicks, key presses and scrolling, together with the exact HTML DOM tree objects involved. As we show in several case studies, the tracking also works across multiple websites, none of which needs to be under our control. This approach is much less invasive than previous efforts: The test person does not need to install software on her computer, and in certain operation modes, no configuration changes at all are required on her computer. Our research indicates that if the technology described in this paper is employed, arbitrary visitors of a website are more likely to take part in a usability test offered by that site -- this facilitates recruiting test participants over the Internet.

REFERENCES

• 1: Vinod Anupam , Juliana Freire , Bharat Kumar , Daniel Lieuwen, Automating Web navigation with the WebVCR, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.503-517, June 2000, Amsterdam, The Netherlands
• 2: Ernesto Arroyo , Ted Selker , Willy Wei, Usability tool for analysis of web designs using mouse tracks, CHI '06 extended abstracts on Human factors in computing systems, April 22-27, 2006, Montréal, Québec, Canada [doi>10.1145/1125451.1125557]
• 3: Richard Atterer , Monika Wnuk , Albrecht Schmidt, Knowing the user's every move: user activity tracking for website usability evaluation and implicit interaction, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland [doi>10.1145/1135777.1135811]
• 4: WebQuilt: A proxy-based approach to remote web usability testing, ACM Transactions on Information Systems (TOIS), v.19 n.3, p.263-285, July 2001 [doi>10.1145/502115.502118]
• 5: Florian Mueller , Andrea Lockerd, Cheese: tracking mouse movement activity on websites, a tool for user modeling, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634233]
• 6: Hartmut Obendorf , Harald Weinreich , Torsten Hass, Automatic support for web user studies with SCONE and TEA, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986007]
• 7: Robert W. Reeder , Peter Pirolli , Stuart K. Card, WebEyeMapper and WebLogger: tools for analyzing eye tracking data collected in web-use studies, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634082]
• 8: P. Tarasewich, S. Fillion: Discount Eye Tracking: The Enhanced Restricted Focus Viewer. In Proceedings of the Americas Conference on Information Systems AMCIS 2004, New York, NY, USA, August 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.5 Testing and Debugging

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia

General Terms:
Experimentation, Human Factors

Keywords:
AJAX application interaction logging, HTTP proxy, RIA, UsaProxy, mouse tracking, website usability evaluation