Not quite the average: An empirical study of Web use

ABSTRACT

In the past decade, the World Wide Web has been subject to dramatic changes. Web sites have evolved from static information resources to dynamic and interactive applications that are used for a broad scope of activities on a daily basis. To examine the consequences of these changes on user behavior, we conducted a long-term client-side Web usage study with twenty-five participants. This report presents results of this study and compares the user behavior with previous long-term browser usage studies, which range in age from seven to thirteen years. Based on the empirical data and the interview results, various implications for the interface design of browsers and Web sites are discussed.

A major finding is the decreasing prominence of backtracking in Web navigation. This can largely be attributed to the increasing importance of dynamic, service-oriented Web sites. Users do not navigate on these sites searching for information, but rather interact with an online application to complete certain tasks. Furthermore, the usage of multiple windows and tabs has partly replaced back button usage, posing new challenges for user orientation and backtracking. We found that Web browsing is a rapid activity even for pages with substantial content, which calls for page designs that allow for cursory reading. Click maps provide additional information on how users interact with the Web on page level. Finally, substantial differences were observed between users, and characteristic usage patterns for different types of Web sites emphasize the need for more adaptive and customizable Web browsers.

REFERENCES

• 1: David Abrams , Ron Baecker , Mark Chignell, Information archiving with bookmarks: personal Web space construction and organization, Proceedings of the SIGCHI conference on Human factors in computing systems, p.41-48, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274651]
• 2: Baker, K. R. 2003. The impact of paging vs. scrolling on reading online text passages. Usability News 5, 1. http://psychology.wichita.edu/surl/usabilitynews/51/paging_scrolling.htm.
• 3: Rob Barrett , Paul P. Maglio , Daniel C. Kellem, How to personalize the Web, Proceedings of the SIGCHI conference on Human factors in computing systems, p.75-82, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258595]
• 4: Bernard, M., Baker, K. R., and Fernandez, M. 2002. Paging vs. scrolling: Looking for the best way to present search results. Usability News 4, 1. http://psychology.wichita.edu/surl/usabilitynews/41/paging.htm.
• 5: Capra, R. and Pérez-Quiñones, M. 2003. Re-finding found things: An exploratory study of how users re-find information. Tech. Rep. cs.HC/0310011, Computing Research Repository (CoRR).
• 6: Lara D. Catledge , James E. Pitkow, Characterizing browsing strategies in the World-Wide Web, Computer Networks and ISDN Systems, v.27 n.6, p.1065-1073, April 1995
• 7: Chisholm, W., Vanderheiden, G., and Jacobs, I. 1999. Web content accessibility guidelines 1.0. World Wide Web Consortium Recommendation. http://www.w3.org/TR/WAI-WEBCONTENT/.
• 8: Junghoo Cho , Hector Garcia-Molina, The Evolution of the Web and Implications for an Incremental Crawler, Proceedings of the 26th International Conference on Very Large Data Bases, p.200-209, September 10-14, 2000
• 9: Choo, C. W., Detlor, B., and Turnbull, D. 2000. Information seeking on the Web: An integrated model of browsing and searching. First Monday Online J. 5, 2. http://firstmonday.org/issues/issue5_2/choo/index.html.
• 10: What do web users do? An empirical analysis of web use, International Journal of Human-Computer Studies, v.54 n.6, p.903-922, June 2001 [doi>10.1006/ijhc.2001.0459]
• 11: Andy Cockburn , Bruce McKenzie , Michael Jason Smith, Pushing back: evaluating a new behaviour for the back and forward buttons in web browsers, International Journal of Human-Computer Studies, v.57 n.5, p.397-414, November 2002 [doi>10.1006/ijhc.1025]
• 12: Jeff Conklin, Hypertext: An Introduction and Survey, Computer, v.20 n.9, p.17-41, September 1987 [doi>10.1109/MC.1987.1663693]
• 13: Carlos Cunha , Azer Bestavros , Mark Crovella, Characteristics of WWW Client-based Traces, Boston University, Boston, MA, 1995
• 14: ECMA-262. 1999. ECMAScript language definition. ECMA International. http://www.ecma-international.org/publications/files/ecma-st/ECMA-262.pdf
• 15: Dennis Fetterly , Mark Manasse , Marc Najork , Janet Wiener, A large-scale study of the evolution of web pages, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775246]
• 16: Greenberg, S. and Cockburn, A. 1999. Getting back to back: Alternate behaviors for a Web browser's back button. In Proceedings of 5th Human Factors and the Web Conference, Austin, TX.
• 17: Haas, S. W. and Grams, E. S. 1998. A link taxonomy for Web pages. In Proceedings of the 61st Annual Meeting of the Information Access in the Global Information Economy (ASIS'98). Information Today, Medford, NJ, 485--495.
• 18: Frank,G. Halasz, Reflections on NoteCards: seven issues for the next generation of hypermedia systems, Communications of the ACM, v.31 n.7, p.836-852, July 1988 [doi>10.1145/48511.48514]
• 19: Herder, E. 2006. Forward, back and home again---analyzing user behavior on the web. Ph.D. Thesis, University of Twente, The Netherlands.
• 20: Hoffman, M. 1997. Enabling extremely rapid navigation in your web or document, 2nd Version, (Dec.) http://www.hypertextnavigation.com/infoaxcs.htm.
• 21: Hyams, J. and Sellen, A. 2003. Gathering and sharing web-based information: Implications for ePerson concepts. HP Labs: Tech. rep. HPL-2003-19.
• 22: Hyatt, D. 2001. XML user interface language (XUL) 1.0. technical specification, Mozilla project. http://www.mozilla.org/projects/xul/xul.html.
• 23: ISO 9241/110. 2006. Ergonomics of human-system interaction---Part 110: Dialogue principles. International Standards Organization.
• 24: Bernard J. Jansen , Udo Pooch, A review of web searching studies and a framework for future research, Journal of the American Society for Information Science and Technology, v.52 n.3, p.235-246, Feb. 1, 2001 [doi>10.1002/1097-4571(2000)9999:9999<::AID-ASI1607>3.3.CO;2-6]
• 25: Bernard J. Jansen , Amanda Spink , Tefko Saracevic, Real life, real users, and real needs: a study and analysis of user queries on the web, Information Processing and Management: an International Journal, v.36 n.2, p.207-227, Jan.1.2000 [doi>10.1016/S0306-4573(99)00056-4]
• 26: Bernard J. Jansen , Amanda Spink, How are we searching the world wide web?: a comparison of nine search engine transaction logs, Information Processing and Management: an International Journal, v.42 n.1, p.248-263, January 2006 [doi>10.1016/j.ipm.2004.10.007]
• 27: William Jones , Harry Bruce , Susan Dumais, Keeping found things found on the web, Proceedings of the tenth international conference on Information and knowledge management, October 05-10, 2001, Atlanta, Georgia, USA [doi>10.1145/502585.502607]
• 28: Shaun Kaasten , Saul Greenberg, Integrating back, history and bookmarks in web browsers, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634291]
• 29: Kehoe, C., Pitkow, J., Sutton, K., Aggarwal, G., and Rogers, J. 1998. 10th GVU WWW user survey. http://www.cc.gatech.edu/gvu/user_surveys/survey-1998-10.
• 30: Melanie Kellar , Carolyn Watters , Kori M. Inkpen, An exploration of web-based monitoring: implications for design, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240686]
• 31: Andrea Knight , Guy Pyrzak , Collin Green, When two methods are better than one: combining user study with cognitive modeling, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA [doi>10.1145/1240866.1240900]
• 32: Patrick J. Lynch , Sarah Horton , Louis Rosenfeld, Web Style Guide: Basic Design Principles for Creating Web Sites, Yale University Press, New Haven, CT, 2002
• 33: B. McKenzie , A. Cockburn, An Empirical Analysis of Web Page Revisitation, Proceedings of the 34th Annual Hawaii International Conference on System Sciences ( HICSS-34)-Volume 5, p.5019, January 03-06, 2001
• 34: Meschkat, S. and Mittleman, J. 2007. Keeping the Web in Web 2.0: An HCI approach to designing Web applications. CHI 2007 Course, http://ajaxchi.googlepages.com/.
• 35: Natasa Milic-Frayling , Rachel Jones , Kerry Rodden , Gavin Smyth , Alan Blackwell , Ralph Sommerer, Smartback: supporting users in back navigation, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988682]
• 36: Morkes, J. and Nielsen, J. 1997. Concise, SCANNABLE, and objective: How to write for the web, Sun Microsystems. http://www.useit.com/papers/webwriting/writing.html.
• 37: Michael Moyle , Andy Cockburn, The design and evaluation of a flick gesture for 'back' and 'forward' in web browsers, Proceedings of the Fourth Australasian user interface conference on User interfaces 2003, p.39-46, February 01, 2003, Adelaide, Australia
• 38: Nicholas, D., Huntington, P., Jamali, H. R. and Tenopir, C. 2006. What deep log analysis tells us about the impact of big deals: Case study OhioLINK, J. Document. 62, 4, 482--508
• 39: Nielsen, J. 1997. The tyranny of the page: Continued lack of decent navigation support in version 4 browsers. Useit Alertbox, Nielsen Norman Group. http://www.useit.com/alertbox/9711a.html.
• 40: Nielsen, J. 2004. The need for Web design standards. Useit Alertbox, Nielsen Norman Group. http://www.useit.com/alertbox/20040913.html.
• 41: Nielsen, J. 2005. Ten best intranets of 2005. Useit Alertbox, Nielsen Norman Group. http://www.useit.com/alertbox/20050228.html.
• 42: Nielsen, J. 2006. F-shaped pattern for reading web content. Useit Alertbox, Nielsen Norman Group. http://www.useit.com/alertbox/reading_pattern.html.
• 43: Nielsen, J. 2006b. Screen resolution and page layout. Useit Alertbox, Nielsen Norman Group. http://www.useit.com/alertbox/screen_resolution.html.
• 44: Hartmut Obendorf , Harald Weinreich , Torsten Hass, Automatic support for web user studies with SCONE and TEA, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986007]
• 45: Hartmut Obendorf , Harald Weinreich , Eelco Herder , Matthias Mayer, Web page revisitation revisited: implications of a long-term click-stream study of browser usage, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240719]
• 46: Ottaway, M. 2004. Nielsen/Netratings data support TVNZ's widescreen Web decision. Nielsen/Netratings. http://www.nielsen-netratings.com/pr/pr_040504_nz.pdf.
• 47: Outing, S. and Ruel, L. 2004. The best of Eyetrack III: What we saw when we looked through their eyes. Eyetrack III, http://www.poynterextra.org/eyetrack2004/main.htm.
• 48: Peterson, E. 2004. Which screen resolution should you be using? Jupiterresearch Analyst Weblogs. http://weblogs.jupiterresearch.com/analysts/peterson/archives/003965.html.
• 49: James E. Pitkow, Summary of WWW characterizations, World Wide Web, v.2 n.1-2, p.3-13, 1999 [doi>10.1023/A:1019284202914]
• 50: Daniel E. Rose , Danny Levinson, Understanding user goals in web search, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988675]
• 51: Nadine Schmidt-Maenz , Martina Koch, A General Classification of (Search) Queries and Terms, Proceedings of the Third International Conference on Information Technology: New Generations, p.375-381, April 10-12, 2006 [doi>10.1109/ITNG.2006.9]
• 52: Abigail J. Sellen , Rachel Murphy , Kate L. Shaw, How knowledge workers use the web, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503418]
• 53: Shrestha, S. and Lenz, K. 2007. Eye gaze patterns while searching vs. browsing a Website. Usability News 9, 1, January 2007, Software Usability Research Lab, Wichita State University.
• 54: Myra Spiliopoulou , Bamshad Mobasher , Bettina Berendt , Miki Nakagawa, A Framework for the Evaluation of Session Reconstruction Heuristics in Web-Usage Analysis, INFORMS Journal on Computing, v.15 n.2, p.171-190, April 2003 [doi>10.1287/ijoc.15.2.171.14445]
• 55: Jared M. Spool , Tara Scanlon , Carolyn Snyder , Will Schroeder , Terri DeAngelo, Web site usability: a designer's guide, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 56: Linda Tauscher , Saul Greenberg, How people revisit web pages: empirical findings and implications for the design of history systems, International Journal of Human-Computer Studies, v.47 n.1, p.97-137, July 1997 [doi>10.1006/ijhc.1997.0125]
• 57: Jaime Teevan , Christine Alvarado , Mark S. Ackerman , David R. Karger, The perfect search engine is not enough: a study of orienteering behavior in directed search, Proceedings of the SIGCHI conference on Human factors in computing systems, p.415-422, April 24-29, 2004, Vienna, Austria [doi>10.1145/985692.985745]
• 58: Jaime Teevan , Eytan Adar , Rosie Jones , Michael Potts, History repeats itself: repeat queries in Yahoo's logs, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA [doi>10.1145/1148170.1148326]
• 59: The Counter, 2007. Global Screen Resolution Statistics. Jupitermedia Corporation.
• 60: University of Southern California. 2007. Digital Future Report. Annenberg School, Center for the Digital Future. http://www.digitalcenter.org/pages/current_report.asp?intGlobalId=19.
• 61: Weinreich, H. and Lamersdorf, W. 2003. Eine Umfrage zu Link- und Objekt-Attributen im Web. In Proceedings of Mensch und Computer. Stuttgart, Germany. Teubner Verlag, 387--390. http://vsis-www.informatik.uni-hamburg.de/getDoc.php/publications/121/weinreich-umfrage-2003.pdf.
• 62: Weinreich, H., Obendorf, H., and Herder, E. 2006. Data cleaning methods for client and proxy logs. In Proceedings of the Workshop of the World Wide Web Conference. Edinburgh, UK. http://torch.cs.dal.ca/~www2006/Workshop_submissions.html.
• 63: Ryen W. White , Steven M. Drucker, Investigating behavioral variability in web search, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242576]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: User issues

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

General Terms:
Design, Experimentation, Human Factors

Keywords:
Navigation, WWW, Web, browser interfaces, hypertext, usability, user study, web browsing, web design