A survey of Web metrics

ABSTRACT

The unabated growth and increasing significance of the World Wide Web has resulted in a flurry of research activity to improve its capacity for serving information more effectively. But at the heart of these efforts lie implicit assumptions about "quality" and "usefulness" of Web resources and services. This observation points towards measurements and models that quantify various attributes of web sites. The science of measuring all aspects of information, especially its storage and retrieval or informetrics has interested information scientists for decades before the existence of the Web. Is Web informetrics any different, or is it just an application of classical informetrics to a new medium? In this article, we examine this issue by classifying and discussing a wide ranging set of Web metrics. We present the origins, measurement functions, formulations and comparisons of well-known Web metrics for quantifying Web graph properties, Web page significance, Web page similarity, search and retrieval, usage characterization and information theoretic properties. We also discuss how these metrics can be applied for improving Web information access and use.

REFERENCES

• 1: Albert, R. and Barabasi, A. 2000. Topology of evolving networks: Local events and uncertainty. Phys. Rev. Lett. 84, 56--60.
• 2: Albert, R., Jeong, H., and Barabasi, A. 1999. The diameter of the world wide web. Nature 401, 130--131.
• 3: Barabasi, A. and Albert, R. 1999. Emergence of scaling in random networks. Science 286 (Oct.), 509--512.
• 4: Barabasi, A., Albert, R., and Jeong, A. 1999. Mean-field theory for scale free random networks. Phys. A 272, 173--187.
• 5: Barabasi, A., Albert, R., and Jeong, J. 2000. Scale-free characteristics of random networks: The topology of the world wide web. Phys. A, 281, 69--77.
• 6: Krishna Bharat , Andrei Broder, A technique for measuring the relative size and overlap of public Web search engines, Proceedings of the seventh international conference on World Wide Web 7, p.379-388, April 1998, Brisbane, Australia
• 7: Brian E. Brewington , George Cybenko, How dynamic is the Web?, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.257-276, June 2000, Amsterdam, The Netherlands
• 8: Andrei Z. Broder , Steven C. Glassman , Mark S. Manasse , Geoffrey Zweig, Syntactic clustering of the Web, Selected papers from the sixth international conference on World Wide Web, p.1157-1166, September 1997, Santa Clara, California, United States
• 9: Andrei Broder , Ravi Kumar , Farzin Maghoul , Prabhakar Raghavan , Sridhar Rajagopalan , Raymie Stata , Andrew Tomkins , Janet Wiener, Graph structure in the Web, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.309-320, June 2000, Amsterdam, The Netherlands
• 10: Boyce, B. R., Meadow, C. T., and Kraft, D. H. 1994. Measurement in Information Science. Academic Press Inc. Orlando, Fla.
• 11: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
• 12: Allan Borodin , Gareth O. Roberts , Jeffrey S. Rosenthal , Panayiotis Tsaparas, Finding authorities and hubs from link structures on the World Wide Web, Proceedings of the 10th international conference on World Wide Web, p.415-429, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372096]
• 13: Rodrigo A. Botafogo , Ehud Rivlin , Ben Shneiderman, Structural analysis of hypertexts: identifying hierarchies and useful metrics, ACM Transactions on Information Systems (TOIS), v.10 n.2, p.142-180, April 1992 [doi>10.1145/146802.146826]
• 14: Tim Bray, Measuring the Web, Proceedings of the fifth international World Wide Web conference on Computer networks and ISDN systems, p.993-1005, May 1996, Paris, France
• 15: Lara D. Catledge , James E. Pitkow, Characterizing browsing strategies in the World-Wide Web, Computer Networks and ISDN Systems, v.27 n.6, p.1065-1073, April 1995
• 16: Chakrabarti, S., Dom, B., Gibson, D., Kumar, R., Raghavan, P., Rajagopalan, S., and Tomkins, A. 1998a. Experiments in topic distillation. In Proceedings of the SIGIR Workshop on Hypertext IR.
• 17: Soumen Chakrabarti , Byron Dom , Prabhakar Raghavan , Sridhar Rajagopalan , David Gibson , Jon Kleinberg, Automatic resource compilation by analyzing hyperlink structure and associated text, Proceedings of the seventh international conference on World Wide Web 7, p.65-74, April 1998, Brisbane, Australia
• 18: Junghoo Cho , Hector Garcia-Molina , Lawrence Page, Efficient crawling through URL ordering, Proceedings of the seventh international conference on World Wide Web 7, p.161-172, April 1998, Brisbane, Australia
• 19: David Cohn , Huan Chang, Learning to Probabilistically Identify Authoritative Documents, Proceedings of the Seventeenth International Conference on Machine Learning, p.167-174, June 29-July 02, 2000
• 20: Jeffrey Dean , Monika R. Henzinger, Finding related pages in the World Wide Web, Proceeding of the eighth international conference on World Wide Web, p.1467-1479, May 1999, Toronto, Canada
• 21: Dhyani, D. 2001. Measuring the web: Metrics, models and methods. Master's Dissertation, School of Computer Engineering, Nanyang Technological University, Singapore.
• 22: Egghe, L. and Rousseau, R. 1990. Introduction to Informetrics. Elsevier Science Publishers. Amsterdam, The Netherlands.
• 23: David Gibson , Jon Kleinberg , Prabhakar Raghavan, Inferring Web communities from link topology, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.225-234, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276652]
• 24: David Hawking , Nick Craswell , Paul Thistlewaite , Donna Harman, Results and challenges in Web search evaluation, Proceeding of the eighth international conference on World Wide Web, p.1321-1330, May 1999, Toronto, Canada
• 25: Monika R. Henzinger , Allan Heydon , Michael Mitzenmacher , Marc Najork, Measuring index quality using random walks on the Web, Proceeding of the eighth international conference on World Wide Web, p.1291-1303, May 1999, Toronto, Canada
• 26: Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms, p.668-677, January 25-27, 1998, San Francisco, California, United States
• 27: Kleinberg, J., Kumar, R., Raghavan, P., Rajagopalan, S., and Tomkins, A. 1999. The web as a graph: Measurements, models, and methods. In Proceedings of the 5th International Conference on Computing and Combinatorics (COCOON).
• 28: Ravi Kumar , Prabhakar Raghavan , Sridhar Rajagopalan , Andrew Tomkins, Trawling the Web for emerging cyber-communities, Proceeding of the eighth international conference on World Wide Web, p.1481-1493, May 1999, Toronto, Canada
• 29: Larson, R. 1996. Bibliometrics of the world wide web: An exploratory analysis of the intellectual structure of cyberspace. In Annual Meeting of the American Society of Information Science.
• 30: Lawrence, S. and Giles, C. L. 1998. Searching the world wide web. Science 280 (Apr.).
• 31: Lawrence, S. and Giles, C. L. 1999. Searching the web: General and scientific information access. IEEE Commun. 37, 1, 116--122.
• 32: Dik L. Lee , Huei Chuang , Kent Seamons, Document Ranking and the Vector-Space Model, IEEE Software, v.14 n.2, p.67-75, March 1997 [doi>10.1109/52.582976]
• 33: R. Lempel , S. Moran, The stochastic approach for link-structure analysis (SALSA) and the TKC effect, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.387-401, June 2000, Amsterdam, The Netherlands
• 34: Ronny Lempel , Aya Soffer, PicASHOW: pictorial authority search by hyperlinks on the Web, Proceedings of the 10th international conference on World Wide Web, p.438-448, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372098]
• 35: Massimo Marchiori, The quest for correct information on the Web: hyper search engines, Selected papers from the sixth international conference on World Wide Web, p.1225-1235, September 1997, Santa Clara, California, United States
• 36: Montgomery, D. C. and Runger, G. C. 1994. Applied Statistics and Probability for Engineers. Wiley, New York.
• 37: Murray, B. H. and Moore, A. 2000. Sizing the internet. White paper. Available from http:// www.cyveillance.com/web/us/downloads/Sizing_the_Internet.pdf (July).
• 38: Perkowitz, M. and Etzioni, O. 1997. Adaptive web sites: An AI challenge. In Proceedings of the 15th International Joint Conference on Artificial Intelligence.
• 39: Mike Perkowitz , Oren Etzioni, Adaptive Web sites: automatically synthesizing Web pages, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.727-732, July 1998, Madison, Wisconsin, United States
• 40: Mike Perkowitz , Oren Etzioni, Towards adaptive Web sites: conceptual framework and case study, Proceeding of the eighth international conference on World Wide Web, p.1245-1258, May 1999, Toronto, Canada
• 41: Peter Pirolli , James Pitkow , Ramana Rao, Silk from a sow's ear: extracting usable structures from the Web, Proceedings of the SIGCHI conference on Human factors in computing systems: common ground, p.118-125, April 13-18, 1996, Vancouver, British Columbia, Canada [doi>10.1145/238386.238450]
• 42: James Pitkow, In search of reliable usage data on the WWW, Selected papers from the sixth international conference on World Wide Web, p.1343-1355, September 1997, Santa Clara, California, United States
• 43: James Pitkow , Peter Pirolli, Life, death, and lawfulness on the electronic frontier, Proceedings of the SIGCHI conference on Human factors in computing systems, p.383-390, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258805]
• 44: Davood Rafiei , Alberto O. Mendelzon, What is this page known for? Computing Web page reputations, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.823-835, June 2000, Amsterdam, The Netherlands
• 45: Margaret M. Recker , James E. Pitkow, Predicting document access in large multimedia repositories, ACM Transactions on Computer-Human Interaction (TOCHI), v.3 n.4, p.352-375, Dec. 1996 [doi>10.1145/235833.236058]
• 46: Ross, S. 1983. Stochastic Processes. Wiley, New York.
• 47: Selberg, E. and Etzioni, O. 1995. Multi-service search and comparison using the MetaCrawler. In Proceedings of the 4th International World Wide Web Conference.
• 48: Ramesh R. Sarukkai, Link prediction and path analysis using Markov chains, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.377-386, June 2000, Amsterdam, The Netherlands
• 49: Snell, L. 1998. Introduction to Probability. McGraw-Hill International Edition, Englewood Cliffs, N.J.
• 50: Ron Weiss , Bienvenido Vélez , Mark A. Sheldon, HyPursuit: a hierarchical network search engine that exploits content-link hypertext clustering, Proceedings of the the seventh ACM conference on Hypertext, p.180-193, March 16-20, 1996, Bethesda, Maryland, United States [doi>10.1145/234828.234846]
• 51: Tak Woon Yan , Matthew Jacobsen , Hector Garcia-Molina , Umeshwar Dayal, From user access patterns to dynamic hypertext linking, Proceedings of the fifth international World Wide Web conference on Computer networks and ISDN systems, p.1007-1014, May 1996, Paris, France
• 52: Budi Yuwono , Dik Lun Lee, Search and Ranking Algorithms for Locating Resources on the World Wide Web, Proceedings of the Twelfth International Conference on Data Engineering, p.164-171, February 26-March 01, 1996
• 53: Yuwono, B., Lam, S., Ying, J., and Lee, D. 1995. A world wide web resource discovery system. In Proceedings of the 4th International World Wide Web Conference.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.4 Systems and Software

          Nouns: World Wide Web (WWW)

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.0 General
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.0 General

General Terms:
Algorithms, Measurement

Keywords:
Information theoretic, PageRank, Web graph, Web metrics, Web page similarity, quality metrics