The indexable web is more than 11.5 billion pages

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

The indexable web is more than 11.5 billion pages

Full text

Pdf (146 KB)

Source

International World Wide Web Conference archive
Special interest tracks and posters of the 14th international conference on World Wide Web table of contents

Chiba, Japan

POSTER SESSION: Posters table of contents

Pages: 902 - 903

Year of Publication: 2005

ISBN:1-59593-051-5

Authors

A. Gulli	Universitaá di Pisa
A. Signorini	University of Iowa

Sponsor

ACM: Association for Computing Machinery

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 15, Downloads (12 Months): 165, Citation Count: 48

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/1062745.1062789 What is a DOI?

ABSTRACT

In this short paper we estimate the size of the public indexable web at 11.5 billion pages. We also estimate the overlap and the index size of Google, MSN, Ask/Teoma and Yahoo!

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	A. Gulli , A. Signorini, Building an open source meta-search engine, Special interest tracks and posters of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan [doi>10.1145/1062745.1062840]
	2	Krishna Bharat , Andrei Broder, A technique for measuring the relative size and overlap of public Web search engines, Proceedings of the seventh international conference on World Wide Web 7, p.379-388, April 1998, Brisbane, Australia
	3	S. Lawrence and C. L. Giles. Accessibility of information on the web. Nature, 400:107--109, 1999.
	4	Erik Warren Selberg , Oren Etzioni, Towards comprehensive web search, 1999
	5	http://www.cs.uiowa.edu/~asignori/web-size/
	6	http://www.neci.nj.nec.com/homepages/lawrence/
	7	http://searchengineshowdown.com/stats/
	8	http://searchenginewatch.com/article.php/2156481

CITED BY 49

	A. Gulli , A. Signorini, Building an open source meta-search engine, Special interest tracks and posters of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan
	Ricardo Baeza-Yates , Paolo Boldi , Carlos Castillo, Generalizing PageRank: damping functions for link-based ranking algorithms, Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, August 06-11, 2006, Seattle, Washington, USA
	Judit Bar-Ilan , Mazlita Mat-Hassan , Mark Levene, Methods for comparing rankings of search engine results, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.50 n.10, p.1448-1463, 14 July 2006
	Amanda Spink , Bernard J. Jansen , Chris Blakely , Sherry Koshman, A study of results overlap and uniqueness among major web search engines, Information Processing and Management: an International Journal, v.42 n.5, p.1379-1391, September 2006
	P. Ferragina , A. Gulli, A personalized search engine based on Web-snippet hierarchical clustering, Software—Practice & Experience, v.38 n.2, p.189-225, February 2008
	Frank McCown , Joan A. Smith , Michael L. Nelson, Lazy preservation: reconstructing websites by crawling the crawlers, Proceedings of the eighth ACM international workshop on Web information and data management, November 10-10, 2006, Arlington, Virginia, USA
	Ziv Bar-Yossef , Maxim Gurevich, Random sampling from a search engine's index, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland
	Greg Pass , Abdur Chowdhury , Cayley Torgeson, A picture of search, Proceedings of the 1st international conference on Scalable information systems, p.1-es, May 30-June 01, 2006, Hong Kong
	Michael L. Nelson , Joan A. Smith , Ignacio Garcia del Campo, Efficient, automatic web resource harvesting, Proceedings of the eighth ACM international workshop on Web information and data management, November 10-10, 2006, Arlington, Virginia, USA
	Andrei Broder , Marcus Fontura , Vanja Josifovski , Ravi Kumar , Rajeev Motwani , Shubha Nabar , Rina Panigrahy , Andrew Tomkins , Ying Xu, Estimating corpus size via queries, Proceedings of the 15th ACM international conference on Information and knowledge management, November 06-11, 2006, Arlington, Virginia, USA
	G. Almpanidis , C. Kotropoulos , I. Pitas, Combining text and link analysis for focused crawling-An application for vertical search engines, Information Systems, v.32 n.6, p.886-908, September, 2007
	Amir Hosein Keyhanipour , Behzad Moshiri , Majid Kazemian , Maryam Piroozmand , Caro Lucas, Aggregation of web search engines based on users' preferences in WebFusion, Knowledge-Based Systems, v.20 n.4, p.321-328, May, 2007
	Calkin S. Montero , Kenji Araki, Is it correct?: towards web-based evaluation of automatic natural language phrase generation, Proceedings of the COLING/ACL on Interactive presentation sessions, p.5-8, July 17-18, 2006, Sydney, Australia
	Debora Donato , Luigi Laura , Stefano Leonardi , Stefano Millozzi, The Web as a graph: How far we are, ACM Transactions on Internet Technology (TOIT), v.7 n.1, p.4-es, February 2007
	Frank McCown , Norou Diawara , Michael L. Nelson, Factors affecting website reconstruction from the web infrastructure, Proceedings of the 2007 conference on Digital libraries, June 18-23, 2007, Vancouver, BC, Canada
	Frank McCown , Michael L. Nelson, Agreeing to disagree: search engines and their public interfaces, Proceedings of the 2007 conference on Digital libraries, June 18-23, 2007, Vancouver, BC, Canada
	Ziv Bar-Yossef , Maxim Gurevich, Efficient search engine measurements, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada
	Yon Dourisboure , Filippo Geraci , Marco Pellegrini, Extraction and classification of dense communities in the web, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada
	Dirk Lewandowski, Web searching, search engines and Information Retrieval, Information Services and Use, v.25 n.3,4, p.137-147, July 2005
	Luciana S. Buriol , Carlos Castillo , Debora Donato , Stefano Leonardi , Stefano Millozzi, Temporal Analysis of the Wikigraph, Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence, p.45-51, December 18-22, 2006
	Motohiro Mase , Seiji Yamada, Extracting Topic Maps from Web Histories by Clustering with Web Structure and Contents, Proceedings of the 2006 IEEE/WIC/ACM international conference on Web Intelligence and Intelligent Agent Technology, p.405-408, December 18-22, 2006
	Paul Thomas , David Hawking, Evaluating sampling methods for uncooperative collections, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands
	Teemu Koponen , Mohit Chawla , Byung-Gon Chun , Andrey Ermolinskiy , Kye Hyun Kim , Scott Shenker , Ion Stoica, A data-oriented (and beyond) network architecture, ACM SIGCOMM Computer Communication Review, v.37 n.4, October 2007
	James Hendler , Nigel Shadbolt , Wendy Hall , Tim Berners-Lee , Daniel Weitzner, Web science: an interdisciplinary approach to understanding the web, Communications of the ACM, v.51 n.7, July 2008
	Yi-Wen Tu , Meilun Shih , Chin-Chung Tsai, Eighth graders' web searching strategies and outcomes: The role of task types, web experiences and epistemological beliefs, Computers & Education, v.51 n.3, p.1142-1153, November, 2008
	M. Ángeles Serrano , Ana Maguitman , Marián Boguñá , Santo Fortunato , Alessandro Vespignani, Decoding the structure of the WWW: A comparative analysis of Web crawls, ACM Transactions on the Web (TWEB), v.1 n.2, p.10-es, August 2007
	Fabiano Atalla , Daniel Miranda , Jussara Almeida , Marcos André Gonçalves , Virgilio Almeida, Analyzing the impact of churn and malicious behavior on the quality of peer-to-peer web search, Proceedings of the 2008 ACM symposium on Applied computing, March 16-20, 2008, Fortaleza, Ceara, Brazil
	Maurice Coyle , Barry Smyth, Supporting intelligent Web search, ACM Transactions on Internet Technology (TOIT), v.7 n.4, p.20-es, October 2007
	Lin Li , Zhenglu Yang , Kulwadee Somboonviwat , Masaru Kitsuregawa, User-assisted similarity estimation for searching related web pages, Proceedings of the eighteenth conference on Hypertext and hypermedia, September 10-12, 2007, Manchester, UK
	Gianna M. Del Corso , Antonio Gullí , Francesco Romani, Comparison of Krylov subspace methods on the PageRank problem, Journal of Computational and Applied Mathematics, v.210 n.1-2, p.159-166, December, 2007
	Qiaozhu Mei , Kenneth Church, Entropy of search logs: how hard is search? with personalization? with backoff?, Proceedings of the international conference on Web search and web data mining, February 11-12, 2008, Palo Alto, California, USA
	Luca Becchetti , Carlos Castillo , Debora Donato , Ricardo Baeza-YATES , Stefano Leonardi, Link analysis for Web spam detection, ACM Transactions on the Web (TWEB), v.2 n.1, p.1-42, February 2008
	Ali Mohammad Zareh Bidoki , Nasser Yazdani, DistanceRank: An intelligent ranking algorithm for web pages, Information Processing and Management: an International Journal, v.44 n.2, p.877-892, March, 2008
	Alexandros Ntoulas , Junghoo Cho, Pruning policies for two-tiered inverted index with correctness guarantee, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands
	William-Chandra Tjhi , Lihui Chen, Possibilistic fuzzy co-clustering of large document collections, Pattern Recognition, v.40 n.12, p.3452-3466, December, 2007
	Dirk Lewandowski, A three-year study on the freshness of web search engine databases, Journal of Information Science, v.34 n.6, p.817-831, December 2008
	Ruhi Sarikaya, Rapid bootstrapping of statistical spoken dialogue systems, Speech Communication, v.50 n.7, p.580-593, July, 2008
	Luca Becchetti , Paolo Boldi , Carlos Castillo , Aristides Gionis, Efficient semi-streaming algorithms for local triangle counting in massive graphs, Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2008, Las Vegas, Nevada, USA
	Robert Pasley , Paul Clough , Ross S. Purves , Florian A. Twaroch, Mapping geographic coverage of the web, Proceedings of the 16th ACM SIGSPATIAL international conference on Advances in geographic information systems, November 05-07, 2008, Irvine, California
	Ziv Bar-Yossef , Maxim Gurevich, Mining search engine query logs via suggestion sampling, Proceedings of the VLDB Endowment, v.1 n.1, August 2008
	Ziv Bar-Yossef , Maxim Gurevich, Random sampling from a search engine's index, Journal of the ACM (JACM), v.55 n.5, p.1-74, October 2008
	Sofia Stamou , Alexandros Ntoulas, Search personalization through query and page topical analysis, User Modeling and User-Adapted Interaction, v.19 n.1-2, p.5-33, February 2009
	Yon Dourisboure , Filippo Geraci , Marco Pellegrini, Extraction and classification of dense implicit communities in the Web graph, ACM Transactions on the Web (TWEB), v.3 n.2, p.1-36, April 2009
	Yushi Uno , Yoshinobu Ota , Akio Uemichi, Web Structure Mining by Isolated Cliques, IEICE - Transactions on Information and Systems, v.E90-D n.12, p.1998-2006, December 2007
	Petri Jokela , András Zahemszky , Christian Esteve Rothenberg , Somaya Arianfar , Pekka Nikander, LIPSIN: line speed publish/subscribe inter-networking, ACM SIGCOMM Computer Communication Review, v.39 n.4, October 2009
	Rohit Kaul , Yeogirl Yun , Seong-Gon Kim, Ranking billions of web pages using diodes, Communications of the ACM, v.52 n.8, August 2009
	Frank McCown , Xiaoming Liu , Michael L. Nelson , Mohammad Zubair, Search Engine Coverage of the OAI-PMH Corpus, IEEE Internet Computing, v.10 n.2, p.66-73, March 2006
	Ahmet Uyar, Investigation of the accuracy of search engine hit counts, Journal of Information Science, v.35 n.4, p.469-480, August 2009
	Rongwei Cen , Yiqun Liu , Min Zhang , Liyun Ru , Shaoping Ma, Web Observation from a User Perspective, Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, p.291-294, September 15-18, 2009