Impact of search engines on page popularity

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Impact of search engines on page popularity

Full text

Pdf (172 KB)

Source

International World Wide Web Conference archive
Proceedings of the 13th international conference on World Wide Web table of contents

New York, NY, USA

SESSION: Search engineering 1 table of contents

Pages: 20 - 29

Year of Publication: 2004

ISBN:1-58113-844-X

Authors

Junghoo Cho	University of California at Los Angeles, Los Angeles, CA
Sourashis Roy	University of California at Los Angeles, Los Angeles, CA

Sponsor

ACM: Association for Computing Machinery

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 20, Downloads (12 Months): 225, Citation Count: 34

Additional Information:

abstract references cited by index terms collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/988672.988676 What is a DOI?

ABSTRACT

Recent studies show that a majority of Web page accesses are referred by search engines. In this paper we study the widespread use of Web search engines and its impact on the ecology of the Web. In particular, we study how much impact search engines have on the popularity evolution of Web pages. For example, given that search engines return currently popular" pages at the top of search results, are we somehow penalizing newly created pages that are not very well known yet? Are popular pages getting even more popular and new pages completely ignored? We first show that this unfortunate trend indeed exists on the Web through an experimental study based on real Web data. We then analytically estimate how much longer it takes for a new page to attract a large number of Web users when search engines return only popular pages at the top of search results. Our result shows that search engines can have an immensely worrisome impact on the discovery of new Web pages.

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Serge Abiteboul , Mihai Preda , Gregory Cobena, Adaptive on-line page importance computation, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775192]
	2	R. Albert, A.-L. Barabasi, and H. Jeong. Diameter of the World Wide Web. Nature, 401(6749):130--131, September 1999.
	3	A.-L. Barabasi and R. Albert. Emergence of scaling in random networks. Science, 286(5439):509--512, October 1999.
	4	Paul Barford , Azer Bestavros , Adam Bradley , Mark Crovella, Changes in Web client access patterns: Characteristics and caching implications, World Wide Web, v.2 n.1-2, p.15-28, 1999 [doi>10.1023/A:1019236319752]
	5	Brian E. Brewington , George Cybenko, How dynamic is the Web?, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.257-276, June 2000, Amsterdam, The Netherlands
	6	Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
	7	Andrei Broder , Ravi Kumar , Farzin Maghoul , Prabhakar Raghavan , Sridhar Rajagopalan , Raymie Stata , Andrew Tomkins , Janet Wiener, Graph structure in the Web, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.309-320, June 2000, Amsterdam, The Netherlands
	8	J. Cho and R. E. Adams. Page quality: In search of an unbiased web ranking. Technical report, UCLA Computer Science Department, November 2003.
	9	Junghoo Cho , Hector Garcia-Molina, The Evolution of the Web and Implications for an Incremental Crawler, Proceedings of the 26th International Conference on Very Large Data Bases, p.200-209, September 10-14, 2000
	10	B. D. Davison. Web traffic logs: An imperfect resource for evaluation. In Ninth Annual Conference of the Internet Society (INET'99), pages 22--25, June 1999.
	11	F. Douglis, A. Feldmann, and B. Krishnamurthy. Rate of change and other metrics: a live study of the world wide web. In Proceedings of the Second USENIX Symposium on Internetworking Technologies and Systems, October 1999.
	12	Dennis Fetterly , Mark Manasse , Marc Najork , Janet Wiener, A large-scale study of the evolution of web pages, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775246]
	13	Google information for webmasters. Available at http://www.google.com/webmasters/.
	14	Jun Hirai , Sriram Raghavan , Hector Garcia-Molina , Andreas Paepcke, WebBase: a repository of Web pages, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.277-293, June 2000, Amsterdam, The Netherlands
	15	B. A. Huberman, P. Pirolli, J. Pitkow, and R. M. Lukose. Strong regularities in world wide web surfing. Science, 280(5360):95--97, April 1998.
	16	Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Journal of the ACM (JACM), v.46 n.5, p.604-632, Sept. 1999 [doi>10.1145/324133.324140]
	17	J. Kleinberg, R. Kumar, P. Raghavan, S. Rajagopalan, and A. Tomkins. The web as a graph: measurements, models, and methods. In International Conference on Combinatorics and Computing, 1999.
	18	Ronny Lempel , Shlomo Moran, Predictive caching and prefetching of query results in search engines, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775156]
	19	Nielsen netratings search engine ratings. Brief summary is available athttp://searchenginewatch.com/reports/article.php/2156451, February 2003.
	20	S. Olsen. Does search engine's power threaten web's independence? Available at http://news.com.com/2009-1023963618.html, October 2002.
	21	L. Page, S. Brin, R. Motwani, and T. Winograd. The pagerank citation ranking: Bringing order to the web. Technical report, Stanford University Database Group, 1998. Available at http://dbpubs.stanford.edu:8090/pub/1999-66.
	22	D. M. Pennock, G. W. Flake, S. Lawrence, E. J. Glover, and C. L. Giles. Winners don't take all: Characterizing the competition for links on the web. Proceedings of the National Academy of Sciences, 99(8):5207--5211, 2002.
	23	John A. Tomlin, A new paradigm for ranking pages on the world wide web, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775202]
	24	Craig E. Wills , Mikhail Mikhailov, Towards a better understanding of Web resources and server responses for improved caching, Proceeding of the eighth international conference on World Wide Web, p.1231-1243, May 1999, Toronto, Canada
	25	J. L. Wolf , M. S. Squillante , P. S. Yu , J. Sethuraman , L. Ozsen, Optimal crawling strategies for web search engines, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511465]

CITED BY 34

	David Gibson, The site browser: catalyzing improvements in hypertext organization, Proceedings of the fifteenth ACM conference on Hypertext and hypermedia, August 09-13, 2004, Santa Cruz, CA, USA
	Sandeep Pandey , Sourashis Roy , Christopher Olston , Junghoo Cho , Soumen Chakrabarti, Shuffling a stacked deck: the case for partially randomized ranking of search engine results, Proceedings of the 31st international conference on Very large data bases, August 30-September 02, 2005, Trondheim, Norway
	Junghoo Cho , Sourashis Roy , Robert E. Adams, Page quality: in search of an unbiased web ranking, Proceedings of the 2005 ACM SIGMOD international conference on Management of data, June 14-16, 2005, Baltimore, Maryland
	Zaiqing Nie , Yuanzhi Zhang , Ji-Rong Wen , Wei-Ying Ma, Object-level ranking: bringing order to Web objects, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan
	Sandeep Pandey , Christopher Olston, User-centric Web crawling, Proceedings of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan
	Ramesh R. Sarukkai, How much is a keyword worth?, Special interest tracks and posters of the 14th international conference on World Wide Web, May 10-14, 2005, Chiba, Japan
	Daniel Gomes , Mário J. Silva, The Viúva Negra crawler: an experience report, Software—Practice & Experience, v.38 n.2, p.161-188, February 2008
	P. Ferragina , A. Gulli, A personalized search engine based on Web-snippet hierarchical clustering, Software—Practice & Experience, v.38 n.2, p.189-225, February 2008
	Mike Thelwall, Extracting accurate and complete results from search engines: Case study windows live, Journal of the American Society for Information Science and Technology, v.59 n.1, p.38-50, January 2008
	Bernardo A. Huberman , Fang Wu, The economics of attention: maximizing user value in information-rich environments, Proceedings of the 1st international workshop on Data mining and audience intelligence for advertising, p.16-20, August 12-12, 2007, San Jose, California
	Pedram Ghodsnia , Ali Mohammad Zareh Bidoki , Nasser Yazdani, A punishment/reward based approach to ranking, Proceedings of the 2nd international conference on Scalable information systems, June 06-08, 2007, Suzhou, China
	Rajeev Motwani , Ying Xu, Evolution of page popularity under random web graph models, Proceedings of the twenty-fifth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 26-28, 2006, Chicago, IL, USA
	Doug Warner , Stephen D. Durbin , J. Neal Richter , Zuzana Gedeon, Adaptive web sites: user studies and simulation, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland
	Feng Qiu , Junghoo Cho, Automatic identification of user interest for personalized search, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland
	Matthew Richardson , Amit Prakash , Eric Brill, Beyond PageRank: machine learning for static ranking, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland
	Pavel A. Dmitriev , Nadav Eiron , Marcus Fontoura , Eugene Shekita, Using annotations in enterprise search, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland
	Maeve O'Brien , Mark T. Keane, Modeling user behavior using a search-engine, Proceedings of the 12th international conference on Intelligent user interfaces, January 28-31, 2007, Honolulu, Hawaii, USA
	Qingzhao Tan , Prasenjit Mitra , C. Lee Giles, Designing clustering-based web crawling policies for search engine crawlers, Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, November 06-10, 2007, Lisbon, Portugal
	Mark T. Keane , Maeve O'Brien , Barry Smyth, Are people biased in their use of search engines?, Communications of the ACM, v.51 n.2, p.49-52, February 2008
	Mark R. Meiss , Filippo Menczer , Santo Fortunato , Alessandro Flammini , Alessandro Vespignani, Ranking web sites with real user traffic, Proceedings of the international conference on Web search and web data mining, February 11-12, 2008, Palo Alto, California, USA
	Frank McCown , Norou Diawara , Michael L. Nelson, Factors affecting website reconstruction from the web infrastructure, Proceedings of the 2007 conference on Digital libraries, June 18-23, 2007, Vancouver, BC, Canada
	John Garofalakis , John Giannakou , Theodoula Giannakoudi , Evangelos Sakkopoulos, Promo: novel metrics that combine hits and accessibility criteria in order to Promote important content and links, Proceedings of the 2007 Euro American conference on Telematics and information systems, May 14-17, 2007, Faro, Portugal
	Sandeep Pandey , Christopher Olston, Crawl ordering by search impact, Proceedings of the international conference on Web search and web data mining, February 11-12, 2008, Palo Alto, California, USA
	Ricardo Baeza-Yates , Álvaro Pereira , Nivio Ziviani, Genealogical trees on the web: a search engine user perspective, Proceeding of the 17th international conference on World Wide Web, April 21-25, 2008, Beijing, China
	Rajat Bhattacharjee , Ashish Goel, Algorithms and incentives for robust ranking, Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms, p.425-433, January 07-09, 2007, New Orleans, Louisiana
	Ali Mohammad Zareh Bidoki , Nasser Yazdani, DistanceRank: An intelligent ranking algorithm for web pages, Information Processing and Management: an International Journal, v.44 n.2, p.877-892, March, 2008
	Meeyoung Cha , Haewoon Kwak , Pablo Rodriguez , Yong-Yeol Ahn , Sue Moon, I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system, Proceedings of the 7th ACM SIGCOMM conference on Internet measurement, October 24-26, 2007, San Diego, California, USA
	Arun Kumar Agrahri , Divya Anand Thattandi Manickam , John Riedl, Can people collaborate to improve the relevance of search results?, Proceedings of the 2008 ACM conference on Recommender systems, October 23-25, 2008, Lausanne, Switzerland
	M. Hagenbuchner , A. Sperduti , A. C. Tsoi, Graph self-organizing maps for cyclic and unbounded graphs, Neurocomputing, v.72 n.7-9, p.1419-1430, March, 2009
	Dario Taraborelli, How the Web Is Changing the Way We Trust, Proceeding of the 2008 conference on Current Issues in Computing and Philosophy, p.194-204, June 24, 2008
	Martin Klein , Olena Hunsicker , Michael L. Nelson, Comparing the performance of us college football teams in the web and on the field, Proceedings of the 20th ACM conference on Hypertext and hypermedia, June 29-July 01, 2009, Torino, Italy
	Leif Azzopardi , Ciaran Owens, Search engine predilection towards news media providers, Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, July 19-23, 2009, Boston, MA, USA
	Brian Harrington , Robert Brazile , Kathleen Swigger, A practical method for browsing a relational database using a standard search engine, Integrated Computer-Aided Engineering, v.16 n.3, p.211-223, August 2009
	Mike Thelwall, Quantitative comparisons of search engine results, Journal of the American Society for Information Science and Technology, v.59 n.11, p.1702-1710, September 2008