ACM Portal
  Subscribe (Full Service)    Register (Limited Service, Free)    Login
  Search:   The ACM Digital Library   The Guide
  
ACM Home Page
Please provide us with feedback. Feedback
Challenges in web search engines
Full text PdfPdf (279 KB)
Source ACM SIGIR Forum archive
Volume 36 ,  Issue 2  (Fall 2002) table of contents
SESSION: Papers table of contents
Pages: 11 - 22  
Year of Publication: 2002
ISSN:0163-5840
Authors
Monika R. Henzinger  Google In., Main View, CA
Rajeev Motwani  Stanford University, Stanford, CA
Craig Silverstein  Google In., Main View, CA
Publisher
ACM  New York, NY, USA
Bibliometrics
Downloads (6 Weeks): 37,   Downloads (12 Months): 126,   Citation Count: 33
Additional Information:

abstract   references   cited by   collaborative colleagues  

Tools and Actions: Review this Article  
DOI Bookmark: Use this link to bookmark this Article: http://doi.acm.org/10.1145/792550.792553
What is a DOI?

ABSTRACT

This article presents a high-level discussion of some problems in information retrieval that are unique to web search engines. The goal is to raise awareness and stimulate research in these areas.


REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

 
1
H. Ahonen, H. Mannila, and E. Nikunen. "Generating grammars for SGML tagged texts lacking DTD." PODP'94 - Worskhop on Principles of Document Processing, 1994. http://www.cs.Helsinki.FI/u/hahonen/publications.html.
 
2
G. K. Berland, M. N. Elliott, L. S. Morales, J. I. Algazy, R. L. Kravitz, M. S. Broder, D. E. Kanouse, J. A. Muñoz, J.-A. Puyol, M. Lara, K. E. Watkins, H. Yang, and E. A. McGlynn. "Health Information on the Internet Accessibility, Quality, and Readability in English and Spanish." Journal of the American Medical Association, 285(2001): 2612-2621.
 
3
Krishna Bharat , Andrei Broder , Jeffrey Dean , Monika R. Henzinger, A comparison of techniques to find mirrored hosts on the WWW, Journal of the American Society for Information Science, v.51 n.12, p.1114-1122, Oct. 2000  [doi>10.1002/1097-4571(2000)9999:9999<::AID-ASI1025>3.0.CO;2-0]
4
Sergey Brin , James Davis , Héctor García-Molina, Copy detection mechanisms for digital documents, Proceedings of the 1995 ACM SIGMOD international conference on Management of data, p.398-409, May 22-25, 1995, San Jose, California, United States
 
5
Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
 
6
S. Brin, L. Page, R. Motwani, and T. Winograd. "What can you do with a Web in your Pocket?" Bulletin of the Technical Committee on Data Engineering, 21(1998): 37-47.
 
7
A. Broder, On the Resemblance and Containment of Documents, Proceedings of the Compression and Complexity of Sequences 1997, p.21, June 11-13, 1997
8
Soumen Chakrabarti , Mukul Joshi , Vivek Tawde, Enhanced topic distillation using text, markup tags, and hyperlinks, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.208-216, September 2001, New Orleans, Louisiana, United States  [doi>10.1145/383952.383990]
9
Soumen Chakrabarti, Integrating the document object model with hyperlinks for enhanced topic distillation and information extraction, Proceedings of the 10th international conference on World Wide Web, p.211-220, May 01-05, 2001, Hong Kong, Hong Kong  [doi>10.1145/371920.372054]
10
Junghoo Cho , Narayanan Shivakumar , Hector Garcia-Molina, Finding replicated Web collections, Proceedings of the 2000 ACM SIGMOD international conference on Management of data, p.355-366, May 15-18, 2000, Dallas, Texas, United States
11
Nick Craswell , David Hawking , Stephen Robertson, Effective site finding using link anchor information, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.250-257, September 2001, New Orleans, Louisiana, United States  [doi>10.1145/383952.383999]
12
Pete Faraday, Attending to web pages, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington  [doi>10.1145/634067.634165]
 
13
Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms, p.668-677, January 25-27, 1998, San Francisco, California, United States
 
14
T. Joachims. "Evaluation Search Engines using Clickthrough Data". To appear, 2002.
15
Svetlozar Nestorov , Serge Abiteboul , Rajeev Motwani, Extracting schema from semistructured data, Proceedings of the 1998 ACM SIGMOD international conference on Management of data, p.295-306, June 01-04, 1998, Seattle, Washington, United States
 
16
Ravi Kumar , Prabhakar Raghavan , Sridhar Rajagopalan , Andrew Tomkins, Trawling the Web for emerging cyber-communities, Proceeding of the eighth international conference on World Wide Web, p.1481-1493, May 1999, Toronto, Canada
17
Craig Silverstein , Hannes Marais , Monika Henzinger , Michael Moricz, Analysis of a very large web search engine query log, ACM SIGIR Forum, v.33 n.1, p.6-12, Fall 1999  [doi>10.1145/331403.331405]
 
18
World Wide Web Consortium. "Web Style Sheets." http://www.w3.org/Style/.

CITED BY  34
Einat Amitay , David Carmel , Adam Darlow , Ronny Lempel , Aya Soffer, The connectivity sonar: detecting site functionality by structural patterns, Proceedings of the fourteenth ACM conference on Hypertext and hypermedia, August 26-30, 2003, Nottingham, UK
Tad Hogg , Lada Adamic, Enhancing reputation mechanisms via online social networks, Proceedings of the 5th ACM conference on Electronic commerce, May 17-20, 2004, New York, NY, USA
Dennis Fetterly , Mark Manasse , Marc Najork, Detecting phrase-level duplication on the world wide web, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil
Dennis Fetterly , Mark Manasse , Marc Najork, Spam, damn spam, and statistics: using statistical analysis to locate spam web pages, Proceedings of the 7th International Workshop on the Web and Databases: colocated with ACM SIGMOD/PODS 2004, June 17-18, 2004, Paris, France
Judit Bar-Ilan, What do we know about links and linking? A framework for studying links in academic environments, Information Processing and Management: an International Journal, v.41 n.4, p.973-986, July 2005
Zoltán Gyöngyi , Hector Garcia-Molina, Link spam alliances, Proceedings of the 31st international conference on Very large data bases, August 30-September 02, 2005, Trondheim, Norway
Mirena S. Chausheva, Calculating web page trustworthiness by exploring communities on the web, Journal of Computing Sciences in Colleges, v.19 n.5, p.314-315, May 2004
Udo Kruschwitz , Hala Al-Bakour, Users want more sophisticated search assistants: results of a task-based evaluation, Journal of the American Society for Information Science and Technology, v.56 n.13, p.1377-1393, November 2005
Thomas Mandl, Implementation and evaluation of a quality-based search engine, Proceedings of the seventeenth conference on Hypertext and hypermedia, August 22-25, 2006, Odense, Denmark
Alexandros Ntoulas , Marc Najork , Mark Manasse , Dennis Fetterly, Detecting spam web pages through content analysis, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland
Daniel Gomes , Mário J. Silva, The Viúva Negra crawler: an experience report, Software—Practice & Experience, v.38 n.2, p.161-188, February 2008
Zoltan Gyongyi , Pavel Berkhin , Hector Garcia-Molina , Jan Pedersen, Link spam detection based on mass estimation, Proceedings of the 32nd international conference on Very large data bases, September 12-15, 2006, Seoul, Korea
Baoning Wu , Brian D. Davison, Undue influence: eliminating the impact of link plagiarism on web search rankings, Proceedings of the 2006 ACM symposium on Applied computing, April 23-27, 2006, Dijon, France
Baoning Wu , Brian D. Davison, Detecting semantic cloaking on the web, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland
Baoning Wu , Vinay Goel , Brian D. Davison, Topical TrustRank: using topicality to combat web spam, Proceedings of the 15th international conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland
Qingqing Gan , Torsten Suel, Improving web spam classifiers using link structure, Proceedings of the 3rd international workshop on Adversarial information retrieval on the web, May 08-08, 2007, Banff, Alberta, Canada
Tim Berners-Lee , Wendy Hall , James A. Hendler , Kieron O'Hara , Nigel Shadbolt , Daniel J. Weitzner, A framework for web science, Foundations and Trends in Web Science, v.1 n.1, p.1-130, January 2006
Ye Du , Yaoyun Shi , Xin Zhao, Using spam farm to boost PageRank, Proceedings of the 3rd international workshop on Adversarial information retrieval on the web, May 08-08, 2007, Banff, Alberta, Canada
András Benczúr , István Bíró , Károly Csalogány , Tamás Sarlós, Web spam detection via commercial intent analysis, Proceedings of the 3rd international workshop on Adversarial information retrieval on the web, May 08-08, 2007, Banff, Alberta, Canada
R. Lempel , S. Moran, Rank-Stability and Rank-Similarity of Link-Based Web Ranking Algorithms in Authority-Connected Graphs, Information Retrieval, v.8 n.2, p.245-264, April 2005
Orland Hoeber , Xue Dong Yang, Evaluating WordBars in exploratory Web search scenarios, Information Processing and Management: an International Journal, v.44 n.2, p.485-510, March, 2008
Saverio Perugini, Symbolic links in the Open Directory Project, Information Processing and Management: an International Journal, v.44 n.2, p.910-930, March, 2008
Carlos Castillo , Debora Donato , Aristides Gionis , Vanessa Murdock , Fabrizio Silvestri, Know your neighbors: web spam detection using the web topology, Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, July 23-27, 2007, Amsterdam, The Netherlands
Ali Mohammad Zareh Bidoki , Nasser Yazdani, DistanceRank: An intelligent ranking algorithm for web pages, Information Processing and Management: an International Journal, v.44 n.2, p.877-892, March, 2008
Carlos Castillo , Kumar Chellapilla , Dennis Fetterly, Fourth international workshop on adversarial information retrieval on the web (AIRWeb 2008), Proceeding of the 17th international conference on World Wide Web, April 21-25, 2008, Beijing, China
István Bíró , Jácint Szabó , András A. Benczúr, Latent dirichlet allocation in web spam filtering, Proceedings of the 4th international workshop on Adversarial information retrieval on the web, April 22-22, 2008, Beijing, China
István Bíró , Dávid Siklósi , Jácint Szabó , András A. Benczúr, Linked latent Dirichlet allocation in web spam filtering, Proceedings of the 5th International Workshop on Adversarial Information Retrieval on the Web, April 21-21, 2009, Madrid, Spain
Miklós Erdélyi , András A. Benczúr , Julien Masanés , Dávid Siklósi, Web spam filtering in internet archives, Proceedings of the 5th International Workshop on Adversarial Information Retrieval on the Web, April 21-21, 2009, Madrid, Spain
Timothy Jones , Ramesh Sankaranarayana , David Hawking , Nick Craswell, Nullification test collections for web spam and SEO, Proceedings of the 5th International Workshop on Adversarial Information Retrieval on the Web, April 21-21, 2009, Madrid, Spain
Rohit Kaul , Yeogirl Yun , Seong-Gon Kim, Ranking billions of web pages using diodes, Communications of the ACM, v.52 n.8, August 2009
Iris Xie , Colleen Cool, Understanding help seeking within the context of searching digital libraries, Journal of the American Society for Information Science and Technology, v.60 n.3, p.477-494, March 2009
Monika R. Henzinger , Rajeev Motwani , Craig Silverstein, Challenges in web search engines, Proceedings of the 18th international joint conference on Artificial intelligence, p.1573-1579, August 09-15, 2003, Acapulco, Mexico
Peng Zhang , Yuexian Hou , Dawei Song, Approximating true relevance distribution from a mixture model based on irrelevance data, Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval, July 19-23, 2009, Boston, MA, USA
Rongwei Cen , Yiqun Liu , Min Zhang , Liyun Ru , Shaoping Ma, Web Observation from a User Perspective, Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, p.291-294, September 15-18, 2009
Collaborative Colleagues:
Monika R. Henzinger: colleagues
Rajeev Motwani: colleagues
Craig Silverstein: colleagues

The ACM Portal is published by the Association for Computing Machinery. Copyright © 2009 ACM, Inc.
Terms of Usage   Privacy Policy   Code of Ethics   Contact Us

Useful downloads: Adobe Acrobat    QuickTime    Windows Media Player    Real Player