Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

This article describes the CLEVER search system developed at the IBM Almaden Research Center. We present a detailed and unified exposition of the various algorithmic components that make up the system, and then present results from two user studies.

REFERENCES

• 1: A. Fiat , A. Karlin , F. McSherry, Web Search via Hub Synthesis, Proceedings of the 42nd IEEE symposium on Foundations of Computer Science, p.500, October 14-17, 2001
• 2: Krishna Bharat , Monika R. Henzinger, Improved algorithms for topic distillation in a hyperlinked environment, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.104-111, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290972]
• 3: Allan Borodin , Gareth O. Roberts , Jeffrey S. Rosenthal , Panayiotis Tsaparas, Link analysis ranking: algorithms, theory, and experiments, ACM Transactions on Internet Technology (TOIT), v.5 n.1, p.231-297, February 2005 [doi>10.1145/1052934.1052942]
• 4: Allan Borodin , Gareth O. Roberts , Jeffrey S. Rosenthal , Panayiotis Tsaparas, Finding authorities and hubs from link structures on the World Wide Web, Proceedings of the 10th international conference on World Wide Web, p.415-429, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372096]
• 5: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
• 6: Andrei Z. Broder , Steven C. Glassman , Mark S. Manasse , Geoffrey Zweig, Syntactic clustering of the Web, Selected papers from the sixth international conference on World Wide Web, p.1157-1166, September 1997, Santa Clara, California, United States
• 7: Soumen Chakrabarti, Integrating the document object model with hyperlinks for enhanced topic distillation and information extraction, Proceedings of the 10th international conference on World Wide Web, p.211-220, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372054]
• 8: Soumen Chakrabarti , Byron Dom , Prabhakar Raghavan , Sridhar Rajagopalan , David Gibson , Jon Kleinberg, Automatic resource compilation by analyzing hyperlink structure and associated text, Proceedings of the seventh international conference on World Wide Web 7, p.65-74, April 1998, Brisbane, Australia
• 9: Chakrabarti, S., Dom, B., Gibson, D., Kumar, R., Raghavan, P., Rajagopalan, S., and Tomkins, A. 1998b. Spectral filtering for resource discovery. In Proceedings of the ACM SIGIR Workshop on Hypertext Analysis. ACM Press, New York, NY, 13--21.
• 10: David Cohn , Huan Chang, Learning to Probabilistically Identify Authoritative Documents, Proceedings of the Seventeenth International Conference on Machine Learning, p.167-174, June 29-July 02, 2000
• 11: Jeffrey Dean , Monika R. Henzinger, Finding related pages in the World Wide Web, Proceeding of the eighth international conference on World Wide Web, p.1467-1479, May 1999, Toronto, Canada
• 12: Chris Ding , Xiaofeng He , Parry Husbands , Hongyuan Zha , Horst D. Simon, PageRank, HITS and a unified framework for link analysis, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564440]
• 13: Joel C. Miller , Gregory Rae , Fred Schaefer , Lesley A. Ward , Thomas LoFaro , Ayman Farahat, Modifications of Kleinberg's HITS algorithm using matrix exponentiation and web log records, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.444-445, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.384086]
• 14: Feller, W. 1968. An Introduction to Probability Theory and its Applications, I & II. John Wiley, New York, NY.
• 15: David Gibson , Jon Kleinberg , Prabhakar Raghavan, Clustering categorical data: an approach based on dynamical systems, The VLDB Journal — The International Journal on Very Large Data Bases, v.8 n.3-4, p.222-236, February 2000 [doi>10.1007/s007780050005]
• 16: Golub, G. and Loan, C. V. 1989. Matrix Computations. Johns Hopkins University Press, Baltimore, MD.
• 17: Taher H. Haveliwala, Topic-sensitive PageRank, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511513]
• 18: Thomas Hofmann, Learning probabilistic models of the Web (poster session), Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.369-371, July 24-28, 2000, Athens, Greece [doi>10.1145/345508.345660]
• 19: Glen Jeh , Jennifer Widom, Scaling personalized web search, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775191]
• 20: Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Journal of the ACM (JACM), v.46 n.5, p.604-632, Sept. 1999 [doi>10.1145/324133.324140]
• 21: Jon Kleinberg , Andrew Tomkins, Applications of linear algebra in information retrieval and hypertext analysis, Proceedings of the eighteenth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, p.185-193, May 31-June 03, 1999, Philadelphia, Pennsylvania, United States [doi>10.1145/303976.303995]
• 22: Ravi Kumar , Prabhakar Raghavan , Sridhar Rajagopalan , Andrew Tomkins, Trawling the Web for emerging cyber-communities, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.31 n.11-16, p.1481-1493, May 17, 1999
• 23: Kumar, R., Raghavan, P., Rajagopalan, S., and Tomkins, A. 2001. On semi-automated Web taxonomy construction. In Proceedings of the 4th ACM WebDB. ACM Press, New York, NY, 91--96.
• 24: Amy N. Langville , Carl D. Meyer, A Survey of Eigenvector Methods for Web Information Retrieval, SIAM Review, v.47 n.1, p.135-161, 2005 [doi>10.1137/S0036144503424786]
• 25: R. Lempel , S. Moran, The stochastic approach for link-structure analysis (SALSA) and the TKC effect, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.33 n.1-6, p.387-401, June 2000
• 26: R. Lempel , S. Moran, SALSA: the stochastic approach for link-structure analysis, ACM Transactions on Information Systems (TOIS), v.19 n.2, p.131-160, April 2001 [doi>10.1145/382979.383041]
• 27: Longzhuang Li , Yi Shang , Wei Zhang, Improvement of HITS-based algorithms on web documents, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511514]
• 28: Y. S. Maarek , F. Z. Smadja, Full text indexing based on lexical relations an application: software libraries, Proceedings of the 12th annual international ACM SIGIR conference on Research and development in information retrieval, p.198-206, June 25-28, 1989, Cambridge, Massachusetts, United States
• 29: Andrew Y. Ng , Alice X. Zheng , Michael I. Jordan, Stable algorithms for link analysis, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.258-266, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.384003]
• 30: Page, L., Brin, S., Motwani, R., and Winograd, T. 1998. The pagerank citation ranking: Bringing order to the Web. Tech. rep. Stanford University, Stanford, CA.
• 31: Davood Rafiei , Alberto O. Mendelzon, What is this page known for? Computing Web page reputations, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.33 n.1-6, p.823-835, June 2000
• 32: P. Krishna Reddy , Masaru Kitsuregawa, An Approach to Relate the Web Communities through Bipartite Graphs, Proceedings of the Second International Conference on Web Information Systems Engineering (WISE'01) Volume 1, p.301, December 03-06, 2001
• 33: Richardson, M. and Domingos, P. 2002. The intelligent surfer: Probabilistic combination of link and content information in pagerank. In Advances in Neural Information Processing Systems (NIPS). Morgan Kaufmann, San Francisco, CA, 1441--1448.
• 34: Salton, G. and Buckley, C. 1990. Improving retrieval performance for relevance feedback. J. Amer. Soc. Informat. Sci. 41, 4, 288--297.
• 35: John A. Tomlin, A new paradigm for ranking pages on the world wide web, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775202]
• 36: Toyoda, M. and Kitsuregawa, M. 2001. A Web community chart for navigating related communities. In Proceedings of the 10th International World Wide Web Conference. Poster.
• 37: Panayiotis Tsaparas , Allan Borodin, Link analysis ranking, 2004
• 38: Panayiotis Tsaparas, Using non-linear dynamical systems for web searching and ranking, Proceedings of the twenty-third ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, June 14-16, 2004, Paris, France [doi>10.1145/1055558.1055569]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

General Terms:
Algorithms, Experimentation, Measurement

Keywords:
Anchortext, Web search, hyperlinks, linear algebra, link analysis