HITS algorithm improvement using anchor-related text extracted by DOM structure analysis

ABSTRACT

Kleinberg's HITS algorithm is a popular algorithm to rank web pages. One of its problems is the topic drift problem. Previous researchers have tried to solve this problem using anchor-related text. We proposed another type of anchor-related text in our previous study. This is found by executing a deep analysis on the DOM structures of web pages. We call our anchor-related text DOM-based anchor-related text (DOM-text). In this paper, we investigate the effectiveness of using DOM-text for improving the HITS algorithm. We examine how much we can improve the HITS algorithm. We also compare DOM-text with anchor-related text of other kinds. The experimental results show that the use of DOM-text is the best for improving the HITS algorithm.

REFERENCES

• 1: E. Amitay, Using common hypertext links to identify the best phrasal description of target web document, in: Proc. SIGIR'98 Post-Conference Workshop on Hypertext Information Retrieval for the Web, pp.271--276, 1998.
• 2: Einat Amitay , Cécile Paris, Automatically summarising Web sites: is there a way around it?, Proceedings of the ninth international conference on Information and knowledge management, p.173-179, November 06-11, 2000, McLean, Virginia, United States [doi>10.1145/354756.354816]
• 3: Krishna Bharat , Monika R. Henzinger, Improved algorithms for topic distillation in a hyperlinked environment, Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, p.104-111, August 24-28, 1998, Melbourne, Australia [doi>10.1145/290941.290972]
• 4: Avrim Blum , Tom Mitchell, Combining labeled and unlabeled data with co-training, Proceedings of the eleventh annual conference on Computational learning theory, p.92-100, July 24-26, 1998, Madison, Wisconsin, United States [doi>10.1145/279943.279962]
• 5: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
• 6: S. Jeromy Carrière , Rick Kazman, WebQuery: searching and visualizing the Web through connectivity, Selected papers from the sixth international conference on World Wide Web, p.1257-1267, September 1997, Santa Clara, California, United States
• 7: Soumen Chakrabarti , Byron Dom , Prabhakar Raghavan , Sridhar Rajagopalan , David Gibson , Jon Kleinberg, Automatic resource compilation by analyzing hyperlink structure and associated text, Proceedings of the seventh international conference on World Wide Web 7, p.65-74, April 1998, Brisbane, Australia
• 8: Brian D. Davison, Topical locality in the Web, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.272-279, July 24-28, 2000, Athens, Greece [doi>10.1145/345508.345597]
• 9: Document Object Model (DOM) Technical Reports, http://www.w3.org/DOM/DOMTR
• 10: Johannes Fürnkranz, Exploiting Structural Information for Text Classification on the WWW, Proceedings of the Third International Symposium on Advances in Intelligent Data Analysis, p.487-498, August 01, 1997
• 11: Eric J. Glover , Kostas Tsioutsiouliklis , Steve Lawrence , David M. Pennock , Gary W. Flake, Using web structure for classifying and describing web pages, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511520]
• 12: Erik Hatcher , Otis Gospodnetic, Lucene in Action (In Action series), Manning Publications Co., Greenwich, CT, 2004
• 13: D. Hawking, et al., Overview of the TREC-7 very large collection track, in: Proc. TREC-7, pp. 1--24, 1998.
• 14: Monika R. Henzinger, Hyperlink Analysis for the Web, IEEE Internet Computing, v.5 n.1, p.45-50, January 2001 [doi>10.1109/4236.895141]
• 15: Jun Hirai , Sriram Raghavan , Hector Garcia-Molina , Andreas Paepcke, WebBase: a repository of Web pages, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.277-293, June 2000, Amsterdam, The Netherlands
• 16: Bui Quang Hung , Masanori Otsubo , Yoshinori Hijikata , Shogo Nishida, Extraction of Semantic Text Portion Related to Anchor Link, IEICE - Transactions on Information and Systems, v.E89-D n.6, p.1834-1847, June 2006 [doi>10.1093/ietisy/e89-d.6.1834]
• 17: Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Journal of the ACM (JACM), v.46 n.5, p.604-632, Sept. 1999 [doi>10.1145/324133.324140]
• 18: Longzhuang Li , Yi Shang , Wei Zhang, Improvement of HITS-based algorithms on web documents, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511514]
• 19: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 20: http://code.google.com/apis/

INDEX TERMS

Primary Classification:
  F. Theory of Computation
  F.2 ANALYSIS OF ALGORITHMS AND PROBLEM COMPLEXITY
      F.2.m Miscellaneous

General Terms:
Algorithms, Experimentation, Performance

Keywords:
DOM, HITS algorithm, anchor-related text, link structure, web page ranking