Log-based indexing to improve web site search

ABSTRACT

Despite the success of global search engines, web site search is still problematic in its retrieval accuracy. In this paper, we try to improve the performance of the site search by combining a new source of evidence from web server logs. We propose a novel approach of using server log analysis to extract terms to build the web page index. Then, this log-based index is combined with the text-based and anchor-based index to provide a more complete view on the page content. Experiments have shown that it could improve the effectiveness of the web site search significantly.

REFERENCES

• 1: Bodo Billerbeck , Falk Scholer , Hugh E. Williams , Justin Zobel, Query expansion using associated queries, Proceedings of the twelfth international conference on Information and knowledge management, November 03-08, 2003, New Orleans, LA, USA [doi>10.1145/956863.956866]
• 2: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
• 3: R. Cooley, B. Mobasher, and J. Srivastava, Data preparation for mining World Wide Web browsing patterns, In Knowledge and Information Systems, 1(1):5--32, 1999.
• 4: W. B. Croft, Combining approaches to information retrieval, In Advances in Information Retrieval: Recent Research from the Center for Intelligent Information Retrieval, pp. 1--36, Kluwer Academic Publishers, 2000.
• 5: Qing Cui , Alex Dekhtyar, On improving local website search using web server traffic logs: a preliminary report, Proceedings of the 7th annual ACM international workshop on Web information and data management, November 04-04, 2005, Bremen, Germany [doi>10.1145/1097047.1097060]
• 6: Ronald Fagin , Ravi Kumar , Kevin S. McCurley , Jasmine Novak , D. Sivakumar , John A. Tomlin , David P. Williamson, Searching the workplace web, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775204]
• 7: David Hawking , Francis Crimmins , Nick Craswell , Trystan Upstill, How valuable is external link evidence when searching enterprise Webs?, Proceedings of the 15th Australasian database conference, p.77-84, January 01, 2004, Dunedin, New Zealand
• 8: Jon M. Kleinberg, Authoritative sources in a hyperlinked environment, Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms, p.668-677, January 25-27, 1998, San Francisco, California, United States
• 9: Massimo Marchiori, The quest for correct information on the Web: hyper search engines, Selected papers from the sixth international conference on World Wide Web, p.1225-1235, September 1997, Santa Clara, California, United States
• 10: Tao Qin , Tie-Yan Liu , Xu-Dong Zhang , Zheng Chen , Wei-Ying Ma, A study of relevance propagation for web search, Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, August 15-19, 2005, Salvador, Brazil [doi>10.1145/1076034.1076105]
• 11: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 12: Falk Scholer , Hugh E. Williams , Andrew Turpin, Query association surrogates for Web search: Research Articles, Journal of the American Society for Information Science and Technology, v.55 n.7, p.637-650, May 2004 [doi>10.1002/asi.v55:7]
• 13: A. Shakery, and C. X. Zhai, Relevance propagation for topic distillation, UIUC TREC 2003 Web Track Experiments, In the 12th Text REtrieval Conference, 2003.
• 14: Gui-Rong Xue , Hua-Jun Zeng , Zheng Chen , Wei-Ying Ma , Chao-Jun Lu, Log Mining to Improve the Performance of Site Search, Proceedings of the Third International Conference on Web Information Systems Engineering (Workshops) - (WISEw'02), p.238, December 11-11, 2002
• 15: Gui-Rong Xue , Hua-Jun Zeng , Zheng Chen , Wei-Ying Ma , Hong-Jiang Zhang , Chao-Jun Lu, Implicit link analysis for small web search, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860448]
• 16: Gui-Rong Xue , Hua-Jun Zeng , Zheng Chen , Yong Yu , Wei-Ying Ma , WenSi Xi , WeiGuo Fan, Optimizing web search using web click-through data, Proceedings of the thirteenth ACM international conference on Information and knowledge management, November 08-13, 2004, Washington, D.C., USA [doi>10.1145/1031171.1031192]
• 17: J. Zhou, Web site search: rank combination with supporting evidence, Master's Thesis, 2006.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Keywords:
log-based indexing, term propagation, web site search