Query-independent evidence in home page finding

ABSTRACT

Hyperlink recommendation evidence, that is, evidence based on the structure of a web's link graph, is widely exploited by commercial Web search systems. However there is little published work to support its popularity. Another form of query-independent evidence, URL-type, has been shown to be beneficial on a home page finding task. We compared the usefulness of these types of evidence on the home page finding task, combined with both content and anchor text baselines. Our experiments made use of five query sets spanning three corpora---one enterprise crawl, and the WT10g and VLC2 Web test collections.We found that, in optimal conditions, all of the query-independent methods studied (in-degree, URL-type, and two variants of PageRank) offered a better than random improvement on a content-only baseline. However, only URL-type offered a better than random improvement on an anchor text baseline. In realistic settings, for either baseline, only URL-type offered consistent gains. In combination with URL-type the anchor text baseline was more useful for finding popular home pages, but URL-type with content was more useful for finding randomly selected home pages. We conclude that a general home page finding system should combine evidence from document content, anchor text, and URL-type classification.

REFERENCES

• 1: Brian Amento , Loren Terveen , Will Hill, Does “authority” mean quality? predicting expert quality ratings of Web documents, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.296-303, July 24-28, 2000, Athens, Greece [doi>10.1145/345508.345603]
• 2: Peter Bailey , Nick Craswell , David Hawking, Engineering a multi-purpose test collection for web retrieval experiments, Information Processing and Management: an International Journal, v.39 n.6, p.853-871, November 2003 [doi>10.1016/S0306-4573(02)00084-5]
• 3: Krishna Bharat , George A. Mihaila, When experts agree: using non-affiliated experts to rank popular topics, Proceedings of the 10th international conference on World Wide Web, p.597-602, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372162]
• 4: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
• 5: Andrei Broder, A taxonomy of web search, ACM SIGIR Forum, v.36 n.2, Fall 2002 [doi>10.1145/792550.792552]
• 6: S. Jeromy Carrière , Rick Kazman, WebQuery: searching and visualizing the Web through connectivity, Selected papers from the sixth international conference on World Wide Web, p.1257-1267, September 1997, Santa Clara, California, United States
• 7: Nick Craswell , David Hawking , Stephen Robertson, Effective site finding using link anchor information, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.250-257, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.383999]
• 8: DMOZ. n.d. Open directory project. See Web site www.dmoz.org.
• 9: Excite. 2002. Excite. See Web site www.excite.com.
• 10: FAST Search and Transfer, ASA. Personal communication. See Web site www.alltheweb.com.
• 11: Google. 2003a. Google search appliance frequently asked questions. Available online at www.google.com/appliance/faq.html.
• 12: Google. 2003b. Google search engine. See Web site www.google.com.
• 13: Hawking, D. 2000. Overview of the TREC-9 Web Track. In Proceedings of TREC-9. Available online at trec.nist.gov/pubs/trec9/.
• 14: Hawking, D. and Craswell, N. 2001. Overview of the TREC-2001 Web Track. In Proceedings of TREC-2001 (Gaithersburg, MD). Available online at trec.nist.gov/pubs/.
• 15: Hawking, D., Craswell, N., and Griffiths, K. 2001. Which search engine is best at finding online services? In WWW10 Poster Proceedings (Hong Kong). Available online at www10.org/ cdrom/posters/1089.pdf.
• 16: Hawking, D., Voorhees, E., Bailey, P., and Craswell, N. 1999. Overview of TREC-8 Web Track. In Proceedings of TREC-8. 131--150. Available online at trec.nist.gov/pubs/trec8/.
• 17: Wessel Kraaij , Thijs Westerveld , Djoerd Hiemstra, The Importance of Prior Probabilities for Entry Page Search, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564383]
• 18: Looksmart. n.d. See Web site www.looksmart.com.
• 19: Ng, A. Y., Zheng, A. X., and Jordan, M. I. 2001. Link analysis, eigenvectors, and stability. In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-01). ACM Press, New York, NY.
• 20: Page, L., Brin, S., Motwani, R., and Winograd, T. 1998. The PageRank citation ranking: Bringing order to the Web. Tech. Rep. 1999-66, Stanford University Database Group. Stanford, CA. Available online at dbpubs.stanford.edu:8090/pub/1999-66.
• 21: Robertson, S., Walker, S., Jones, S., Hancock-Beaulieu, M., and Gatford, M. 1994. Okapi at TREC-3. In Proceedings of TREC-3. Available online at trec.nist.gov/pubs/trec3/.
• 22: Savoy, J. and Rasolofo, Y. 2001. Report on the TREC-10 experiment: Distributed collections and entrypage searching. In TREC-2001 Notebook proceedings. Available online at trec.nist.gov/pubs/.
• 23: Amit Singhal , Marcin Kaszkiel, A case study in web search using TREC algorithms, Proceedings of the 10th international conference on World Wide Web, p.708-716, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372186]
• 24: Travis, B. and Broder, A. 2001. Web search quality vs. informational relevance. In Proceedings of the Infonortics Search Engines Meeting. Boston. Available online at www.infonortics.com/ searchengines/sh01/slides-01/travis.html.
• 25: Westerveld, T., Kraij, W., and Hiemstra, D. 2001. Retrieving Web pages using content, links, URLs and anchors. In TREC-2001 Notebook Proceedings. Available online at trec.nist. gov/pubs/.
• 26: Yahoo!. n.d. Yahoo! directory service. See Web site www.yahoo.com.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

General Terms:
Experimentation

Keywords:
Web information retrieval, citation and link analysis, connectivity