Classifying search engine queries using the web as background knowledge

ABSTRACT

The performance of search engines crucially depends on their ability to capture the meaning of a query most likely intended by the user. We study the problem of mapping a search engine query to those nodes of a given subject taxonomy that characterize its most likely meanings. We describe the architecture of a classification system that uses a web directory to identify the subject context that the query terms are frequently used in. Based on its performance on the classification of 800,000 example queries recorded from MSN search, the system received the Runner-Up Award for Query Categorization Performance of the KDD Cup 2005.

REFERENCES

• 1: Rakesh Agrawal , Ramakrishnan Srikant, On integrating catalogs, Proceedings of the 10th international conference on World Wide Web, p.603-612, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372163]
• 2: James Allan , Hema Raghavan, Using part-of-speech patterns to reduce query ambiguity, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564430]
• 3: Peter G. Anick , Suresh Tipirneni, The paraphrase search assistant: terminological feedback for iterative information seeking, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.153-159, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312670]
• 4: P. Bruza and S. Dennis. Query reformulation on the internet: Empirical data and the hyperindex search engine. Proceedings of the Conference on Computer-Assisted Information Searching on Internet, 1997.
• 5: Douglass R. Cutting , David R. Karger , Jan O. Pedersen , John W. Tukey, Scatter/Gather: a cluster-based approach to browsing large document collections, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.318-329, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133214]
• 6: Simon Dennis , Peter Bruza , Robert McArthur, Web searching: a process-oriented experimental study of three interactive search paradigms, Journal of the American Society for Information Science and Technology, v.53 n.2, p.120-133, January 15, 2002 [doi>10.1002/asi.10015]
• 7: A. Doan, J. Madhavan, P. Domingos, and A. Halevy. Ontology matching: A machine learning approach. In S. Staab and R. Studer, editors, Handbook on Ontologies in Information Systems. Springer-Verlag, 2003.
• 8: Natalie S. Glance, Community search assistant, Proceedings of the 6th international conference on Intelligent user interfaces, p.91-96, January 14-17, 2001, Santa Fe, New Mexico, United States [doi>10.1145/359784.360293]
• 9: J. Gonzalo, F. Verdejo, I. Chugur, and J. Cigarran. Indexing with wordnet synsets can improve text retrieval. In Proceedings of the Annual Meeting of the Association for Computational Linguistics and International Conference on Computational Linguistics, 1998.
• 10: D. Hosmer and S. Lemeshow. Applied logistic regression. New York, Wiley, 1989.
• 11: D. W. J. Stefanowski. Carrot2 and language properties in web search results clustering. In Proceedings of the International Atlantic Web Intelligence Conference, 2003.
• 12: Mark Sanderson, Retrieving with Good Sense, Information Retrieval, v.2 n.1, p.49-69, February 2000 [doi>10.1023/A:1009933700147]
• 13: H. Schutze and J. Pederson. Information retrieval based on word senses. In Proceedings of the Annual Symposium on Document Analysis and Information Retrieval, 1994.
• 14: Christopher Stokoe , Michael P. Oakes , John Tait, Word sense disambiguation in information retrieval revisited, Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, July 28-August 01, 2003, Toronto, Canada [doi>10.1145/860435.860466]
• 15: M. K. Y. Wang. C4-2: Combining link and contents in clustering web search results to improve information interpretation. In Proceedings of the International Conference on Database and Expert Systems Applications, 2002.
• 16: Oren Zamir , Oren Etzioni, Grouper: a dynamic clustering interface to Web search results, Computer Networks: The International Journal of Computer and Telecommunications Networking, v.31 n.11-16, p.1361-1374, May 17, 1999
• 17: D. Zhang and W. Lee. Learning to integrate web taxonomies. Web Semantics, 2(2):131--151, 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Clustering; Query formulation
      H.3.4 Systems and Software
          Subjects: Performance evaluation (efficiency and effectiveness)

General Terms:
Algorithms, Performance