Y!Q: contextual search at the point of inspiration

ABSTRACT

Contextual search tries to better capture a user's information need by augmenting the user's query with contextual information extracted from the search context (for example, terms from the web page the user is currently reading or a file the user is currently editing).This paper presents Y!Q---a first of its kind large-scale contextual search system---and provides an overview of its system design and architecture. Y!Q solves two major problems. First, how to capture high quality search context. Second, how to use that context in a way to improve the relevancy of search queries. To address the first problem, Y!Q introduces an information widget that captures precise search context and provides convenient access to its functionality at the point of inspiration. For example, Y!Q can be easily embedded into web pages using a web API, or it can be integrated into a web browser toolbar. This paper provides an overview of Y!Q's user interaction design, highlighting its novel aspects for capturing high quality search context.To address the second problem, Y!Q uses a semantic network for analyzing search context, possibly resolving ambiguous terms, and generating a contextual digest comprising its key concepts. This digest is passed through a query planner and rewriting framework for augmenting a user's search query with relevant context terms to improve the overall search relevancy and experience. We show experimental results comparing contextual Y!Q search results side-by-side with regular Yahoo! web search results. This evaluation suggests that Y!Q results are considered significantly more relevant.The paper also identifies interesting research problems and argues that contextual search may represent the next major step in the evolution of web search engines.

REFERENCES

• 1: K. Ali, C. Chang, and Y. F. Juan. Exploring cost-effective approaches to human evaluation of search engine relevance. In ECIR '05, 27th European Conference on Information Retrieval, Santiago de Compostela, Spain, March 2005.
• 2: N. J. Belkin, R. Oddy, and H. M. Brooks. ASK for Information Retrieval: Part I. Background and Theory, Part II. Results of a Design Study. Journal of Documentation, 38(3):61--71, 145--164, Sep. 1982.
• 3: Krishna Bharat, SearchPad: explicit capture of search context to support Web search, Proceedings of the 9th international World Wide Web conference on Computer networks : the international journal of computer and telecommunications netowrking, p.493-501, June 2000, Amsterdam, The Netherlands
• 4: Daniel M. Bikel , Richard Schwartz , Ralph M. Weischedel, An Algorithm that Learns What‘s in a Name, Machine Learning, v.34 n.1-3, p.211-231, Feb. 1999 [doi>10.1023/A:1007558221122]
• 5: Daniel Billsus , David M. Hilbert , Dan Maynes-Aminzade, Improving proactive information systems, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040869]
• 6: A. Borthwick, J. Sterling, E. Agichtein, and R. Grishman. Exploiting diverse knowledge sources via maximum entropy in named entity recognition. In Proceedings 6th Workshop on very large corpra at the 17th International Conference on computational Linguistics and the 36th Annual meeting of the Association for Computational Linguistics, Montreal, Canada, 1998.
• 7: J. Budzik and K. Hammond. Watson: Anticipating and contextualizing information needs. In 62nd Annual Meeting of the American Society for Information Science, Medford, NJ, 1999.
• 8: Tara Calishain , Rael Dornfest, Google Hacks: 100 Industrial-Strength Tips and Tools, O'Reilly & Associates, Inc., Sebastopol, CA, 2003
• 9: Mary Czerwinski , Susan Dumais , George Robertson , Susan Dziadosz , Scott Tiernan , Maarten van Dantzich, Visualizing implicit queries for information management and retrieval, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.560-567, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303158]
• 10: Placing search in context: the concept revisited, ACM Transactions on Information Systems (TOIS), v.20 n.1, p.116-131, January 2002 [doi>10.1145/503104.503110]
• 11: Eric J. Glover , Steve Lawrence , William P. Birmingham , C. Lee Giles, Architecture of a metasearch engine that supports user information needs, Proceedings of the eighth international conference on Information and knowledge management, p.210-216, November 02-06, 1999, Kansas City, Missouri, United States [doi>10.1145/319950.319980]
• 12: A. Goker. Capturing information need by learning user context. In Sixteenth International Joint Conference in Artificial Intelligence: Learning About Users Workshop, pages 21--27, 1999.
• 13: Monika Henzinger , Bay-Wei Chang , Brian Milch , Sergey Brin, Query-free news search, Proceedings of the 12th international conference on World Wide Web, May 20-24, 2003, Budapest, Hungary [doi>10.1145/775152.775154]
• 14: S. Lawrence. Context in web search. IEEE Data Engineering Bulletin, 23(3):25--32, 2000.
• 15: D. Maynard and S. Ananiadou. Term sense disambiguation using a domain-specific thesaurus. In Proceedings of 1st International Conference on Language Resources and Evaluation (LREC), Granada, Spain, 1998.
• 16: D. Maynard and S. Ananiadou. Identifying contextual information for multi-word term extraction. In Proc. of Terminology and Knowledge Engineering Conference (TKE-99), Innsbruck, Austria, pages 212--221, 1999.
• 17: B. Rhodes and T. Starner. The remembrance agent: A continuously running automated information retrieval system. In The Proceedings of The First International Conference on The Practical Application of Intelligent Agents and Multi Agent Technology (PAAM '96), London, UK, pages 487--495, April 1996.
• 18: E. Selberg and O. Etzioni. The MetaCrawler Architecture for Resource Aggregation on the Web. IEEE Expert, 12(1):8--14, Jan. 1997.
• 19: Craig Silverstein , Hannes Marais , Monika Henzinger , Michael Moricz, Analysis of a very large web search engine query log, ACM SIGIR Forum, v.33 n.1, p.6-12, Fall 1999 [doi>10.1145/331403.331405]
• 20: C. T. Yu , K. Lam , G. Salton, Term Weighting in Information Retrieval Using the Term Precision Model, Journal of the ACM (JACM), v.29 n.1, p.152-170, Jan. 1982 [doi>10.1145/322290.322300]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS

General Terms:
Theory

Keywords:
Web information retrieval, content analysis, context, contextual search, search personalization, semantic networks