Query by document

ABSTRACT

We are experiencing an unprecedented increase of content contributed by users in forums such as blogs, social networking sites and microblogging services. Such abundance of content complements content on web sites and traditional media forums such as news papers, news and financial streams, and so on. Given such plethora of information there is a pressing need to cross reference information across textual services. For example, commonly we read a news item and we wonder if there are any blogs reporting related content or vice versa.

In this paper, we present techniques to automate the process of cross referencing online information content. We introduce methodologies to extract phrases from a given "query document" to be used as queries to search interfaces with the goal to retrieve content related to the query document. In particular, we consider two techniques to extract and score key phrases. We also consider techniques to complement extracted phrases with information present in external sources such as Wikipedia and introduce an algorithm called RelevanceRank for this purpose.

We discuss both these techniques in detail and provide an experimental study utilizing a large number of human judges from Amazons's Mechanical Turk service. Detailed experiments demonstrate the effectiveness and efficiency of the proposed techniques for the task of automating retrieval of documents related to a query document.

REFERENCES

• 1: IJsbrand Jan Aalbersberg, Incremental relevance feedback, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.11-22, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133169]
• 2: Nilesh Bansal , Fei Chiang , Nick Koudas , Frank Wm. Tompa, Seeking stable clusters in the blogosphere, Proceedings of the 33rd international conference on Very large data bases, September 23-27, 2007, Vienna, Austria
• 3: Nilesh Bansal , Nick Koudas, BlogScope: a system for online analysis of high volume text streams, Proceedings of the 33rd international conference on Very large data bases, September 23-27, 2007, Vienna, Austria
• 4: BlogScope http://www.blogscope.net/about/
• 5: Kenneth Ward Church , Patrick Hanks, Word association norms, mutual information, and lexicography, Proceedings of the 27th annual meeting on Association for Computational Linguistics, p.76-83, June 26-29, 1989, Vancouver, British Columbia, Canada [doi>10.3115/981623.981633]
• 6: Amit Chandel , Oktie Hassanzadeh , Nick Koudas , Mohammad Sadoghi , Divesh Srivastava, Benchmarking declarative approximate selection predicates, Proceedings of the 2007 ACM SIGMOD international conference on Management of data, June 11-14, 2007, Beijing, China [doi>10.1145/1247480.1247521]
• 7: F. Crestani, Application of Spreading Activation Techniques in InformationRetrieval, Artificial Intelligence Review, v.11 n.6, p.453-482, Dec. 1997 [doi>10.1023/A:1006569829653]
• 8: Cucerzan, S. Large-Scale Named Entity Disambiguation Based on Wikipedia Data. In EMNLP-CoNLL, 2007.
• 9: Ido Dagan , Ken Church, Termight: identifying and translating technical terminology, Proceedings of the fourth conference on Applied natural language processing, October 13-15, 1994, Stuttgart, Germany [doi>10.3115/974358.974367]
• 10: Efthmiadis, E. Query Expansion. In Annual Review of Information Science and Technology, 31:121--187, 1996.
• 11: Fabian M. Suchanek , Gjergji Kasneci , Gerhard Weikum, Yago: a core of semantic knowledge, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242667]
• 12: J. Fagan, Automatic phrase indexing for document retrieval, Proceedings of the 10th annual international ACM SIGIR conference on Research and development in information retrieval, p.91-101, June 03-05, 1987, New Orleans, Louisiana, United States [doi>10.1145/42005.42016]
• 13: Feller, W. An Introduction to Probability Theory and Its Applications, Wiley, 1968.
• 14: Katerina T. Frantzi, Incorporating context information for the extraction of terms, Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics, p.501-503, July 07-12, 1997, Madrid, Spain
• 15: Gravano, L., Ipeirotis, P., Koudas, N., Srivastava, D. Text Joins for Data Cleasing and Integration in an RDBMS. In WWW, 2003.
• 16: Zoltán Gyöngyi , Hector Garcia-Molina , Jan Pedersen, Combating web spam with trustrank, Proceedings of the Thirtieth international conference on Very large data bases, p.576-587, August 31-September 03, 2004, Toronto, Canada
• 17: Donna Harman, Relevance feedback revisited, Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval, p.1-10, June 21-24, 1992, Copenhagen, Denmark [doi>10.1145/133160.133167]
• 18: Taher H. Haveliwala, Topic-sensitive PageRank, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511513]
• 19: Ide, E. New Experiments in Relevance Feedback. In The SMART Retrieval System - Experiments in Automatic Document Processing, Prentice-Hall, 1971.
• 20: Levenshtein, V. Binary codes capable of correcting deletions, insertions, and reversals. In Soviet Physics Doklady 1966.
• 21: MacDonald, C., He, B., Plachouras, V., Ounis, I. University of Glasgow at TREC 2005: Experiments in Terabyte and Enterprise Tracks with Terrier. In TREC, 2005.
• 22: Christopher D. Manning , Hinrich Schütze, Foundations of statistical natural language processing, MIT Press, Cambridge, MA, 1999
• 23: Medelyan, O. Computing Lexical Chains with Graph Clustering In ACL 2007.
• 24: Olena Medelyan , Ian H. Witten, Thesaurus based automatic keyphrase indexing, Proceedings of the 6th ACM/IEEE-CS joint conference on Digital libraries, June 11-15, 2006, Chapel Hill, NC, USA [doi>10.1145/1141753.1141819]
• 25: Mitra, M., Buckley, C., Singhal, A., Cardie, C. An Analysis of Statistical and Sytactic Phrases. In RIAO Conference, 1997.
• 26: Elke Mittendorf , Bojidar Mateev , Peter Schäuble, Using the Co-occurrence of Words for Retrieval Weighting, Information Retrieval, v.3 n.3, p.243-251, October 2000 [doi>10.1023/A:1026520926673]
• 27: Amazon Mechanical Turk. http://www.mturk.com
• 28: Pantel, P., Lin, D. A statistical corpus based term extractor Lecture notes in AI, 2001, Springer-Verlag
• 29: Part-of-speech tagging. http://en.wikipedia.org/wiki/Part-of-speech_tagging
• 30: Rocchio, J. Relevance Feedback in Information Retrieval. In The SMART Retrieval System - Experiments in Automatic Document Processing, Prentice-Hall, 1971.
• 31: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 32: Spink, A., Jansen, B., Ozmultu, H. Use of Query Reformulation and Relevance Feedback by Excite Users. In Internet Research: Electronic Networking Applications and Policy, 2000.
• 33: Takashi Tomokiyo , Matthew Hurst, A language model approach to keyphrase extraction, Proceedings of the ACL 2003 workshop on Multiword expressions: analysis, acquisition and treatment, p.33-40, July 12, 2003, Sapporo, Japan [doi>10.3115/1119282.1119287]
• 34: Peter D. Turney, Learning Algorithms for Keyphrase Extraction, Information Retrieval, v.2 n.4, p.303-336, May 2000 [doi>10.1023/A:1009976227802]
• 35: Vechtomova, O., Karamuftuoglu, M. Approaches to High Accuracy Retrieval: Phrase-Based Search Experiments in the HARD Track. In TREC, 2004.
• 36: Ian H. Witten , Gordon W. Paynter , Eibe Frank , Carl Gutwin , Craig G. Nevill-Manning, KEA: practical automatic keyphrase extraction, Proceedings of the fourth ACM conference on Digital libraries, p.254-255, August 11-14, 1999, Berkeley, California, United States [doi>10.1145/313238.313437]
• 37: Yahoo Term Extraction Web Service. http://developer.yahoo.com/search/content/V1/termExtraction.html
• 38: Hugo Zaragoza , Henning Rode , Peter Mika , Jordi Atserias , Massimiliano Ciaramita , Giuseppe Attardi, Ranking very many typed entities on wikipedia, Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, November 06-10, 2007, Lisbon, Portugal [doi>10.1145/1321440.1321599]
• 39: The Future of Social Networking: Understanding Market Stratigic and Technology developments. Datamonitor, 2007.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services

General Terms:
Algorithms

Keywords:
Wikipedia, blog, similarity matching, web 2.0