Word sense disambiguation in information retrieval revisited

ABSTRACT

Word sense ambiguity is recognized as having a detrimental effect on the precision of information retrieval systems in general and web search systems in particular, due to the sparse nature of the queries involved. Despite continued research into the application of automated word sense disambiguation, the question remains as to whether less than 90% accurate automated word sense disambiguation can lead to improvements in retrieval effectiveness. In this study we explore the development and subsequent evaluation of a statistical word sense disambiguation system which demonstrates increased precision from a sense based vector space retrieval model over traditional TF*IDF techniques.

REFERENCES

• 1: Agirre, E; Martinez, D. "Exploring Automatic Word Sense Disambiguation with Decision Lists and the Web" Internal report: UPV-EHU, Donostia, Basque Country, 2000.
• 2: James Allan , Hema Raghavan, Using part-of-speech patterns to reduce query ambiguity, Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, August 11-15, 2002, Tampere, Finland [doi>10.1145/564376.564430]
• 3: Edmonds, P; Cotton, S. "SENSEVAL-2: Overview" In Proceedings of the Second International workshop on Evaluating Word Sense Disambiguation Systems. Toulouse, France, 2002.
• 4: William Gale , Kenneth Ward Church , David Yarowsky, Estimating upper and lower bounds on the performance of word-sense disambiguation programs, Proceedings of the 30th annual meeting on Association for Computational Linguistics, p.249-256, June 28-July 02, 1992, Newark, Delaware [doi>10.3115/981967.981999]
• 5: Gonzalo, J; Verdejo, F; Chugur, I; Cigarran, J. "Indexing With WordNet Synsets Can Improve Text Retrieval" In proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, Pp 38 -- 44, Montreal, Canada, 1998.
• 6: Gerald Kowalski , Mark T. Maybury, Information Storage and Retrieval Systems: Theory and Implementation, Kluwer Academic Publishers, Norwell, MA, 2000
• 7: Robert Krovetz , W. Bruce Croft, Lexical ambiguity and information retrieval, ACM Transactions on Information Systems (TOIS), v.10 n.2, p.115-141, April 1992 [doi>10.1145/146802.146810]
• 8: Landes, S; Leacock, C., Tengi, R. "Building Semantic Concordances" In WordNet: An Electronic Lexical Database, MIT Press, Cambridge, MA, 1998.
• 9: Hang Li , Naoki Abe, Word clustering and disambiguation based on co-occurrence data, Proceedings of the 17th international conference on Computational linguistics, p.749-755, August 10-14, 1998, Montreal, Quebec, Canada
• 10: Miller, G. "Wordnet: an On-line Lexical Database" in Special Issue: International Journal of Lexicography Vol. 3(4). Pp 235 -- 312, 1990.
• 11: Hwee Tou Ng , Hian Beng Lee, Integrating multiple knowledge sources to disambiguate word sense: an exemplar-based approach, Proceedings of the 34th annual meeting on Association for Computational Linguistics, p.40-47, June 24-27, 1996, Santa Cruz, California [doi>10.3115/981863.981869]
• 12: M. F. Porter, An algorithm for suffix stripping, Readings in information retrieval, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1997
• 13: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 14: Mark Sanderson, Word sense disambiguation and information retrieval, Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval, p.142-151, July 03-06, 1994, Dublin, Ireland
• 15: Mark Sanderson, Retrieving with Good Sense, Information Retrieval, v.2 n.1, p.49-69, February 2000 [doi>10.1023/A:1009933700147]
• 16: Schutze, H; Pederson, J. O. "Information Retrieval Based on Word Senses" In Proceedings of the 4th Annual Symposium on Document Analysis and Information Retrieval, Pp 161 -- 175, Las Vegas, NV, 1995.
• 17: Silverstein, C; Henzinger, M. "Analysis of a Very Large Altavista Query Log" SRC Technical note #1998-14, California, Digital Systems Reasearch Center: 17, 1998.
• 18: Mark Stevenson , Yorick Wilks, The interaction of knowledge sources in word sense disambiguation, Computational Linguistics, v.27 n.3, p.321-349, September 2001 [doi>10.1162/089120101317066104]
• 19: Michael Sussna, Word sense disambiguation for free-text indexing using a massive semantic network, Proceedings of the second international conference on Information and knowledge management, p.67-74, November 01-05, 1993, Washington, D.C., United States [doi>10.1145/170088.170106]
• 20: Travis, B; Broader, A. "Web Search Quality vs. Informational Relevance" In Proceedings of the 2001 Infornortics Search Engines Meeting. Boston, 2001.
• 21: Ellen M. Voorhees, Using WordNet to disambiguate word senses for text retrieval, Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, p.171-180, June 27-July 01, 1993, Pittsburgh, Pennsylvania, United States [doi>10.1145/160688.160715]
• 22: Wallis, P. "Information Retrieval Based on Paraphrase" In Proceedings of the 1st Pacific Association for Computational Linguistics Conference, Pp 118 -- 126, Vancouver, 1993.
• 23: David Yarowsky, One sense per collocation, Proceedings of the workshop on Human Language Technology, March 21-24, 1993, Princeton, New Jersey [doi>10.3115/1075671.1075731]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Linguistic processing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process; Retrieval models

General Terms:
Experimentation, Performance, Verification

Keywords:
information retrieval, performance evaluation, word sense disambiguation