Toward an improved concept-based information retrieval system

ABSTRACT

This paper presents a novel information retrieval system that includes 1) the addition of concepts to facilitate the identification of the correct word sense, 2) a natural language query interface, 3) the inclusion of weights and penalties for proper nouns that build upon the Okapi weighting scheme, and 4) a term clustering technique that exploits the spatial proximity of search terms in a document to further improve the performance. The effectiveness of the system is validated by experimental results.

REFERENCES

• 1: Clifford Weinstein, Young-Suk Lee, Stephanie Seneff, Dinesh Tummala, Beth Carlson, John T. Lynch, Jung-Taik Hwang, Linda Kukolich. "Automated English-Korean Translation for Enhanced Coalition Communications," The Lincoln Laboratory Journal 10(1). pp. 35-60, 1997.
• 2: Eric Brill, A simple rule-based part of speech tagger, Proceedings of the third conference on Applied natural language processing, March 31-April 03, 1992, Trento, Italy [doi>10.3115/974499.974526]
• 3: G. Miller. "WordNet: An On-Line Lexical Database," International Journal of Lexicography. Vol. 3, No. 4, 1990.
• 4: Gerard Salton , Michael J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill, Inc., New York, NY, 1986
• 5: S.E. Robertson, S. Walker, S. Jones, M.M. Hancock-Beaulieu, M. Gatford. "Okapi at TREC-3," in The 3rd Text Retrieval Conference (TREC-3) ed. by D.K. Harman,. NIST Special Pub. 500-225, 1995.
• 6: Stephanie Seneff, TINA: a natural language system for spoken language applications, Computational Linguistics, v.18 n.1, p.61-86, March 1992
• 7: Young-Suk Lee, Clifford Weinstein. "An Integrated Approach to English-Korean Translation and Translingual Information Access." Proceedings of the C-STAR Workshop. Schwetzingen, Germany, September 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Search process
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Natural language

General Terms:
Design, Experimentation, Human Factors, Performance

Keywords:
Roget's thesaurus, WordNet, brill tegger, concept, information retrieval, word sense disambiguation