MURAX: a robust linguistic approach for question answering using an on-line encyclopedia

ABSTRACT

Robust linguistic methods are applied to the task of answering closed-class questions using a corpus of natural language. The methods are illustrated in a broad domain: answering general-knowledge questions using an on-line encyclopedia. A closed-class question is a question stated in natural language, which assumes some definite answer typified by a noun phrase rather than a procedural answer. The methods hypothesize noun phrases that are likely to be the answer, and present the user with relevant text in which they are marked, focussing the user's attention appropriately. Furthermore, the sentences of matching text that are shown to the user are selected to confirm phrase relations implied by the question, rather than being selected solely on the basis of word frequency. The corpus is accessed via an information retrieval (IR) system that supports boolean search with proximity constraints. Queries are automatically constructed from the phrasal content of the question, and passed to the IR system to find relevant text. Then the relevant text is itself analyzed; noun phrase hypotheses are extracted and new queries are independently made to confirm phrase relations for the various hypotheses. The methods are currently being implemented in a system called MURAX and although this process is not complete, it is sufficiently advanced for an interim evaluation to be presented.

REFERENCES

• Cutting et al., 1991: D.R. Cutting, J. Pedersen, and P.-K. Halvorsen. An object-oriented architecture for text retrieval. In Conference Proceedings of RIA 0'91, Intelligent Text and Image Handlzng, Barcelona, Spain, pages 285-298, April 1991.
• Cutting et al., 1992: Doug Cutting , Julian Kupiec , Jan Pedersen , Penelope Sibun, A practical part-of-speech tagger, Proceedings of the third conference on Applied natural language processing, March 31-April 03, 1992, Trento, Italy [doi>10.3115/974499.974523]
• Francis and Kuc˘era, 1982: W. N. Francis and F. KuSera. Frequency Analysis of English Usage. Houghton Mifflin, 1982.
• Grolier, 1990: The Academic American Encyclopedia. Grolier Electronic Publishing, Danbury, Connecticut, 1990.
• Hearst, 1992: Marti A. Hearst, Automatic acquisition of hyponyms from large text corpora, Proceedings of the 14th conference on Computational linguistics, August 23-28, 1992, Nantes, France [doi>10.3115/992133.992154]
• Hopcroft and Ullman, 1979: John E. Hopcroft , Jeffrey D. Ullman, Introduction To Automata Theory, Languages, And Computation, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1990
• Jacobs et al., 1991: Paul S. Jacobs , George R. Krupka , Lisa F. Rau, Lexico-semantic pattern matching as a companion to parsing in text understanding, Proceedings of the workshop on Speech and Natural Language, p.337-341, February 19-22, 1991, Pacific Grove, California [doi>10.3115/112405.112477]
• Kupiec, 1992a: J. M. Kupiec. Hidden Markov estimarion for unrestricted stochastic context-free grammars. In Proceedings of the 1992 International Conference on Acoustics, Speech and Signal Processing, pages 1-177-180. IEEE Signal Processing Society, IEEE, March 1992.
• Kupiec, 1992b: J. M. Kupiec. Robust part-of-speech tagging using a hidden Markov model. Computer Speech and Language, 6:225-242, 1992.
• Miller et al., 1990: G. A. Miller, R. Be&with, C. Fellbaum, D. Gross, and K. Miller. Five papers on Word- Net. Technical report, Princeton University, Computer Science Laboratory, July 1990.
• Salton and Buckley, 1991: Gerard Salton , Chris Buckley, Automatic text structuring and retrieval-experiments in automatic encyclopedia searching, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.21-30, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122863]
• Salton et al., 1983: G. Salton, C. Buckley, and E. A. Fox. Automatic query formulations in information retrieval. Journal of the American Society for Informarion Science, 34(4):262-280, July 1983.
• Wendlandt and Driscoll, 1991: Edgar B. Wendlandt , James R. Driscoll, Incorporating a semantic analysis into a document retrieval strategy, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.270-279, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122888]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Linguistic processing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Query formulation

General Terms:
Languages, Performance