Web question answering: is more always better?

ABSTRACT

This paper describes a question answering system that is designed to capitalize on the tremendous amount of data that is now available online. Most question answering systems use a wide variety of linguistic resources. We focus instead on the redundancy available in large corpora as an important resource. We use this redundancy to simplify the query rewrites that we need to use, and to support answer mining from returned snippets. Our system performs quite well given the simplicity of the techniques being utilized. Experimental results show that question answering accuracy can be greatly improved by analyzing more and more matching passages. Simple passage ranking and n-gram extraction techniques work well in our system making it efficient to use with many backend retrieval engines.

REFERENCES

• 1: AAAI Spring Symposium Series (2002). Mining Answers from Text and Knowledge Bases.
• 2: Steven Abney , Michael Collins , Amit Singhal, Answer extraction, Proceedings of the sixth conference on Applied natural language processing, p.296-301, April 29-May 04, 2000, Seattle, Washington [doi>10.3115/974147.974188]
• 3: ACL-EACL (2002). Workshop on Open-domain Question Answering.
• 4: Eugene Agichtein , Steve Lawrence , Luis Gravano, Learning search engine specific query transformations for question answering, Proceedings of the 10th international conference on World Wide Web, p.169-178, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.371976]
• 5: Eric Brill , Susan Dumais , Michele Banko, An analysis of the AskMSR question-answering system, Proceedings of the ACL-02 conference on Empirical methods in natural language processing, p.257-264, July 06, 2002 [doi>10.3115/1118693.1118726]
• 6: E. Brill, J. Lin, M. Banko, S. Dumais and A. Ng (2002). Data-intensive question answering. In Proceedings of the Tenth Text REtrieval Conference (TREC 2001).
• 7: S. Buchholz (2002). Using grammatical relations, answer frequencies and the World Wide Web for TREC question answering. In Proceedings of the Tenth Text REtrieval Conference (TREC 2001).
• 8: J. Chen, A. R. Diekema, M. D. Taffet, N. McCracken, N. E. Ozgencil, O. Yilmazel, E. D. Liddy (2002). Question answering: CNLP at the TREC-10 question answering track. In Proceedings of the Tenth Text REtrieval Conference (TREC 2001).
• 9: Charles L. A. Clarke , Gordon V. Cormack , Thomas R. Lynam, Exploiting redundancy in question answering, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.358-365, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.384024]
• 10: C. Clarke, G. Cormack and T. Lynam (2002). Web reinforced question answering. In Proceedings of the Tenth Text REtrieval Conference (TREC 2001).
• 11: S. Harabagiu, D. Moldovan, M. Pasca, R. Mihalcea, M. Surdeanu, R. Bunescu, R. Girju, V. Rus and P. Morarescu (2001). FALCON: Boosting knowledge for question answering. In Proceedings of the Ninth Text REtrieval Conference (TREC-9), 479--488.
• 12: E. Hovy, L. Gerber, U. Hermjakob, M. Junk and C. Lin (2001). Question answering in Webclopedia. In Proceedings of the Ninth Text REtrieval Conference (TREC-9), 655--664.
• 13: E. Hovy, U. Hermjakob and C. Lin (2002). The use of external knowledge in factoid QA. In Proceedings of the Tenth Text REtrieval Conference (TREC 2001).
• 14: Cody C. T. Kwok , Oren Etzioni , Daniel S. Weld, Scaling question answering to the Web, Proceedings of the 10th international conference on World Wide Web, p.150-161, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.371973]
• 15: Marius A. Pasca , Sandra M. Harabagiu, High performance question/answering, Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, p.366-374, September 2001, New Orleans, Louisiana, United States [doi>10.1145/383952.384025]
• 16: John Prager , Eric Brown , Anni Coden , Dragomir Radev, Question-answering by predictive annotation, Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval, p.184-191, July 24-28, 2000, Athens, Greece [doi>10.1145/345508.345574]
• 17: Dragomir R. Radev , Hong Qi , Zhiping Zheng , Sasha Blair-Goldensohn , Zhu Zhang , Weiguo Fan , John Prager, Mining the web for answers to natural language questions, Proceedings of the tenth international conference on Information and knowledge management, October 05-10, 2001, Atlanta, Georgia, USA [doi>10.1145/502585.502610]
• 18: M. M. Soubbotin and S. M. Soubbotin (2002). Patterns and potential answer expressions as clues to the right answers. In Proceedings of the Tenth Text REtrieval Conference (TREC 2001).
• 19: E. Voorhees and D. Harman, Eds. (2001). Proceedings of the Ninth Text REtrieval Conference (TREC-9). NIST Special Publication 500-249.
• 20: E. Voorhees and D. Harman, Eds. (2002). Proceedings of the Tenth Text REtrieval Conference (TREC 2001). ). NIST Special Publication 500-250.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms, Experimentation