Text filtering in MUC-3 and MUC-4

ABSTRACT

One of the changes from the Third (MUC-3) to the Fourth (MUC-4) Message Understanding Conference was the emergence of text filtering as an explicit topic of discussion. In this paper we examine text filtering in MUC systems with three goals in mind. First, we clarify the difference between two uses of the term "text filtering" in the context of data extraction systems, and put these phenomena in the context of prior research on information retrieval (IR).

REFERENCES

• 1: {Cha88} Chatfield, Christopher. Problem Solving: A Statistician's Guide. Chapman and Hall, London, 1988.
• 2: Nancy Chinchor, MUC-4 evaluation metrics, Proceedings of the 4th conference on Message understanding, June 16-18, 1992, McLean, Virginia [doi>10.3115/1072064.1072067]
• 3: Nancy Chinchor, The statistical significance of the MUC-4 results, Proceedings of the 4th conference on Message understanding, June 16-18, 1992, McLean, Virginia [doi>10.3115/1072064.1072068]
• 4: {CHL92} Chinchor, Nancy; Hirschman, Lynette; and Lewis, David D. Evaluating message understanding systems: An analysis of the third message understanding conference (MUC-3). Submitted to Computational Linguistics, 1992.
• 5: Cyril W. Cleverdon, The significance of the Cranfield tests on index languages, Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval, p.3-12, October 13-16, 1991, Chicago, Illinois, United States [doi>10.1145/122860.122861]
• 6: E. A. Fox , G. L. Nunn , W. C. Lee, Coefficients of combining concept classes in a collection, Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval, p.291-307, May 1988, Grenoble, France [doi>10.1145/62437.62465]
• 7: {Rob69} Robertson, S. E. The parametric description of retrieval tests. Part I: The basic parameters. Journal of Documentation, 25(1):1--27, 1969.
• 8: {Sal72} Salton, G. The "generality" effect and the retrieval evaluation for large collections. Journal of the American Society for Information Science, pages 11--22, January-February, 1972.
• 9: Beth M. Sundheim, Overview of the third message understanding evaluation and conference, Proceedings of the 3rd conference on Message understanding, May 21-23, 1991, San Diego, California [doi>10.3115/1071958.1071960]
• 10: Beth M. Sundheim, Overview of the fourth message understanding evaluation and conference, Proceedings of the 4th conference on Message understanding, June 16-18, 1992, McLean, Virginia [doi>10.3115/1072064.1072066]
• 11: {Sun92b} Sundheim, Beth M. Personal communication. August 13, 1992.
• 12: {Swe69} Swets, John A. Effectiveness of information retrieval methods. American Documentation, pages 72--69, January, 1969.
• 13: C. J. Van Rijsbergen, Information Retrieval, Butterworth-Heinemann, Newton, MA, 1979