Overview of the fourth message understanding evaluation and conference

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Overview of the fourth message understanding evaluation and conference

Full text

Publisher Site , Pdf

Pdf (1.35 MB)

Source

Message Understanding Conference archive
Proceedings of the 4th conference on Message understanding table of contents

McLean, Virginia

SESSION: General papers table of contents

Pages: 3 - 21

Year of Publication: 1992

ISBN:1-55860-273-9

Author

Beth M. Sundheim

Naval Command, Control, and Ocean Surveillance Center, San Diego, CA

Publisher

Association for Computational Linguistics Morristown, NJ, USA

Bibliometrics

Downloads (6 Weeks): 10, Downloads (12 Months): 31, Citation Count: 16

Additional Information:

abstract references cited by collaborative colleagues

Tools and Actions:	Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	10.3115/1072064.1072066

ABSTRACT

The Fourth Message Understanding Conference (MUC-4) is the latest in a series of conferences that concern the evaluation of natural language processing (NLP) systems. These conferences have reported on progress being made both in the development of systems capable of analyzing relatively short English texts and in the definition of a rigorous performance evaluation methodology. MUC-4 was preceded by a period of intensive system development by each of the participating organizations and blind testing using materials prepared by NRaD and SAIC that are described in this paper, other papers in this volume, and the MUC-3 proceedings [1].

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Proceedings of the Third Message Understanding Conference (MUC-3), May, 1991, Morgan Kaufmann.
	2	Beth M. Sundheim, Plans for a task-oriented evaluation of natural language understanding systems, Proceedings of the workshop on Speech and Natural Language, p.197-202, February 21-23, 1989, Philadelphia, Pennsylvania [doi>10.3115/100964.100984]
	3	Chinchor, N., MUC-4 Evaluation Metrics (in this volume).
	4	Lewis, D. and Tong, R., Text Filtering in MUC-3 and MUC-4 (in this volume).
	5	Krupka, G. and Rau, L., GE Adjunct Test Report: Object-Oriented Design and Scoring for MUC-4 (in this volume).
	6	Lynette Hirschman, Comparing MUCK-II and MUC-3: assessing the difficulty of different tasks, Proceedings of the 3rd conference on Message understanding, May 21-23, 1991, San Diego, California [doi>10.3115/1071958.1071962]
	7	Chinchor, N., Statistical Significance of MUC-4 Results (in this volume).
	8	Nancy Chinchor, MUC-3 linguistic phenomena test experiment, Proceedings of the 3rd conference on Message understanding, May 21-23, 1991, San Diego, California [doi>10.3115/1071958.1071963]
	9	Hirschman, L., An Adjunct Test for Discourse Processing in MUC-4 (in this volume).
	10	Beth M. Sundheim, Overview of the third message understanding evaluation and conference, Proceedings of the 3rd conference on Message understanding, May 21-23, 1991, San Diego, California [doi>10.3115/1071958.1071960]

CITED BY 16

	Peter Jackson , Khalid Al-Kofahi , Alex Tyrrell , Arun Vachher, Information extraction from case law and retrieval of prior cases, Artificial Intelligence, v.150 n.1-2, p.239-290, November 2003
	Fernando Gomez , Richard Hull , Carlos Segami, Acquiring knowledge from encyclopedic texts, Proceedings of the fourth conference on Applied natural language processing, October 13-15, 1994, Stuttgart, Germany
	Jeremy Crowe, Constraint-based event recognition for information extraction, Proceedings of the 33rd annual meeting on Association for Computational Linguistics, June 26-30, 1995, Cambridge, Massachusetts
	David D. Lewis , Richard M. Tong, Text filtering in MUC-3 and MUC-4, Proceedings of the 4th conference on Message understanding, June 16-18, 1992, McLean, Virginia
	Paul S. Jacobs , George Krupka , Lisa Rau , Michael L. Mauldin , Teruko Mitamura , Tsuyoshi Kitani , Ira Sider , Lois Childs, The TIPSTER/SHOGUN project, Proceedings of a workshop on held at Fredericksburg, Virginia: September 19-23, 1993, September 19-23, 1993, Fredericksburg, Virginia
	Craig A. Will, Comparing human and machine performance for natural language information extraction: results for English microelectronics from the MUC-5 evaluation, Proceedings of the 5th conference on Message understanding, August 25-27, 1993, Baltimore, Maryland
	Dan Moldovan , Seungho Cha , Minhwa Chung , Tony Gallippi , Kenneth J. Hendrickson , Jun-Tae Kim , Changhwa Lin , Chinyew Lin, USC: description of the SNAP system used for MUC-5, Proceedings of the 5th conference on Message understanding, August 25-27, 1993, Baltimore, Maryland
	Beth M. Sundheim , Nancy A. Chinchor, Survey of the Message Understanding Conferences, Proceedings of the workshop on Human Language Technology, March 21-24, 1993, Princeton, New Jersey
	Jerry R. Hobbs , Douglas Appelt , John Bear , David Israel , Megumi Kameyama , Mabry Tyson, FASTUS: a system for extracting information from text, Proceedings of the workshop on Human Language Technology, March 21-24, 1993, Princeton, New Jersey
	Marc Vilain, Validation of terminological inference in an information extraction task, Proceedings of the workshop on Human Language Technology, March 21-24, 1993, Princeton, New Jersey
	Craig A. Will, Comparing human and machine performance for natural language information extraction: results from the Tipster text evaluation, Proceedings of a workshop on held at Fredericksburg, Virginia: September 19-23, 1993, September 19-23, 1993, Fredericksburg, Virginia
	Jerry Hobbs , David Israel, Principles of template design, Proceedings of the workshop on Human Language Technology, March 08-11, 1994, Plainsboro, NJ
	Seokhwan Kim , Minwoo Jeong , Gary Geunbae Lee, An alignment-based pattern representation model for information extraction, Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, July 20-24, 2008, Singapore, Singapore
	Beth Sundheim, Resources to facilitate progress in place name identification and reference resolution, Proceedings of the second international conference on Human Language Technology Research, p.319-324, March 24-27, 2002, San Diego, California
	Joseph F. McCarthy , Wendy G. Lehnert, Using decision trees for conference resolution, Proceedings of the 14th international joint conference on Artificial intelligence, p.1050-1055, August 20-25, 1995, Montreal, Quebec, Canada
	Marc Vilaln, Semantic inference in natural language: validating a tractable approach, Proceedings of the 14th international joint conference on Artificial intelligence, p.1346-1351, August 20-25, 1995, Montreal, Quebec, Canada

Collaborative Colleagues:

Beth M. Sundheim: colleagues

Adobe Acrobat

QuickTime

Windows Media Player

Real Player