The LinGO Redwoods treebank motivation and preliminary applications

ABSTRACT

The LinGO Redwoods initiative is a seed activity in the design and development of a new type of treebank. While several medium- to large-scale treebanks exist for English (and for other major languages), pre-existing publicly available resources exhibit the following limitations: (i) annotation is mono-stratal, either encoding topological (phrase structure) or tectogrammatical (dependency) information, (ii) the depth of linguistic information recorded is comparatively shallow, (iii) the design and format of linguistic representation in the treebank hard-wires a small, predefined range of ways in which information can be extracted from the treebank, and (iv) representations in existing treebanks are static and over the (often year- or decade-long) evolution of a large-scale treebank tend to fall behind the development of the field. LinGO Redwoods aims at the development of a novel treebanking methodology, rich in nature and dynamic both in the ways linguistic data can be retrieved from the treebank in varying granularity and in the constant evolution and regular updating of the treebank itself. Since October 2001, the project is working to build the foundations for this new type of treebank, to develop a basic set of tools for treebank construction and maintenance, and to construct an initial set of 10,000 annotated trees to be distributed together with the tools under an open-source license.

REFERENCES

• 1: Steven P. Abney, Stochastic attribute-value grammars, Computational Linguistics, v.23 n.4, p.597-618, December 1997
• 2: Agresti, A. (1990). Categorical data analysis. John Wiley & Sons.
• 3: Bouma, G., Noord, G. van, & Malouf, R. (2001). Alpino. Wide-coverage computational analysis of Dutch. In W. Daelemans, K. Sima-an, J. Veenstra, & J. Zavrel (Eds.), Computational linguistics in the Netherlands (pp. 45--59). Amsterdam, The Netherlands: Rodopi.
• 4: Carter, D. (1997). The TreeBanker. A tool for supervised training of parsed corpora. In Proceedings of the Workshop on Computational Environments for Grammar Development and Linguistic Engineering. Madrid, Spain.
• 5: Charniak, E. (1997). Statistical parsing with a context-free grammar and word statistics. In Proceedings of the Fourteenth National Conference on Artificial Intelligence (pp. 598--603). Providence, RI.
• 6: Eugene Charniak , Glenn Carroll, Context-sensitive statistics for improved grammatical language models, Proceedings of the twelfth national conference on Artificial intelligence (vol. 1), p.728-733, October 1994, Seattle, Washington, United States
• 7: Michael Collins, Three generative, lexicalised models for statistical parsing, Proceedings of the 35th annual meeting on Association for Computational Linguistics, p.16-23, July 07-12, 1997, Madrid, Spain
• 8: Copestake, A. (2002). Implementing typed feature structure grammars. Stanford, CA: CSLI Publications.
• 9: Ann Copestake , Alex Lascarides , Dan Flickinger, An algebra for semantic construction in constraint-based grammars, Proceedings of the 39th Annual Meeting on Association for Computational Linguistics, p.140-147, July 06-11, 2001, Toulouse, France [doi>10.3115/1073012.1073031]
• 10: Dipper, S. (2000). Grammar-based corpus annotation. In Workshop on linguistically interpreted corpora LINC-2000 (pp. 56--64). Luxembourg.
• 11: Dan Flickinger, On building a more efficient grammar by exploiting types, Natural Language Engineering, v.6 n.1, p.15-28, March 2000 [doi>10.1017/S1351324900002370]
• 12: Harris, T. E. (1963). The theory of branching processes. Berlin, Germany: Springer.
• 13: Mark Johnson , Stuart Geman , Stephen Canon , Zhiyi Chi , Stefan Riezler, Estimators for stochastic "Unification-Based" grammars, Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics, p.535-541, June 20-26, 1999, College Park, Maryland [doi>10.3115/1034678.1034758]
• 14: Christopher D. Manning , Hinrich Schütze, Foundations of statistical natural language processing, MIT Press, Cambridge, MA, 1999
• 15: Mullen. T., Malouf, R., & Noord, G. van. (2001). Statistical parsing of Dutch using Maximum Entropy models with feature merging. In Proceedings of the Natural Language Processing Pacific Rim Symposium. Tokyo, Japan.
• 16: Oepen, S., & Callmeier, U. (2000). Measure for measure: Parser cross-fertilization. Towards increased component comparability and exchange. In Proceedings of the 6th International Workshop on Parsing Technologies (pp. 183--194). Trento, Italy.
• 17: Kristina Toutanova , Christopher D. Manning, Feature selection for a rich HPSG grammar using decision trees, proceeding of the 6th conference on Natural language learning, p.1-7, August 31, 2002 [doi>10.3115/1118853.1118883]
• 18: Wahlster, W. (Ed.) (2000). Verbmobil. Foundations of speech-to-speech translation. Berlin, Germany: Springer.