Computational cognitive linguistics

ABSTRACT

The talk will describe an ongoing project (modestly named the Neural Theory of Language) that is attempting to model language behavior in a way that is both neurally plausible and computationally practical. The cornerstone of the effort is a formalism called Embodied Construction Grammar (ECG). I will describe the formalism, a robust semantic parser based on it, and a variety of applications of moderate scale. These include a system for understanding the (probabilistic and metaphorical) implications of news stories, and the first cognitively plausible model of how children learn grammar.

REFERENCES

• 1: S. Abney. 1996. Partial parsing via finite-state cascades. In Workshop on Robust Parsing, 8th European Summer School in Logic, Language and Information, pages 8--15, Prague, Czech Republic.
• 2: D. Bailey, N. Chang, J. Feldman and S. Naryanan. 1998. Extending embodied lexical development. In Proceedings of the twentieth annual meeting of the Cognitive Science Society COGSCI-98, Madison.
• 3: B. Bergen and N. Chang. 2002. Embodied construction grammar in simulation-based language understanding. Technical Report TR-02-004, ICSI, 2002. To appear in Oestman and Reid, eds., Construction Grammar(s): Cognitive and Cross-Linguistic Dimensions. John Benjamins.
• 4: B. Bergen, N. Chang and S. Narayan. 2004. Simulated Action in an Embodied Construction Grammar. Proc. 26th Cognitive Science Society Conference.
• 5: J. Bryant. 2003. Constructional analysis. Master's thesis, UC Berkeley.
• 6: J. Bryant. 2004. Towards Cognitive, Compositional Construction Grammar. ROMAND 2004: RObust Methods in Analysis of Natural language Data, Geneva.
• 7: G. Buccino, F. Binkofski, G. R. Fink, L. Fadiga, L. Fogassi, V. Gallese, R. J. Seitz, K Zilles, G. Rizzolatti and H.-J. Freund. 2001. Action observation activates premotor and paretal areas in a somatotopic manner: An fMRI study. European Journal of Neuroscience, 13:400--404.
• 8: N. Chang. 2004a. Constructing Grammar: A computational model of the emergence of early constructions. PhD thesis, University of California at Berkeley.
• 9: N. Chang. 2004b. Putting Meaning into Grammar Learning. In Proc. Psychocomputational Models of Human Language Acquisition. Geneva.
• 10: N. Chang, J. Feldman, R. Porzel and K. Sanders. 2002. Scaling cognitive linguistics: Formalisms for language understanding. In Proceedings of the 1st International Workshop on Scalable Natural Language Understanding, Heidelberg, Germany.
• 11: N. Chang and O. Gurevich. Context-driven construction learning. Proc. 26th Cognitive Science Society Conference.
• 12: Nancy Chang , Srini Narayanan , Miriam R. L. Petruck, Putting frames in perspective, Proceedings of the 19th international conference on Computational linguistics, p.1-7, August 24-September 01, 2002, Taipei, Taiwan [doi>10.3115/1072228.1072384]
• 13: W. Croft. 2001. Radical Construction Grammar. Oxford University Press.
• 14: G. Fauconnier. 1997. Mappings in Thought and Language. New York: Cambridge University Press.
• 15: J. Feldman. 2002. The meaning of reference in embodied construction grammar. Technical Report, International Computer Science Institute, ICSI TR-02-11, Berkeley, CA.
• 16: J. Feldman. 2004. From Molecule to Metaphor: A Neural Theory of Language. Forthcoming
• 17: J. Feldman and S. Narayanan. 2003. Embodied meaning in a neural theory of language. Brain and Language, 89:385--392.
• 18: C. Fillmore and P. Kay. 1999. Construction Grammar. CSLI, Stanford, CA to appear.
• 19: A. E. Goldberg. 1995. Constructions: A Construction Grammar Approach to Argument Structure. University of Chicago Press.
• 20: Finn V. Jensen , F.V. V. Jensen , F. V. Jensen, Introduction to Bayesian Networks, Springer-Verlag New York, Inc., Secaucus, NJ, 1996
• 21: G. Lakoff and M. Johnson. 1999. Philosophy in the flesh: The embodied mind and its challenge to western thought, 2nd ed. 202--251. Cambridge: Cambridge University Press.
• 22: R. Langacker. 1991. Concept, Image, Symbol: The Cognitive Basics of Grammar. Mouton de Gruyter.
• 23: B. MacWhinney. 1991. The CHILDES project: Tools for analyzing talk. Erlbaum Associates, Mahwah, New Jersey.
• 24: E. Mok, J. Bryant, J. Feldman. 2004. Scaling up to Mental Spaces. In Proceedings of the Second International Workshop on Scalable Natural Language Understanding, Boston.
• 25: Srinivas Narayanan, Moving right along: a computational model of metaphoric reasoning about events, Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence, p.121-127, July 18-22, 1999, Orlando, Florida, United States
• 26: Srini Narayanan , Sanda Harabagiu, Question answering based on semantic structures, Proceedings of the 20th international conference on Computational Linguistics, p.693-es, August 23-27, 2004, Geneva, Switzerland [doi>10.3115/1220355.1220455]
• 27: F. Pulvermueller. 2001. Brain reflections of words and their meaning. Trends in Cognitive Science, 5(12).
• 28: T. Regier. 1996. The Human Semantic Potential. MIT Press, Cambridge, MA.
• 29: Avi Pfeffer , Daphne Koller, Semantics and Inference for Recursive Probability Models, Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence, p.538-544, July 30-August 03, 2000
• 30: J. Rissanen. 1978. Modeling by shortest data description. Automatica, 14:465--471.
• 31: L. Shastri. 2002. episodic memory and corticohippocampal interactions. Trends in Cognitive Science, 6:162--168.
• 32: D. I. Slobin. 1985. Crosslinguistic evidence for the language-making capacity. In Slobin, D. I., editor, Theoretical Issues, volume 2 of The Crosslinguistic Study of Language Acquisition, chapter 15. Lawrence Erlbaum Associates, Mahwah, New Jersey.
• 33: Andreas Stolcke, Bayesian learning of probabilistic language models, University of California at Berkeley, Berkeley, CA, 1994
• 34: M. Tomasello. 1992. First verbs: A case study of early grammatical development. Cambridge University Press, Cambridge, UK.
• 35: M. Tomasello. 2003. Constructing a Language: A usage-Based Theory of Language Acquisition. Harvard University Press, Cambridge, MA.