Hierarchical rule generalisation for speaker identification in fiction books

ABSTRACT

This paper presents a hierarchical pattern matching and generalisation technique which is applied to the problem of locating the correct speaker of quoted speech found in fiction books. Patterns from a training set are generalised to create a small number of rules, which can be used to identify items of interest within the text. The pattern matching technique is applied to finding the Speech-Verb, Actor and Speaker of quotes found in fiction books. The technique performs well over the training data, resulting in rule-sets many times smaller than the training set, but providing very high accuracy. While the rule-set generalised from one book is less effective when applied to different books than an approach based on hand coded heuristics, performance is comparable when testing on data closely related to the training set.

REFERENCES

• 1: Daniel M. Bikel , Richard Schwartz , Ralph M. Weischedel, An Algorithm that Learns What‘s in a Name, Machine Learning, v.34 n.1-3, p.211-231, Feb. 1999 [doi>10.1023/A:1007558221122]
• 2: Mary Elaine Califf , Raymond J. Mooney, Bottom-up relational learning of pattern matching rules for information extraction, The Journal of Machine Learning Research, 4, p.177-210, 12/1/2003 [doi>10.1162/153244304322972685]
• 3: Ciravegna, F. 2001. Adaptive information extraction from text by rule induction and generalisation. In 17th International Joint Conference on Artificial Intelligence (IJCAI). Seattle.
• 4: William W. Cohen , Sunita Sarawagi, Exploiting dictionaries in named entity extraction: combining semi-Markov extraction processes and data integration methods, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA [doi>10.1145/1014052.1014065]
• 5: Hervé Déjean, Learning rules and their exceptions, The Journal of Machine Learning Research, 2, 3/1/2002
• 6: Downey, D., Soderland, O. E. S., and Weld, D. 2004. Learning text patterns for web information extraction and assessment. In AAAI 2004 workshop on Adaptive Text Extraction and Mining. San Jose, CA.
• 7: Dayne Freitag, Machine Learning for Information Extraction in Informal Domains, Machine Learning, v.39 n.2-3, p.169-202, May-June 2000 [doi>10.1023/A:1007601113994]
• 8: Kevin Glass , Shaun Bangay, Evaluating parts-of-speech taggers for use in a text-to-scene conversion system, Proceedings of the 2005 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries, p.20-28, September 20-22, 2005, White River, South Africa
• 9: Hobbs, J. R. 1978. Resolving pronoun references. Lingua 44, 311--338.
• 10: Christopher Kennedy , Branimir Boguraev, Anaphora for everyone: pronominal anaphora resoluation without a parser, Proceedings of the 16th conference on Computational linguistics, August 05-09, 1996, Copenhagen, Denmark [doi>10.3115/992628.992651]
• 11: Shalom Lappin , Herbert J. Leass, An algorithm for pronominal anaphora resolution, Computational Linguistics, v.20 n.4, p.535-561, December 1994
• 12: Ruslan Mitkov , Richard Evans , Constantin Orasan, A New, Fully Automatic Version of Mitkov's Knowledge-Poor Pronoun Resolution Method, Proceedings of the Third International Conference on Computational Linguistics and Intelligent Text Processing, p.168-186, February 17-23, 2002
• 13: MUC-7. 1998. MUC-7 test scores introduction. In Proceedings of 7th Message Understanding Conference. Fairfax, Virginia.
• 14: Ion Muslea , Steve Minton , Craig Knoblock, A hierarchical approach to wrapper induction, Proceedings of the third annual conference on Autonomous Agents, p.190-197, April 1999, Seattle, Washington, United States [doi>10.1145/301136.301191]
• 15: Stephen Soderland, Learning Information Extraction Rules for Semi-Structured and Free Text, Machine Learning, v.34 n.1-3, p.233-272, Feb. 1999 [doi>10.1023/A:1007562322031]
• 16: Tapanainen, P. 1999. Parsing in two frameworks: finite-state and functional dependency grammar. Ph.D. thesis, University of Helsinki.
• 17: Nina Wacholder , Yael Ravin , Misook Choi, Disambiguation of proper names in text, Proceedings of the fifth conference on Applied natural language processing, p.202-208, March 31-April 03, 1997, Washington, DC [doi>10.3115/974557.974587]
• 18: Roman Yangarber , Ralph Grishman , Pasi Tapanainen , Silja Huttunen, Automatic acquisition of domain knowledge for Information Extraction, Proceedings of the 18th conference on Computational linguistics, July 31-August 04, 2000, Saarbrücken, Germany [doi>10.3115/992730.992782]
• 19: Zhang, J., Black, A., and Sproat, R. 2003. Identifying speakers in children's stories for speech synthesis. In Proceedings of EUROSPEECH 2003. Geneva.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning
          Subjects: Induction

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.7 Natural Language Processing
          Subjects: Language parsing and understanding

General Terms:
Algorithms, Languages

Keywords:
generalisation, machine learning, pattern matching