Identifying agreement and disagreement in conversational speech: use of Bayesian networks to model pragmatic dependencies

ABSTRACT

We describe a statistical approach for modeling agreements and disagreements in conversational interaction. Our approach first identifies adjacency pairs using maximum entropy ranking based on a set of lexical, durational, and structural features that look both forward and backward in the discourse. We then classify utterances as agreement or disagreement using these adjacency pairs and features that represent various pragmatic influences of previous agreement or disagreement on the current utterance. Our approach achieves 86.9% accuracy, a 4.9% increase over previous work.

REFERENCES

• 1: Adam L. Berger , Vincent J. Della Pietra , Stephen A. Della Pietra, A maximum entropy approach to natural language processing, Computational Linguistics, v.22 n.1, p.39-71, March 1996
• 2: J. Cohen. 1960. A coefficient of agreement for nominal scales. Educational and Psychological measurements, 20:37--46.
• 3: S. Cohen. 2002. A computerized scale for monitoring levels of agreement during a conversation. In Proc. of the 26th Penn Linguistics Colloquium.
• 4: Michael Collins, Discriminative Reranking for Natural Language Parsing, Proceedings of the Seventeenth International Conference on Machine Learning, p.175-182, June 29-July 02, 2000
• 5: J. N. Darroch and D. Ratcliff. 1972. Generalized iterative scaling for log-linear models. Annals of Mathematical Statistics, 43:1470--1480.
• 6: R. Dhillon, S. Bhagat, H. Carvey, and E. Shriberg. 2004. Meeting recorder project: Dialog act labeling guide. Technical Report TR-04-002, ICSI.
• 7: Vasileios Hatzivassiloglou , Kathleen R. McKeown, Predicting the semantic orientation of adjectives, Proceedings of the 35th annual meeting on Association for Computational Linguistics, p.174-181, July 07-12, 1997, Madrid, Spain
• 8: Dustin Hillard , Mari Ostendorf , Elizabeth Shriberg, Detection of agreement vs. disagreement in meetings: training with unlabeled data, Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology: companion volume of the Proceedings of HLT-NAACL 2003--short papers, p.34-36, May 27-June 01, 2003, Edmonton, Canada [doi>10.3115/1073483.1073495]
• 9: Julia Hirschberg , Diane Litman, Empirical studies on the disambiguation of cue phrases, Computational Linguistics, v.19 n.3, p.501-530, September 1993
• 10: A. Janin, D. Baron, J. Edwards, D. Ellis, D. Gelbart, N. Morgan, B. Peskin, T. Pfau, E. Shriberg, A. Stolcke, and C. Wooters. 2003. The ICSI meeting corpus. In Proc. of ICASSP-03, Hong Kong.
• 11: D. Klein and C. D. Manning. 2002. Conditional structure versus conditional estimation in NLP models. Technical report.
• 12: S. Levinson. 1983. Pragmatics. Cambridge University Press.
• 13: Andrew McCallum , Dayne Freitag , Fernando C. N. Pereira, Maximum Entropy Markov Models for Information Extraction and Segmentation, Proceedings of the Seventeenth International Conference on Machine Learning, p.591-598, June 29-July 02, 2000
• 14: A. Pomerantz. 1984. Agreeing and disagreeing with assessments: some features of preferred/dispreferred turn shapes. In J. M. Atkinson and J. C. Heritage, editors, Structures of Social Action, pages 57--101.
• 15: A. Ratnaparkhi. 1996. A maximum entropy part-of-speech tagger. In Proc. of EMNLP.
• 16: Deepak Ravichandran , Eduard Hovy , Franz Josef Och, Statistical QA - classifier vs. re-ranker: what's the difference?, Proceedings of the ACL 2003 workshop on Multilingual summarization and question answering, p.69-75, July 11, 2003 [doi>10.3115/1119312.1119321]
• 17: E. A. Schegloff and H Sacks. 1973. Opening up closings. Semiotica, 7-4:289--327.
• 18: E. Shriberg, R. Dhillon, S. Bhagat, J. Ang, and H. Carvey. 2004. The ICSI meeting recorder dialog act (MRDA) corpus. In SIGdial Workshop on Discourse and Dialogue, pages 97--100.
• 19: Andreas Stolcke , Noah Coccaro , Rebecca Bates , Paul Taylor , Carol Van Ess-Dykema , Klaus Ries , Elizabeth Shriberg , Daniel Jurafsky , Rachel Martin , Marie Meteer, Dialogue act modeling for automatic tagging and recognition of conversational speech, Computational Linguistics, v.26 n.3, p.339-373, September 2000 [doi>10.1162/089120100561737]