Automatic prediction of misconceptions in multilingual computer-mediated communication

ABSTRACT

Multilingual communities using machine translation to overcome language barriers are showing up with increasing frequency. However, when a large number of translation errors get mixed into conversations, users have difficulty completely understanding each other. In this paper, we focus on misconceptions found in high volume in actual online conversations using machine translation. We first examine the response patterns in machine translation-mediated communication and associate them with misconceptions. Analysis results indicate that response messages to include misconceptions posted via machine translation tend to be incoherent, often focusing on short phrases of the original message. Next, based on the analysis results, we propose a method that automatically predicts the occurrence of misconceptions in each dialogue. The proposed method assesses the tendency of each dialogue including misconceptions by calculating the gaps between the regular discussion thread (syntactic thread) and the discussion thread based on lexical cohesion (semantic thread). Verification results show significant positive correlation between actual misconception frequency and gaps between syntactic and semantic threads, which indicate the validity of the method.

REFERENCES

• 1: Milam W. Aiken , Jeanette S. Martin , Joseph G.P. Paolillo , Ashraf I. Shirani, A group decision support system for multilingual groups, Information and Management, v.26 n.3, p.155-161, March 1994 [doi>10.1016/0378-7206(94)90039-6]
• 2: Milam Aiken, Multilingual communication in electronic meetings, ACM SIGGROUP Bulletin, v.23 n.1, p.18-19, April 2002 [doi>10.1145/945541.945543]
• 3: Blakar, R. Toward a theory of communication in terms of preconditions: A conceptual framework and some empirical explorations. Recent Advances in Language, Communication, and Social Psychology, 1985, 10--40.
• 4: Elizabeth F. Churchill , Sara Bly, Culture vultures: considering culture and communication in virtual environments, ACM SIGGROUP Bulletin, v.21 n.1, p.6-11, April 2000 [doi>10.1145/377272.377279]
• 5: Clark, H. H. and Marshall, C. E. Definite reference and mutual knowledge. Elements of discourse understanding, 1981, 10--63.
• 6: Clark, H. H. and Wilkes-Gibbs, D. Referring as a collaborative process. Cognition, 22, 1986, 1--39.
• 7: Clark, H. H. and Brennan, S. E., Grounding in communication. Perspectives on socially shared cognition, 1991, 127--149.
• 8: Climent, S., More, J., Oliver, A., Salvatierra, M., Sanchez, I., Taule, M. and Vallmanya, L. Bilingual Newsgroups in Catalonia: A Challenge for Machine Translation. Journal of Computer Mediated Communication, 9, 1, 2003.
• 9: Danet, B. and Herring, S.C. Introduction: The Multilingual Internet, Journal of Computer Mediated Communication, vol. 9, no. 1, 2003.
• 10: Doherty-Sneddon, G., Anderson, A. H., O'Malley, C., Langton, S., Garrod, S. and Bruce, V. Face-to-face and video mediated communication: a comparison of dialogue structure and task performance. Journal of Experimental Psychology: Applied, 3, 1997, 105--125.
• 11: Judith Donath, A semantic approach to visualizing online conversations, Communications of the ACM, v.45 n.4, April 2002 [doi>10.1145/505248.505271]
• 12: Fussell, S. R. and Krauss, R. M. Coordination of knowledge in communication: Effects of speakers' assumptions about what others know. Journal of Personality and Social Psychology, 62, 1992, 378--391.
• 13: Susan R. Fussell , Robert E. Kraut , Jane Siegel, Coordination of communication: effects of shared visual context on collaborative work, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.21-30, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.358947]
• 14: Halliday, M.A.K. and Hasan, R. Cohesion in English, Longman, London, 1976.
• 15: Susan C. Herring, Interactional Coherence in CMC, Proceedings of the Thirty-Second Annual Hawaii International Conference on System Sciences-Volume 2, p.2022, January 05-08, 1999
• 16: Kim, K.J. and Bonk, C.J. Cross-Cultural Comparisons of Online Collaboration. Journal of Computer Mediated Communication, 8, 1, 2002.
• 17: Kraut, R. E., S. Lewis, S., and Swezey, L. Listener responsiveness and the coordination of conversation. Journal of Personality and Sociological Psychology, 43, 1982, 718--731.
• 18: David D. Lewis , Kimberly A. Knowles, Threading electronic mail: a preliminary study, Information Processing and Management: an International Journal, v.33 n.2, p.209-217, March 1997 [doi>10.1016/S0306-4573(96)00063-5]
• 19: Susan E. McDaniel , Gary M. Olson , Joseph C. Magee, Identifying and analyzing multiple threads in computer-mediated and face-to-face conversations, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.39-47, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240187]
• 20: Paula S. Newman, Exploring discussion lists: steps and directions, Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries, July 14-18, 2002, Portland, Oregon, USA [doi>10.1145/544220.544245]
• 21: Yvonne Rogers, Ghosts in the network: distributed troubleshooting in a shared working environment, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.346-355, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143546]
• 22: Rogers, Y. Coordinating computer-mediated work, Computer Supported Cooperative Work, vol. 1, pp. 295--315, 1993.
• 23: Takano, Y. and Noda, A. A temporary decline of thinking ability during foreign language processing. Journal of Cross-Cultural Psychology, 24, 1993, 445--462.
• 24: Lai Lai Tung , M. A. Quaddus, Cultural differences explaining the differences in results in GSS: implications for the next decade, Decision Support Systems, v.33 n.2, p.177-199, June 2002 [doi>10.1016/S0167-9236(01)00143-9]
• 25: Yutaka Yamauchi , Makoto Yokozawa , Takeshi Shinohara , Toru Ishida, Collaboration with Lean Media: how open-source software succeeds, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.329-338, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.359004]
• 26: Grice, H. P. Logic and conversation. In Cole, P. and Morgan, 1975, 41--58.
• 27: Ohno, F, Hamanishi, T, Kadokawa Thesaurus, Kadokawa Shoten, 1981.
• 28: Schegloff, E. A. and Sacks, H. Opening up closings. Semotica, 8, 1973, 289--327.
• 29: Yoshida, Y. and Ohga, J. Effect of S/N ratio on comfortableness of telephone dialog. Acoustic Conference, 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Computer-supported cooperative work

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Asynchronous interaction

General Terms:
Experimentation, Human Factors, Measurement

Keywords:
computer-mediated communication, machine translation, misconception, multilingual groups