A multi modal supporting tool for multi lingual communication by inducing partner's reply

ABSTRACT

This paper introduces a new tool for supporting multilingual communication between speakers of different languages. Conventional tools such as electronic dictionaries enable users to communicate basic intentions to others, but are often insufficient to help understand replies. The input of a Japanese sentence in the proposed tool not only produces a translation of the sentences but also displays a window featuring possible answers. The authors have evaluated the function of a prototype system which resulted in a thorough understanding of the merits and comings of the proposed tool.

REFERENCES

• 1: A. Lavie , A. Waibel , L. Levin , M. Finke , D. Gates , M. Gavalda , T. Zeppenfeld , P. Zhan, JANUS-III: Speech-to-Speech Translation in Multiple Languages, Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 1, p.99, April 21-24, 1997
• 2: F. Sugaya, T. Takezawa, A. Yokoo, S. Yamamoto "End-to-end evaluation in ATR-MATRIX: Speech translation system between English and Japanese", Proc. Eurospeech99 pp.2431--2434 (1999).
• 3: S. Yamamoto, "Toward Speech Communications beyond Language Barrier -- Research of Spoken Language Translation Technologies at ATR ", Proc of ICSLP2000 vol.4, pp.406--411(2000).
• 4: B. Zhou, D. Dechelotte, Y. Gao, "Two-Way Speech-to-Speech Trans-lation on Handheld Devices", Proc of ICSLP2004 pp.1637--1640 (2004).
• 5: Hiroaki Hattori, An Automatic Speech Translation System on PDAs for Travel Conversation, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.211, October 14-16, 2002 [doi>10.1109/ICMI.2002.1166995]
• 6: Y. Lee, S. Oh, J. Park "Usability Consideration of Speech-to Speech Translation System", Proc. of ICSLP2004.
• 7: Y. Wakita, K. Matui, Y. Sagisaka, "Fine keyword clustering using a thesaurus and example sentences for speech translation", Proc of ICSLP2000, vol. 3, pp.390--393 (2000).
• 8: Osamu Furuse , Hitoshi Iida, Constituent boundary parsing for example-based machine translation, Proceedings of the 15th conference on Computational linguistics, August 05-09, 1994, Kyoto, Japan [doi>10.3115/991886.991902]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Prototyping

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design; Natural language; Voice I/O

General Terms:
Design, Experimentation, Languages

Keywords:
answer induction, retrieving meaning-equivalent sentences, speech processing, translation