A markup language for describing interactive humanoid robot presentations

ABSTRACT

This paper presents a multi-modal presentation markup language for humanoid robots, MPML-HR ver. 3.0, which is able to describe presentation contents including speech-based interactions with audiences. Previous versions of MPML-HR do not feature any interaction functionality which dynamically changes the presentation according to the utterances by audiences, although such interaction makes the presentation more effective and understandable. Since MPML-HR ver. 3.0 inherits simple descriptions of previous versions of MPML-HR, the content designer can describe interactive presentations without configuring conventional complicated multi-modal interactive systems.

REFERENCES

• 1: Y. Nishimura, K. Kushida, H. Dohi, M. Ishizuka, J. Takeuchi, and H. Tsujino, "Development and psychological evaluation of multimodal presentation markup language for humanoid robots," in Proc. of IEEE RAS Humanoids, 2005, pp. 393--398.
• 2: H. Prendinger, S. Descomps and M. Ishizuka, "MPML:A Markup Language for Controlling the Behavior of Life-like Characters," Journal of Visual Languages and Computing, 2004, Vol.15, No.2, pp. 183--203.
• 3: Voice XML Forum homapage: http://www.voicexml.org/
• 4: Kouichi Katsurada , Yusaku Nakamura , Hirobumi Yamada , Tsuneo Nitta, XISL: a language for describing multimodal interaction scenarios, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada [doi>10.1145/958432.958483]
• 5: J. Glass and E. Weinstein, "SpeechBuilder: Facilitating spoken dialogue system development," in Proc. Eurospeech, 2001, pp. 1335--1338.
• 6: S. Sutton et al., "Universal Speech Tools: The CSLU Toolkit" in Proc. ICSLP, 1998, pp. 3221--3224.
• 7: M. Nakano, Y. Hasegawa, K. Nakadai, T. Nakamura, J. Takeuchi, T. Torii, H. Tsujino, N. Kanda, and H. G. Okuno, "A two-layer model for behavior and dialogue planning in conversational service robots," in Proc. IEEE/RSJ IROS, 2005, pp. 1542--1548.
• 8: T. Kawahara, A. Lee, K. Takeda, K. Itou, and K. Shikano, "Recent progress of open-source LVCSR engine Julius and Japanese model repository," in Proc. ICSLP, 2004, pp. 3069--3072.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Voice I/O

General Terms:
Design, Human Factors, Languages

Keywords:
interaction, multimodal system, presentation