Smoothing human-robot speech interactions by using a blinking-light as subtle expression

ABSTRACT

Speech overlaps, undesired collisions of utterances between systems and users, harm smooth communication and degrade the usability of systems. We propose a method to enable smooth speech interactions between a user and a robot, which enables subtle expressions by the robot in the form of a blinking LED attached to its chest. In concrete terms, we show that, by blinking an LED from the end of the user's speech until the robot's speech, the number of undesirable repetitions, which are responsible for speech overlaps, decreases, while that of desirable repetitions increases. In experiments, participants played a last-and-first game with the robot. The experimental results suggest that the blinking-light can prevent speech overlaps between a user and a robot, speed up dialogues, and improve user's impressions.

REFERENCES

• 1: Christoph Bartneck , Juliane Reichenbach, Subtle emotional expressions of synthetic characters, International Journal of Human-Computer Studies, v.62 n.2, p.179-192, February 2005 [doi>10.1016/j.ijhcs.2004.11.006]
• 2: L. Bell, J. Boye, and J. Gustafson. Real-time handling of fragmented utterances. In Proc. of NAACL-2001 workshop on Adaptation in Dialogue Systems, 2001.
• 3: A. Kendon. Do gestures communicate? A Review. Research in Language and Social Interaction, 27(3):175--200, 1994.
• 4: N. Kitaoka, M. Takeuchi, R. Nishimura, and S. Nakagawa. Response timing detection using prosodic and linguistic information for human-friendly spoken dialog systems. Journal of The Japanese Society for Artificial Intellignece, 20(3):220--228, 2005.
• 5: Kotaro Funakoshi , Kazuki Kobayashi , Mikio Nakano , Seiji Yamada , Yasuhiko Kitamura , Hiroshi Tsujino, Smoothing human-robot speech interactions by using a blinking-light as subtle expression, Proceedings of the 10th international conference on Multimodal interfaces, October 20-22, 2008, Chania, Crete, Greece [doi>10.1145/1452392.1452452]
• 6: Takanori Komatsu , Seiji Yamada, How do robotic agents' appearances affect people's interpretations of the agents' attitudes?, CHI '07 extended abstracts on Human factors in computing systems, April 28-May 03, 2007, San Jose, CA, USA [doi>10.1145/1240866.1241034]
• 7: M. Nakano, Y. Nagano, K. Funakoshi, T. Ito, K. Araki, Y. Hasegawa, and H. Tsujino. Analysis of user reactions to turn-taking failures in spoken dialogue systems. In Proc. of SIGdial-2007, 2007.
• 8: T. Ohsuga, M. Nishida, Y. Horiuchi, and A. Ichikawa. Investigation of the relationship between turn-taking and prosodic features in spontaneous dialogue. In Proc. of European Conference on Speech Communication and Technology, pages 33--36, 2005.
• 9: W. Rogers. The contribution of kinesic illustrators towards the comprehension of verbal behavior within utterances. Human Communication Research, 5:54--62, 1978.
• 10: N. Ward. On the expressive competencies needed for responsive systems. In Proc. of the CHI2003 workshop on Subtle Expressivity for Characters and Robots, 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

General Terms:
Experimentation, Verification

Keywords:
human-robot interaction, speech overlap, subtle expression, turn-taking