How to approach humans?: strategies for social robots to initiate interaction

ABSTRACT

This paper proposes a model of approach behavior with which a robot can initiate conversation with people who are walking. We developed the model by learning from the failures in a simplistic approach behavior used in a real shopping mall. Sometimes people were unaware of the robot's presence, even when it spoke to them. Sometimes, people were not sure whether the robot was really trying to start a conversation, and they did not start talking with it even though they displayed interest. To prevent such failures, our model includes the following functions: predicting the walking behavior of people, choosing a target person, planning its approaching path, and nonverbally indicating its intention to initiate a conversation. The approach model was implemented and used in a real shopping mall. The field trial demonstrated that our model significantly improves the robot's performance in initiating conversations.

REFERENCES

• 1: A. Kendon, Features of the structural analysis of human communicational behavior. In Walburga von Raffler Engel, ed., Aspects of Nonverbal Communication. 1980.
• 2: A. Scheidig, S. Mueller, C. Martin, and H.-M. Gross, Generating Persons Movement Trajectories on a Mobile Robot, IEEE Int. Workshop on Robot and Human Interactive Communication (RoMan 2006), pp. 747--752, 2006.
• 3: Benjamin Fransen , Vlad Morariu , Eric Martinson , Samuel Blisard , Matthew Marge , Scott Thomas , Alan Schultz , Dennis Perzanowski, Using vision, acoustics, and natural language for disambiguation, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228727]
• 4: B. Jensen et al., The interactive autonomous mobile system RoboX, In Proc. Int. Conf. Intelligent Robots and Systems (IROS2002), 2002.
• 5: D. Glas et al., Laser Tracking of Human Body Motion Using Adaptive Shape Modeling, In Proc. Int. Conf. Intelligent Robots and Systems (IROS2007), pp. 602--608, 2007.
• 6: E. A. Sisbot et al., Implementing a Human-Aware Robot System, IEEE Int. Workshop on Robot and Human Interactive Communication, pp. 727--732, 2006.
• 7: E. A. Sisbot et al., Navigation in the Presence of Humans, IEEE-RAS International Conference on Humanoid Robots, 2005
• 8: E. Goffman, Behavior in public place: Notes on the Social Organization of Gatherings, 1963.
• 9: E. Pacchierotti, H. I. Christensen, and P. Jensfelt, Design of an office guide robot for social interaction studies, In Proc. Int. Conf. Intelligent Robots and System, pp. 4965--4970, 2006.
• 10: E. T. Hall, The Hidden Dimension, 1966.
• 11: F. Tanaka et al., Socialization between toddlers and robots at an early childhood education center, Proceedings of the National Academy of Sciences of the USA, 104(46), pp. 17954--17958, 2007.
• 12: Guy Hoffman , Cynthia Breazeal, Effects of anticipatory action on human-robot teamwork efficiency, fluency, and perception of team, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228718]
• 13: James Fogarty , Scott E. Hudson , Christopher G. Atkeson , Daniel Avrahami , Jodi Forlizzi , Sara Kiesler , Johnny C. Lee , Jie Yang, Predicting human interruptibility with sensors, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.1, p.119-146, March 2005 [doi>10.1145/1057237.1057243]
• 14: J. Schulte, C. Rosenberg, and S. Thrun, Spontaneous, short-term interaction with mobile robots, IEEE Int. Conf. on Robotics and Automation (ICRA99), pp. 658--663, 1999.
• 15: K. Dautenhahn , M. Walters , S. Woods , K. L. Koay , C. L. Nehaniv , A. Sisbot , R. Alami , T. Siméon, How may I serve you?: a robot companion approaching a seated person in a helping context, Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, March 02-03, 2006, Salt Lake City, Utah, USA [doi>10.1145/1121241.1121272]
• 16: Kotaro Hayashi , Daisuke Sakamoto , Takayuki Kanda , Masahiro Shiomi , Satoshi Koizumi , Hiroshi Ishiguro , Tsukasa Ogasawara , Norihiro Hagita, Humanoid robots as a passive-social medium: a field experiment at a train station, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228735]
• 17: K. Wada, T. Shibata, T. Saito, and K. Tanie, Analysis of Factors that Bring Mental Effects to Elderly People in Robot Assisted Activity, IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, 2002.
• 18: K. Yamazaki et al., Prior-to-request and request behaviors within elderly day care: Implications for developing service robots for use in multiparty settings, Proceedings of the Tenth European Conference on Computer Supported Cooperative Work, pp. 61--78, 2007.
• 19: M. Bennewitz, W. Burgard, G. Cielniak, and S. Thrun, Learning Motion Patterns of People for Compliant Robot Motion, Int. J. of Robotics Research, 24(1), pp. 31--48, 2005.
• 20: M. Finke, Kheng Lee Koay, and Kerstin Dautenhahn, Hey, I'm over here - How can a robot attract people's attention, IEEE Int. Workshop on Robot and Human Interactive Communication (RoMan 2005), pp. 7 -- 12, 2005.
• 21: M. L. Walters, D. S. Syrdal, K. L. Koay, K. Dautenhahn, R. te Boekhorst, Human Approach Distances to a Mechanical-Looking Robot with Different Robot Voice Styles, IEEE Int. Symposium on Robot and Human Interactive Communication (RoMan 2008), pp. 707--712, 2008.
• 22: M. P. Michalowski, S. Sabanovic, and R. Simmons, A Spatial Model of Engagement for a Social Robot, IEEE International Workshop on Advanced Motion Control (AMC'06), pp. 762--767, 2006.
• 23: Masahiro Shiomi , Takayuki Kanda , Hiroshi Ishiguro , Norihiro Hagita, Interactive Humanoid Robots for a Science Museum, IEEE Intelligent Systems, v.22 n.2, p.25-32, March 2007 [doi>10.1109/MIS.2007.37]
• 24: M. Yamamoto and T. Watanabe, Timing Control Effects of Utterance to Communicative Actions on Embodied Interaction with a Robot, IEEE Int. Workshop on Robot and Human Interactive Communication, pp. 467--472, 2004.
• 25: N. Bergström, T. Kanda, T. Miyashita, H. Ishiguro, and N. Hagita, Modeling of Natural Human-Robot Encounters, Int. Conf. Intelligent Robots and Systems (IROS2008), 2008.
• 26: Rachel Gockley , Jodi Forlizzi , Reid Simmons, Natural person-following behavior for social robots, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228720]
• 27: R. Gockley et al., Designing robots for long-term social interaction, In Proc. Int. Conf. Intelligent Robots and Systems (IROS2006), pp. 1338--1343, 2006.
• 28: R. Siegwart et al., Robox at expo.02: A Large Scale Installation of Personal Robots, Robotics and Autonomous Systems, 42(3), pp. 203--222, 2003.
• 29: S. Kagami, S. Thompson, Y. Nishida, T. Enomoto, and T. Matsui. Home robot service by ceiling ultrasonic locator and microphone array, IEEE International Conference on Robotics and Automation (ICRA2006), pp. 3171--3176, 2006.
• 30: S. Li, B. Wrede, and G. Sagerer, A dialog system for comparative user studies on robot verbal behavior, IEEE Int. Symposium on Robot and Human Interactive Communication (RoMan 2006), pp.129--134, 2006.
• 31: Takayuki Kanda , Dylan F. Glas , Masahiro Shiomi , Hiroshi Ishiguro , Norihiro Hagita, Who will be the customer?: a social robot that anticipates people's behavior from their trajectories, Proceedings of the 10th international conference on Ubiquitous computing, September 21-24, 2008, Seoul, Korea [doi>10.1145/1409635.1409686]
• 32: Takayuki Kanda , Takayuki Hirano , Daniel Eaton , Hiroshi Ishiguro, Interactive robots as social partners and peer tutors for children: a field trial, Human-Computer Interaction, v.19 n.1, p.61-84, June 2004 [doi>10.1207/s15327051hci1901&2_4]
• 33: T. Tasaki, S. Matsumoto, H. Ohba, M. Toda, K. Komatani, T. Ogata, and H. G. Okuno, Dynamic Communication of Humanoid Robot with multiple People Based on Interaction Distance, IEEE Int. Workshop on Robot and Human Interactive Communication (RoMan 2004), pp.71--76, 2004.
• 34: Wolfram Burgard , Armin B. Cremers , Dieter Fox , Dirk Hähnel , Gerhard Lakemeyer , Dirk Schulz , Walter Steiner , Sebastian Thrun, The interactive museum tour-guide robot, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.11-18, July 1998, Madison, Wisconsin, United States
• 35: X. Shao et al., Detection and tracking of multiple pedestrians by using laser range scanners, Int. Conf. on Intelligent Robots and Systems (IROS 2007), pp. 2174--2179, 2007.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Algorithms, Design, Human Factors, Performance

Keywords:
anticipation, approaching behavior, position-based interaction