An affective guide robot in a shopping mall

ABSTRACT

To explore possible robot tasks in daily life, we developed a guide robot for a shopping mall and conducted a field trial with it. The robot was designed to interact naturally with customers and to affectively provide shopping information. It was also designed to repeatedly interact with people to build a rapport; since a shopping mall is a place people repeatedly visit, it provides the chance to explicitly design a robot for multiple interactions. For this capability, we used RFID tags for person identification. The robot was semi-autonomous, partially controlled by a human operator, to cope with the difficulty of speech recognition in a real environment and to handle unexpected situations.

A field trial was conducted at a shopping mall for 25 days to observe how the robot performed this task and how people interacted with it. The robot interacted with approximately 100 groups of customers each day. We invited customers to sign up for RFID tags and those who participated answered questionnaires. The results revealed that 63 out of 235 people in fact went shopping based on the information provided by the robot. The experimental results suggest promising potential for robots working in shopping malls.

REFERENCES

• 1: Kidd, C. and Breazeal, C., Effect of a Robot on User Perceptions, IROS'04, pp. 3559--3564, 2004.
• 2: Aaron Powers , Sara Kiesler , Susan Fussell , Cristen Torrey, Comparing a computer agent with a humanoid robot, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228736]
• 3: Mutlu, B. et al., A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior, IEEE Int. Conf. on Humanoid Robots (Humanoids2006), pp. 518--523, 2006.
• 4: Peter H. Kahn , Nathan G. Freier , Takayuki Kanda , Hiroshi Ishiguro , Jolina H. Ruckert , Rachel L. Severson , Shaun K. Kane, Design patterns for sociality in human-robot interaction, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349836]
• 5: Wolfram Burgard , Armin B. Cremers , Dieter Fox , Dirk Hähnel , Gerhard Lakemeyer , Dirk Schulz , Walter Steiner , Sebastian Thrun, The interactive museum tour-guide robot, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.11-18, July 1998, Madison, Wisconsin, United States
• 6: Siegwart, R. et al., Robox at Expo.02: A Large Scale Installation of Personal Robots, Robotics and Autonomous Systems, 42(3), pp. 203--222, 2003.
• 7: Takayuki Kanda , Takayuki Hirano , Daniel Eaton , Hiroshi Ishiguro, Interactive robots as social partners and peer tutors for children: a field trial, Human-Computer Interaction, v.19 n.1, p.61-84, June 2004 [doi>10.1207/s15327051hci1901&2_4]
• 8: Wada, K. et al., Effects of robot-assisted activity for elderly people and nurses at a day service center, Proceedings of the IEEE, 92(11), pp. 1780--1788, 2004.
• 9: Dautenhahn, K. et al., A quantitative technique for analysing robot-human interactions, IROS'02, pp.1132--1138, 2002.
• 10: Kozima, H., Nakagawa C., and Yasuda, Y., Interactive robots for communication-care: A case-study in autism therapy, RoMan 2005, pp. 341--346, 2005.
• 11: Tanaka, F. et al., Socialization between toddlers and robots at an early childhood education center, Proc. of the National Academy of Sciences of the USA, 104(46), pp. 17954--17958, 2007.
• 12: Dahlback, D. et al., Wizard of Oz studies - why and how, Knowledge based systems, 6(4), pp. 258--266, 1993.
• 13: Green A. et al. Applying the Wizard-of-Oz Framework to Cooperative Service Discovery and Configuration, RoMan 2004, 2004.
• 14: Dylan F. Glas , Takayuki Kanda , Hiroshi Ishiguro , Norihiro Hagita, Simultaneous teleoperation of multiple social robots, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349863]
• 15: Dario, P., Guglielmelli, E., and Laschi, C., Humanoids and personal robots: Design and experiments, Journal of Robotic Systems, 18 (12), pp. 673--690, 2001.
• 16: Goetz, J., Kiesler, S., and Powers, A., Matching robot appearance and behaviors to tasks to improve human robot cooperation, RoMan 2003, pp. 55--60, 2003.
• 17: Robins, B., Ferrari, E., and Dautenhahn, K., Developing Scenarios for Robot Assisted Play, RoMan2008, pp. 180--186, 2008.
• 18: Research study for the scope of the strategy map of robotics technology, 2005. (Available at http://www.nedo.go.jp/ database/index.html, with index code 100007875) (in Japanese)
• 19: Rosalind W. Picard, Affective computing, MIT Press, Cambridge, MA, 1997
• 20: Takayuki Kanda , Dylan F. Glas , Masahiro Shiomi , Hiroshi Ishiguro , Norihiro Hagita, Who will be the customer?: a social robot that anticipates people's behavior from their trajectories, Proceedings of the 10th international conference on Ubiquitous computing, September 21-24, 2008, Seoul, Korea [doi>10.1145/1409635.1409686]
• 21: Alberto Sanfeliu , Norihiro Hagita , Alessandro Saffiotti, Network robot systems, Robotics and Autonomous Systems, v.56 n.10, p.793-797, October, 2008 [doi>10.1016/j.robot.2008.06.007]
• 22: Ishi, C. T. et al., Robust speech recognition system for communication robots in real environments, IEEE Int. Conf. on Humanoid Robots, pp. 340--345, 2006.
• 23: Masahiro Shiomi , Daisuke Sakamoto , Kanda Takayuki , Carlos Toshinori Ishi , Hiroshi Ishiguro , Norihiro Hagita, A semi-autonomous communication robot: a field trial at a train station, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349862]
• 24: Timothy W. Bickmore , Rosalind W. Picard, Establishing and maintaining long-term human-computer relationships, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.2, p.293-327, June 2005 [doi>10.1145/1067860.1067867]
• 25: Sugiyama, O. et al., Humanlike conversation with gestures and verbal cues based on a three-layer attention-drawing model, Connection science, 18(4), pp. 379--402, 2006.
• 26: Rachel Gockley , Jodi Forlizzi , Reid Simmons, Interactions with a moody robot, Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, March 02-03, 2006, Salt Lake City, Utah, USA [doi>10.1145/1121241.1121274]
• 27: Takuya Murakita , Tetsushi Ikeda , Hiroshi Ishiguro, Human Tracking using Floor Sensors based on the Markov Chain Monte Carlo Method, Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4, p.917-920, August 23-26, 2004 [doi>10.1109/ICPR.2004.447]
• 28: Kanda, T. et al., A two-month Field Trial in an Elementary School for Long-term Human-robot Interaction, IEEE Transactions on Robotics, 23(5), pp. 962--971, 2007.
• 29: Toshiyuki Shiwa , Takayuki Kanda , Michita Imai , Hiroshi Ishiguro , Norihiro Hagita, How quickly should communication robots respond?, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349843]
• 30: Marcel Heerink , Ben Kröse , Bob Wielinga , Vanessa Evers, Enjoyment intention to use and actual use of a conversational robot by elderly people, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349838]
• 31: Leila Takayama , Wendy Ju , Clifford Nass, Beyond dirty, dangerous and dull: what everyday people think robots should do, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349827]
• 32: Toyoda, H., Structural Equation Modeling, Tokyo Tosho, 2007. (in Japanese)
• 33: Kaplan, D. W., Structural Equation Modeling: Foundations and Extensions, Sage Publications, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design

General Terms:
Design, Human Factors

Keywords:
communication robots, field trial, service robots