Field trial for simultaneous teleoperation of mobile social robots

ABSTRACT

Simultaneous teleoperation of mobile, social robots presents unique challenges, combining the real-time demands of conversation with the prioritized scheduling of navigational tasks. We have developed a system in which a single operator can effectively control four mobile robots performing both conversation and navigation. We compare the teleoperation requirements for mobile, social robots with those of traditional robot systems, and we identify metrics for evaluating task difficulty and operator performance for teleoperation of mobile social robots. As a proof of concept, we present an integrated priority model combining real-time conversational demands and non-real-time navigational demands for operator attention, and in a pioneering study, we apply the model and metrics in a demonstration of our multi-robot system through real-world field trials in a shopping arcade.

REFERENCES

• 1: Wolfram Burgard , Armin B. Cremers , Dieter Fox , Dirk Hähnel , Gerhard Lakemeyer , Dirk Schulz , Walter Steiner , Sebastian Thrun, The interactive museum tour-guide robot, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.11-18, July 1998, Madison, Wisconsin, United States
• 2: Jacob W. Crandall , M. L. Cummings, Developing performance metrics for the supervisory control of multiple robots, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228722]
• 3: Crandall, J.W., Goodrich, M.A., Olsen, D.R., Jr., Nielsen, C.W., Validating human-robot interaction schemes in multi-tasking environments, IEEE Trans. on Systems, Man and Cybernetics, Part A, 35 (4), pp. 438--449, 2005
• 4: Fong, T. et al.: A Preliminary Study of Peer-to-Peer Human-Robot Interaction, Int. Conf. on Systems, Man, and Cybernetics, 2006
• 5: Fong, T., Thorpe, C., and Baur, C., Robot as partner: vehicle teleoperation with collaborative control, In Proceedings from the 2002 NRL Workshop on Multi-Robot Systems, 2002.
• 6: Dylan F. Glas , Takayuki Kanda , Hiroshi Ishiguro , Norihiro Hagita, Simultaneous teleoperation of multiple social robots, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349863]
• 7: Glas, D., et al., Laser Tracking of Human Body Motion Using Adaptive Shape Modeling, Int. Conf. on Intelligent Robots and Systems (IROS 2007), pp. 602--608, 2007.
• 8: Michael A. Goodrich , Alan C. Schultz, Human-robot interaction: a survey, Foundations and Trends in Human-Computer Interaction, v.1 n.3, p.203-275, February 2007 [doi>10.1561/1100000005]
• 9: Michael A. Goodrich , Timothy W. McLain , Jeffrey D. Anderson , Jisang Sun , Jacob W. Crandall, Managing autonomy in robot teams: observations from four experiments, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228721]
• 10: Green, A. et al. Applying the Wizard-of-Oz Framework to Cooperative Service Discovery and Configuration, Int. Workshop on Robot and Human Interactive Communication, 2004.
• 11: Hart, S. G., Staveland, L. E., Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research, In Human Mental Workload, P. Hancock, N. Meshkati (Eds.) pp. 139 -- 183, 1988.
• 12: Kotaro Hayashi , Daisuke Sakamoto , Takayuki Kanda , Masahiro Shiomi , Satoshi Koizumi , Hiroshi Ishiguro , Tsukasa Ogasawara , Norihiro Hagita, Humanoid robots as a passive-social medium: a field experiment at a train station, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228735]
• 13: Susan G. Hill , Barry Bodt, A field experiment of autonomous mobility: operator workload for one and two robots, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228739]
• 14: Takayuki Kanda , Takayuki Hirano , Daniel Eaton , Hiroshi Ishiguro, Interactive robots as social partners and peer tutors for children: a field trial, Human-Computer Interaction, v.19 n.1, p.61-84, June 2004 [doi>10.1207/s15327051hci1901&2_4]
• 15: Tobias Kaupp , Alexei Makarenko, Decision-theoretic human-robot communication, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349835]
• 16: Mau, S., Dolan, J., Scheduling for Humans in Multirobot Supervisory Control, Int. Conf. on Intelligent Robots and Systems (IROS 2007), pp.1637--1643, 2007.
• 17: Bilge Mutlu , Jodi Forlizzi, Robots in organizations: the role of workflow, social, and environmental factors in human-robot interaction, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349860]
• 18: Olsen, D.R., Jr., & Goodrich, M. A., Metrics for Evaluating Human-Robot Interactions. PERMIS 2003, September 2003.
• 19: Sanfeliu A. and Andrade J., Ubiquitous networking robotics in urban settings, in Proc. IEEE/RSJ IROS Workshop on Network Robot Systems, pp. 14--18, 2006.
• 20: Schulz, D., Burgard, W., Fox, D., and Cremers, A., People Tracking with Mobile Robots Using Sample-Based Joint Probabilistic Data Association Filters, International Journal of Robotics Research, Vol. 22, No. 2, 99--116 (2003)
• 21: Brennan P. Sellner , Laura M. Hiatt , Reid Simmons , Sanjiv Singh, Attaining situational awareness for sliding autonomy, Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, March 02-03, 2006, Salt Lake City, Utah, USA [doi>10.1145/1121241.1121257]
• 22: Masahiro Shiomi , Takayuki Kanda , Hiroshi Ishiguro , Norihiro Hagita, Interactive Humanoid Robots for a Science Museum, IEEE Intelligent Systems, v.22 n.2, p.25-32, March 2007 [doi>10.1109/MIS.2007.37]
• 23: Toshiyuki Shiwa , Takayuki Kanda , Michita Imai , Hiroshi Ishiguro , Norihiro Hagita, How quickly should communication robots respond?, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349843]
• 24: Siegwart, R. et al.: Robox at Expo.02: A Large Scale Installation of Personal Robots. Robotics and Autonomous Systems, 42, 203--222, 2003.
• 25: Aaron Steinfeld , Terrence Fong , David Kaber , Michael Lewis , Jean Scholtz , Alan Schultz , Michael Goodrich, Common metrics for human-robot interaction, Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, March 02-03, 2006, Salt Lake City, Utah, USA [doi>10.1145/1121241.1121249]
• 26: Jijun Wang , Michael Lewis, Assessing cooperation in human control of heterogeneous robots, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349825]
• 27: Woods, S. et al.: Comparing Human Robot Interaction Scenarios Using Live and Video Based Methods, Towards a Novel Methodological Approach, Int. Workshop on Advanced Motion Control, 2006

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.9 Robotics

General Terms:
Design, Human Factors

Keywords:
adjustable autonomy, prioritized control, simultaneous teleoperation, teleoperation of social robots