Assessing cooperation in human control of heterogeneous robots

ABSTRACT

Human control of multiple robots has been characterized by the average demand of single robots on human attention. While this matches situations in which independent robots are controlled sequentially it does not capture aspects of demand associated with coordinating dependent actions among robots. This paper presents an extension of Crandall's neglect tolerance model intended to accommodate both coordination demands (CD) and heterogeneity among robots. The reported experiment attempts to manipulate coordination demand by varying the proximity needed to perform a joint task in two conditions and by automating coordination within subteams in a third. Team performance and the process measure CD were assessed for each condition. Automating cooperation reduced CD and improved performance. We discuss the utility of process measures such as CD to analyze and improve control performance.

REFERENCES

• 1: Stephen Balakirsky , Stefano Carpin , Alexander Kleiner , Michael Lewis , Arnoud Visser , Jijun Wang , Vittorio Amos Ziparo, Towards heterogeneous robot teams for disaster mitigation: Results and performance metrics from RoboCup rescue: Field Reports, Journal of Field Robotics, v.24 n.11-12, p.943-967, November 2007 [doi>10.1002/rob.v24:11/12]
• 2: Crandall, J., Goodrich, M., Olsen, D. and Nielsen, C. Validating human-robot interaction schemes in multitasking environments. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 35(4):438--449, 2005.
• 3: Jacob W. Crandall , M. L. Cummings, Developing performance metrics for the supervisory control of multiple robots, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228722]
• 4: Gerkey, B. and Mataric, M. A formal framework for the study of task allocation in multi-robot systems. International Journal of Robotics Research, 23(9):939--954, 2004.
• 5: Lewis, M., J. Wang, and S. Hughes, USARSim: Simulation for the Study of Human-Robot Interaction. Journal of Cognitive Engineering and Decision Making, 2007. 1(1): p. 98--120.
• 6: Murphy, R.R. and J.L. Burke, Up from the Rubble: Lessons Learned about HRI from Search and Rescue, in Proceedings of the 49th Annual Meetings of the Human Factors and Ergonomics Society. 2005: Orlando.
• 7: Nielsen, C., Goodrich, M., and Crandall, J. Experiments in human-robot teams. In Proceedings of the 2002 NRL Workshop on Multi-Robot Systems, October 2003
• 8: Parasuraman, R., Galster, S., Squire, P., Furukawa, H. and Miller, C.. A flexible delegation-type interface enhances system performance in human supervision of multiple robots: Empirical studies with roboflag. IEEE Systems, Man and Cybernetics-Part A, 35(4):481--493, July 2005
• 9: Scerri, P., et al., Coordinating large groups of wide area search munitions, in Recent Developments in Cooperative Control and Optimization, D. Grundel, R. Murphey, and P. Pandalos, Editors. 2004, Singapore: World Scientific. p. 451--480.
• 10: Aaron Steinfeld , Terrence Fong , David Kaber , Michael Lewis , Jean Scholtz , Alan Schultz , Michael Goodrich, Common metrics for human-robot interaction, Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, March 02-03, 2006, Salt Lake City, Utah, USA [doi>10.1145/1121241.1121249]
• 11: Trouvain, B. and Wolf, H.. Evaluation of multi-robot control and monitoring performance. In Proceedings of the 2002 IEEE Int. Workshop on Robot and Human Interactive Communication, pages 111--116, September 2002.
• 12: Jijun Wang , Michael Lewis, Human control for cooperating robot teams, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228719]
• 13: Wang, J. and Lewis, M. Assessing coordination overhead in control of robot teams, Proceedings of the 2007 International Conference on Systems, Man, and Cybernetics, 2007b, in press.

INDEX TERMS

Primary Classification:
  J. Computer Applications
  J.7 COMPUTERS IN OTHER SYSTEMS

Additional Classification:
  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES

General Terms:
Experimentation, Human Factors, Measurement

Keywords:
evaluation, human-robot interaction, metrics, multi-robot system