Multi-touch interface for controlling multiple mobile robots

ABSTRACT

We must give some form of a command to robots in order to have the robots do a complex task. An initial instruction is required even if they do their tasks autonomously. We therefore need interfaces for the operation and teaching of robots. Natural languages, joysticks, and other pointing devices are currently used for this purpose. These interfaces, however, have difficulty in operating multiple robots simultaneously. We developed a multi-touch interface with a top-down view from a ceiling camera for controlling multiple mobile robots. The user specifies a vector field followed by all robots on the view. This paper describes the user interface and its implementation, and future work of the project.

REFERENCES

• 1: Rogalla, O., Ehrenmann, M., Zollner, R., Becher, R., and Dillmann, R. Using Gesture and Speech Control for Command a Robot Assistant. In Proc. IEEE International Workshop on Robot and Human Interactive Communication, IEEE Press (2002), 454--459.
• 2: Fong, T., Thorpe, C., and Glass B. PdaDriver: A Handheld System for Remote Driving. In Proc. IEEE International Concefence on Advanced Robotics, 2003.
• 3: Young Sang Choi , Cressel D. Anderson , Jonathan D. Glass , Charles C. Kemp, Laser pointers and a touch screen: intuitive interfaces for autonomous mobile manipulation for the motor impaired, Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, October 13-15, 2008, Halifax, Nova Scotia, Canada [doi>10.1145/1414471.1414512]
• 4: Pham, D.T., Awadalla, M.H., and Eldukhri, E.E. Adaptive and cooperative mobile robots. In Proc. IMechE, 221 (3), 279--293, 2007.
• 5: Fong, T., Thorpe, C., and Baur C. Multi-Robot Remote Driving With Collaborative Control. In IEEE Trans. on Industrial Electronics, 50(4), 699--704, August 2003.
• 6: Driewer, F., Sauer, M., and Schilling, K. Discussion of Challenges for User Interfaces in Human-Robot Teams. In Proc. European Conference on Mobile Robots, 2007.
• 7: Jefferson Y. Han, Low-cost multi-touch sensing through frustrated total internal reflection, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095054]
• 8: Borenstein, J., and Koren Y. Real-Time Obstacle Avoidance for Fast Mobile Robots. In IEEE Trans. on Systems, Man and Cybernetics, 19(5), 1179--1187, October 1989.
• 9: Fukuchi, K., Rekimoto, J. Marble Market: Bimanual Interactive Game with a Body Shape Sensor. In Proc. ICEC 2007, Springer (2007), 374--380.
• 10: Marjorie Skubic , Derek Anderson , Samuel Blisard , Dennis Perzanowski , Alan Schultz, Using a hand-drawn sketch to control a team of robots, Autonomous Robots, v.22 n.4, p.399-410, May 2007 [doi>10.1007/s10514-007-9023-1]
• 11: Craig W. Reynolds, Flocks, herds and schools: A distributed behavioral model, ACM SIGGRAPH Computer Graphics, v.21 n.4, p.25-34, July 1987

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.9 Robotics
          Subjects: Commercial robots and applications

General Terms:
Design

Keywords:
entertainment robot, home robot, human robot interaction, multi-touch interface, multiple-robot operation