Mobile display-based manipulation: an intuitive and interactive technique for manipulating simple robots

ABSTRACT

In this paper, we propose the Mobile Display-based Manipulation (MDM) technique for manipulating simple robots such as automated cleaning robots. By capturing images of robots with a camera-attached mobile display and moving it in a three-dimensional space, a user can easily and intuitively manipulate the robots. To verify the validity and effects of the MDM technique, we developed two prototype systems using a handheld display and a projection display. Issues to be investigated and lessons learned through the design and evaluations of the systems are discussed.

REFERENCES

• 1: Hagita, N. Future Perspective of Network Robots, Journal of Robotic Society of Japan, 23, 6, pp. 642--643 (2005, in Japanese).
• 2: Kazuhiro Hosoi , Vinh Ninh Dao , Akihiro Mori , Masanori Sugimoto, VisiCon: a robot control interface for visualizing manipulation using a handheld projector, Proceedings of the international conference on Advances in computer entertainment technology, June 13-15, 2007, Salzburg, Austria [doi>10.1145/1255047.1255068]
• 3: Hosoi, K. and Sugimoto, M.:Shepherd: A Mobile Interface for Robot Control from a User's Viewpoint, In Proc. of IEEE ROBIO2006, Kunming, China, pp. 908--913 (2006).
• 4: LaValle, S. M. and Kuffner, J. J. Randomized Kinodynamic Planning, In Proc. of IEEE ICRA'99, Detroit, MI, pp. 473--479 (1999).
• 5: Kim, B. et al. Ubiquitous Function Services Based Control for Robots with Ambient Intelligence, In Proc. of IEEE IECON2006, France, pp. 4546--4551 (2006).

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Human Factors

Keywords:
handheld display, human-robot interaction, intuitive robot manipulation, mobile computing, mobile display-based manipulation (MDM), projection display