Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Human Operators (HO) of telerobotics systems may be able to achieve complex operations with robots. Designing usable and effective Human-Robot Interaction (HRI) is very challenging for system developers and human factors specialists. The search for new metaphors and techniques for HRI adapted to telerobotics systems emerge on the conception of Multimodal HRI (MHRI). MHRI allows to interact naturally and easily with robots due to combination of many devices and an efficient Multimodal Management System (MMS). A system like this should bring a new user's experience in terms of natural interaction, usability, efficiency and flexibility to HRI system. So, a good management of multimodality is very. Moreover, the MMS must be transparent to user in order to be efficient and natural.

Empirical evaluation is necessary to have an idea about the goodness of our MMS. We will use an Empirical Evaluation Assistant (EEA) designed in the IBISC laboratory. EEA permits to rapidly gather significant feedbacks about the usability of interaction during the development lifecycle. However the HRI would be classically evaluated by ergonomics experts at the end of its development lifecycle.

Results from a preliminary evaluation on a robot teleoperation tasks using the ARITI software framework for assisting the user in piloting the robot, and the IBISC semi-immersive VR/AR platform EVR@, are given. They compare the use of a Flystick and Data Gloves for the 3D interaction with the robot. They show that our MMS is functional although multimodality used in our experiments is not sufficient to provide an efficient Human-Robot Interaction. The EVR@ SPIDAR force feedback will be integrated in our MMS to improve the user's efficiency.

REFERENCES

• 1: Hasegawa T., Suehiro T., Ogasawara T., Matsui T., Kitagaki K., and Takase K., 1991. Model-based telerobot system manipulation skill. In '91 International Symposiumon Advanced Robot Technology, pp 499--506.
• 2: Espiau B., 1986. Technical report : Téléopération avancée: Le projet de téléopération avancée, Saclay, France. 3, 4, 5 December 1986.
• 3: Otmane, S., Mallem M., Kheddar A. and Chavand F., 2000. ARITI: an augmented reality interface for teleoperation on the Internet. In Advanced Simulation Technologies Conference (ASTC2000), Washington D.C., USA, pp 254--261.
• 4: Nassima Ouramdane , Samir Otmane , Frédéric Davesne , Malik Mallem, FOLLOW-ME: a new 3D interaction technique based on virtual guides and granularity of interaction, Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications, June 14-April 17, 2006, Hong Kong, China [doi>10.1145/1128923.1128945]
• 5: Sylvia Irawati , Daniela Calderón , Heedong Ko, Spatial ontology for semantic integration in 3D multimodal interaction framework, Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications, June 14-April 17, 2006, Hong Kong, China [doi>10.1145/1128923.1128944]
• 6: Ed Kaiser , Alex Olwal , David McGee , Hrvoje Benko , Andrea Corradini , Xiaoguang Li , Phil Cohen , Steven Feiner, Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada [doi>10.1145/958432.958438]
• 7: Sato M., 2002. Development of String-based Force Display: SPIDAR. In 8th International Conference on Virtual Systems and Multimedia, Precision and Intelligence Laboratory, Tokyo Institute of Technology, 4259 Nagatsuta, Midori-ku, Yokohama, 226--8503, Japan.
• 8: Doug A. Bowman , Ernst Kruijff , Joseph J. LaViola , Ivan Poupyrev, 3D User Interfaces: Theory and Practice, Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, 2004
• 9: Ioannis Karaseitanidis , Angelos Amditis , Harshada Patel , Sarah Sharples , Evangelos Bekiaris , Alex Bullinger , Jolanda Tromp, Evaluation of virtual reality products and applications from individual, organizational and societal perspectives-The "VIEW" case study, International Journal of Human-Computer Studies, v.64 n.3, p.251-266, March 2006 [doi>10.1016/j.ijhcs.2005.08.013]
• 10: Joseph L. Gabbard , Deborah Hix , J. Edward Swan, User-Centered Design and Evaluation of Virtual Environments, IEEE Computer Graphics and Applications, v.19 n.6, p.51-59, November 1999 [doi>10.1109/38.799740]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.9 Robotics
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques

General Terms:
Design, Experimentation, Human Factors

Keywords:
empirical evaluation, human-robot interaction, multimodal interaction, usability, virtual environment