Two-way eye contact between humans and robots

ABSTRACT

Eye contact is an effective means of controlling human communication, such as in starting communication. It seems that we can make eye contact if we simply look at each other. However, this alone does not establish eye contact. Both parties also need to be aware of being watched by the other. We propose a method of two-way eye contact for human-robot communication. When a human wants to start communication with a robot, he/she watches the robot. If it finds a human looking at it, the robot turns to him/her, changing its facial expressions to let him/her know its awareness of his/her gaze. When the robot wants to initiate communication with a particular person, it moves its body and face toward him/her and changes its facial expressions to make the person notice its gaze. We show several experimental results to prove the effectiveness of this method. Moreover, we present a robot that can recognize hand gestures after making eye contact with the human to show the usefulness of eye contact as a means of controlling communication.

REFERENCES

• 1: Argyle, M., and Ingham, R. Mutual gaze and proximity. Semiotica 6 (1972), 32--49.
• 2: Brooks, R.A., Breazeal, C., Marjanovic, M., Scassellati, B., and Williamson, M.M. The cog project: Building a humanoid robot. Nehaniv, C. (ed.), Computation for Metaphors, Analogy and Agents, Lecture Notes in Artificial Intelligence, vol.1562, Springer-Verlag (1998), 52--87.
• 3: Cranach, M. The role of orienting behavior in human interaction. Esser, A.H. (ed.), Behavior and Environment, Plenum Press (1971), 217--237.
• 4: Fukui, K. and Yamaguchi, O. Facial feature point extraction method based on combination of shape extraction and pattern matching. Systems and Computers in Japan 29, 6 (1998), 49--58.
• 5: Hansen, J.P., Anderson, A.W., and Roed, P. Eye-gaze control of multimedia systems. Anzai,Y., Ogawa, K., and Mori, H. (eds.), Symbiosis of Human and Artifact, vol.20A, Elsevier Science (1995), 37--42.
• 6: Hasegawa, O., Sakaue, K., Itou, K., Kurita, T., Hayamizu, S., Tanaka, K., and Otsu, N. Agent oriented multimodal image learning system. Proc. IJCAI-WS IMS 1997, 29--34.
• 7: Robert J. K. Jacob, The use of eye movements in human-computer interaction techniques: what you look at is what you get, ACM Transactions on Information Systems (TOIS), v.9 n.2, p.152-169, April 1991 [doi>10.1145/123078.128728]
• 8: Kanda, T., Ishiguro, H., Ono, T., Imai, M., and Nakatsu, R. Development and evaluation of an interactive humanoid robot "Robovie". Proc. IEEE ICRA 2002, 1848--1855.
• 9: Kendon, A. Some functions of gaze direction in social interaction. Acta Psychologica (1967), vol.26, 22--63.
• 10: Matsusaka, Y., Kubota, S., Tojo, T., Furukawa, K., and Kobayashi, T. Multi-person conversation robot using multi-modal interface. Proc. SCI/ISAS 1999, vol.7, 450--455.
• 11: Dai Miyauchi , Arihiro Sakurai , Akio Nakamura , Yoshinori Kuno, Active eye contact for human-robot communication, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.985998]
• 12: Nishimura, T., Mukai, T., and Oka, R. Spotting recognition of gestures performed by people from a single time-varying image. Proc. IEEE/RSJ IROS 1997, vol.2, 967--972.
• 13: Ohno, T. and Mukawa, N. Gaze-based interaction for anyone, anytime. Proc. HCI International 2003, vol.4, 1452--1456.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Experimentation, Human Factors

Keywords:
embodied agent, eye contact, gaze, gesture recognition, human-robot interface, nonverbal behavior