Where to look: a study of human-robot engagement

ABSTRACT

This paper reports on a study of human subjects with a robot designed to mimic human conversational gaze behavior in collaborative conversation. The robot and the human subject together performed a demonstration of an invention created at our laboratory; the demonstration lasted 3 to 3.5 minutes. We briefly discuss the robot architecture and then focus the paper on a study of the effects of the robot operating in two different conditions. We offer some conclusions based on the study about the importance of engagement for 3D IUIs. We will present video clips of the subject interactions with the robot at the conference.

REFERENCES

• 1: Beardsley, P.A. Piecode Detection. Mitsubishi Electric Research Labs TR2003-11, Cambridge, MA, February, 2003.
• 2: Cynthia Breazeal, Affective Interaction between Humans and Robots, Proceedings of the 6th European Conference on Advances in Artificial Life, p.582-591, September 10-14, 2001
• 3: A. Bruce, I. Nourbakhsh, R. Simmons. The Role of Expressiveness and Attention in Human Robot Interaction. In Proceedings of the IEEE International Conference on Robotics and Automation, Washington DC, May 2002.
• 4: Wolfram Burgard , Armin B. Cremers , Dieter Fox , Dirk Hähnel , Gerhard Lakemeyer , Dirk Schulz , Walter Steiner , Sebastian Thrun, The interactive museum tour-guide robot, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.11-18, July 1998, Madison, Wisconsin, United States
• 5: Cassell, J., Sullivan, J., Prevost, S. and Churchill, E. Embodied Conversational Agents. MIT Press, Cambridge, MA, 2000.
• 6: Fong, T., Thorpe, C., and Baur, C. Collaboration, Dialogue and Human-Robot Interaction. In 10th International Symposium of Robotics Research, Lorne, Victoria, Australia, November, 2001.
• 7: Johnson, W.L., Rickel, J.F. and Lester, J.C. Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments. International Journal of Artificial Intelligence in Education, 11: 47--78, 2000.
• 8: Kanda, T., Ishiguro, H., Imai, M., Ono, T., and Mase, K. A constructive approach for developing interactive humanoid robots. In Proceedings of IROS 2002, IEEE Press, NY, 2002.
• 9: Kidd, C. Sociable Robots, The Role of Presence and Task in Human-Robot Interaction. M.S. thesis, MIT Media Laboratory, June 2003.
• 10: Lombard, M. and Ditton, T.B. At the heart of it all: the concept of presence. Journal of Computer-Mediated Communication, 3(2). University of S. Ca Annenberg School of Communiation, 1997.
• 11: Lombard, M., Ditton, T.B., Crane, D., Davis, B., Gil-Egul, G. Horvath, K. and Rossman, J. Measuring presence: a literature-based approach to the development of a standardized paper and pencil instrument. In Presence 2000: The Third International Workshop on Presence, Delft, The Netherlands, 2000.
• 12: Morency, L.-P.; Rahimi, A.; Darrell, T.; Adaptive view-based appearance models. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1:8--20, June, 2003.
• 13: Yukiko I. Nakano , Gabe Reinstein , Tom Stocky , Justine Cassell, Towards a model of face-to-face grounding, Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, p.553-561, July 07-12, 2003, Sapporo, Japan [doi>10.3115/1075096.1075166]
• 14: Reeves, B. Wise, K,., Maldonado, H., Kogure, K., Sinozawa, K. and Naya, F., Robots Versus On-Screen Agents: Effects on Social and Emotional Responses. In Proceedings of CHI 2003, ACM press, 2003.
• 15: Charles Rich , Candace L. Sidner, COLLAGEN: A Collaboration Manager for Software Interface Agents, User Modeling and User-Adapted Interaction, v.8 n.3-4, p.315-350, 1998 [doi>10.1023/A:1008204020038]
• 16: Charles Rich , Candace L. Sidner , Neal Lesh, Collagen: applying collaborative discourse theory to human-computer interaction, AI Magazine, v.22 n.4, p.15-25, Winter 2001
• 17: Human - Robot Interaction: Engagement between Humans and Robots for Hosting Activities, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.123, October 14-16, 2002 [doi>10.1109/ICMI.2002.1166980]
• 18: Sidner, C.L. and Lee, C. An Architecture for Engagement in Collaborative Conversations between a Robot and Humans. MERL Technical Report, TR2003-12, June 2003.
• 19: Sidner, C.L., Lee, C. and Lesh, N. Engagement when looking: behaviors for robots when collaborating with people. In Diabruck: Proceedings of the 7th workshop on the Semantic and Pragmatics of Dialogue, I. Kruiff-Korbayova and C.Kosny (eds.), University of Saarland, pp. 123--130, 2003.
• 20: Viola, P. and Jones, M. Rapid Object Detection Using a Boosted Cascade of Simple Features. In the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Hawaii, pp. 905--910, 2001.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
collaborative conversation, engagement, human-robot interaction, intelligent user interfaces