Revealing gauguin: engaging visitors in robot guide's explanation in an art museum

ABSTRACT

Designing technologies that support the explanation of museum exhibits is a challenging domain. In this paper we develop an innovative approach - providing a robot guide with resources to engage visitors in an interaction about an art exhibit. We draw upon ethnographical fieldwork in an art museum, focusing on how tour guides interrelate talk and visual conduct, specifically how they ask questions of different kinds to engage and involve visitors in lengthy explanations of an exhibit. From this analysis we have developed a robot guide that can coordinate its utterances and body movement to monitor the responses of visitors to these. Detailed analysis of the interaction between the robot and visitors in an art museum suggests that such simple devices derived from the study of human interaction might be useful in engaging visitors in explanations of complex artifacts.

REFERENCES

• 1: Bennewitz, M., Faber, F., Joho, D., Schreiber, M. and Behnke, S. Towards a humanoid museum guide robot that interacts with multiple persons. In Proc. HUMANOIDS 2005, (2005), pp.418--423.
• 2: Goodwin, C. Action and embodiment within situated human interaction. Journal of Pragmatics, 32, (2000), 1489--1522.
• 3: Heath, C. and vom Lehn, D. Configuring reception: (Dis-) regarding the 'Spectator' in museums and galleries. Theory, Culture&Society, 21(6), (2004), 43--65.
• 4: Michael Isard , Andrew Blake, C$ONDENSATION$—Conditional Density Propagation forVisual Tracking, International Journal of Computer Vision, v.29 n.1, p.5-28, Aug. 1998 [doi>10.1023/A:1008078328650]
• 5: Kendon, A. Gesture: Visible action as utterance, Cambridge University Press, (2004).
• 6: Yoshinori Kuno , Kazuhisa Sadazuka , Michie Kawashima , Keiichi Yamazaki , Akiko Yamazaki , Hideaki Kuzuoka, Museum guide robot based on sociological interaction analysis, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240804]
• 7: Hideaki Kuzuoka , Karola Pitsch , Yuya Suzuki , Ikkaku Kawaguchi , Keiichi Yamazaki , Akiko Yamazaki , Yoshinori Kuno , Paul Luff , Christian Heath, Effect of restarts and pauses on achieving a state of mutual orientation between a human and a robot, Proceedings of the ACM 2008 conference on Computer supported cooperative work, November 08-12, 2008, San Diego, CA, USA [doi>10.1145/1460563.1460594]
• 8: Lerner, G.H. Selecting next speaker: the context-sensitive operation of a context-free organization. Language in Society, 32(2), (2003), 177--201.
• 9: Matsumoto, Y., Kato, T. and Wada, T. An occlusion robust likelihood integration method for multi-camera people head tracking. In Proc. INSS 2007, (2007), 235--242.
• 10: Mutlu, B., Hodgins, J.K. and Forlizzi, J. A storytelling robot: modeling and evaluation of human-like gaze behavior. In Proc. HUMANOIDS 2006, (2006), 518--523.
• 11: Tatsuya Nomura_aff1n2 , Takugo Tasaki , Takayuki Kanda , Masahiro Shiomi , Hiroshi Ishiguro , Norihiro Hagita, Questionnaire-based social research on opinions of Japanese visitors for communication robots at an exhibition, AI & Society, v.21 n.1, p.167-183, November 2006 [doi>10.1007/s00146-006-0053-6]
• 12: Sacks, H., Schegloff, E. and Jefferson, G. A simplest systematics for the organization of turn-taking in conversation. Language, 50(4), (1974), 696--735.
• 13: Masahiro Shiomi , Takayuki Kanda , Satoshi Koizumi , Hiroshi Ishiguro , Norihiro Hagita, Group attention control for communication robots with wizard of OZ approach, Proceedings of the ACM/IEEE international conference on Human-robot interaction, March 10-12, 2007, Arlington, Virginia, USA [doi>10.1145/1228716.1228733]
• 14: Candace L. Sidner , Christopher Lee , Cory D. Kidd , Neal Lesh , Charles Rich, Explorations in engagement for humans and robots, Artificial Intelligence, v.166 n.1-2, p.140-164, August 2005 [doi>10.1016/j.artint.2005.03.005]
• 15: Thrun, S., Bennewitz, M., Burgard, W., Cremers, A.B., Dellaert, F., Fox, D., Hhnel, D., Lakemeyer, G., Rosenberg, C., Roy, N., Schulte, J., Schulz, D. and Steiner, W. Experiences with two deployed interactive tour-guide robots. In Proc. FSR 1999, (1999).
• 16: Viola, P. and Jones, M. Rapid object detection using a boosted cascade of simple features. In Proc. CVPR 2001, 1, (2001), 511--518.
• 17: Akiko Yamazaki , Keiichi Yamazaki , Yoshinori Kuno , Matthew Burdelski , Michie Kawashima , Hideaki Kuzuoka, Precision timing in human-robot interaction: coordination of head movement and utterance, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357077]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation); User-centered design

General Terms:
Design, Human Factors

Keywords:
computer vision, conversation analysis, guide robot, human-robot interaction, interaction analysis, museum