Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

During conversations, speakers establish their and others' participant roles (who participates in the conversation and in what capacity)--or "footing" as termed by Goffman-using gaze cues. In this paper, we study how a robot can establish the participant roles of its conversational partners using these cues. We designed a set of gaze behaviors for Robovie to signal three kinds of participant roles: addressee, bystander, and overhearer. We evaluated our design in a controlled laboratory experiment with 72 subjects in 36 trials. In three conditions, the robot signaled to two subjects, only by means of gaze, the roles of (1) two addressees, (2) an addressee and a bystander, or (3) an addressee and an overhearer. Behavioral measures showed that subjects' participation behavior conformed to the roles that the robot communicated to them. In subjective evaluations, significant differences were observed in feelings of groupness between addressees and others and liking between overhearers and others. Participation in the conversation did not affect task performance-measured by recall of information presented by the robot-but affected subjects' ratings of how much they attended to the task.

REFERENCES

• 1: Argyle, M. and Dean, J. Eye-contact, distance and affiliation. Sociometry, 28 (3), 289--304, 1965
• 2: Argyle, M. and Ingham, R. Gaze, mutual gaze and proximity. Semiotica, 6, 32--49, 1972.
• 3: Bailenson, J. N. et al. Transformed social interaction, augmented gaze, and social influence in immersive virtual environments. Human Communication Research, 31 (4), 511--537, 2005.
• 4: Bales, R. F. et al. Channels of communication in small groups. American Sociological Review, 16 (4), 461--68, 1951.
• 5: Bales, R. F. Personality and Interpersonal Behavior. Holt, Rinehart, and Winston, 1970.
• 6: Beattie, G. The role of language production processes in the organization of behavior in face-to-face interaction. In B. Butterworth (Ed.) Language Production, 1, 69--107, 1980.
• 7: Bennewitz, M. et al. Towards a humanoid museum guide robot that interacts with multiple persons. In Proc. HUMANOIDS'05, 2005.
• 8: Justine Cassell , Catherine Pelachaud , Norman Badler , Mark Steedman , Brett Achorn , Tripp Becket , Brett Douville , Scott Prevost , Matthew Stone, Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.413-420, July 1994 [doi>10.1145/192161.192272]
• 9: J. Cassell , T. Bickmore , M. Billinghurst , L. Campbell , K. Chang , H. Vilhjálmsson , H. Yan, Embodiment in conversational interfaces: Rea, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.520-527, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303150]
• 10: Clark, H. H. and Carlson, T. B. Hearers and Speech Acts. Language, 58 (2), 332--373, 1982.
• 11: Clark, H. H. Using Language. Cambridge University Press, 1996.
• 12: Dictionary.com. Unabridged (v 1.1). Retrieved July 21, 2008, from http://dictionary.reference.com/browse/footing, 2008.
• 13: Duncan, S. Some signals and rules for taking speaking turns in conversations. In Nonverbal Communication: Readings with Commentary, Oxford University Press, 1974
• 14: Efran, J. S. Looking for approval: effects on visual behavior of approbation from persons differing in importance. J. Personality and Social Psychology, 10 (1), 21--25, 1968.
• 15: Vanessa Evers , Heidy C. Maldonado , Talia L. Brodecki , Pamela J. Hinds, Relational vs. group self-construal: untangling the role of national culture in HRI, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349856]
• 16: Exline, R. V. Explorations in the process of person perception: visual interaction in relation to competition, sex and need for affiliation. Journal of Personality, 31, 1--20, 1963.
• 17: Goffman, E. On face-work. Psychiatry, 18 (3), 213--231, 1955.
• 18: Goffman, E. Behavior in Public Places. The Free Press, 1963.
• 19: Goffman, E. Footing. Semiotica, 25 (1/2), 1--29, 1979.
• 20: Levinson, S. C. Putting linguistics on a proper footing: Explorations in Goffman's concepts of participation. In P. Drew and A. Wootton (Eds.) Erving Goffman: Exploring the Interaction Order, 161--227. Polity, 1982.
• 21: Maia Garau , Mel Slater , Simon Bee , Martina Angela Sasse, The impact of eye gaze on communication using humanoid avatars, Proceedings of the SIGCHI conference on Human factors in computing systems, p.309-316, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365121]
• 22: Colburn, A. et al. The role of eye gaze in avatar mediated conversational interfaces. Microsoft Research Report, 81, 2000.
• 23: Goodwin, C. Restarts, pauses, and the achievement of mutual gaze at turn-beginning. Sociological Inquiry, 50, 272--302, 1980.
• 24: Goodwin, C. Conversational Organization: Interaction between Speakers and Hearers. Academic Press, 1981.
• 25: Hanks, W. Language and Communicative Practices. Westview, 1996.
• 26: Heylen, D. et al. Controlling the Gaze of Conversational Agents. In J. van Kuppevelt, L. et al (Eds.), Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems. Kluwer, 2005.
• 27: Hymes, D. Models of the Interaction of Language and Social Life. In J. J. Gumperz and D. Hymes (Eds.), Directions in Sociolinguistics: The Ethnography of Comm., 35--77. Holt, Rinehalt & Winston, 1972.
• 28: Imai, M. et al. Robot mediated round table: Analysis of the effect of robot's gaze. In Proc. ROMAN'02, 411--416, 2002
• 29: Kanda, T. et al. Body Movement Analysis of Human-Robot Interaction. In Proc. IJCAI'03, 177--182, 2003.
• 30: Kendon, A. Some functions of gaze-direction in social interaction. Acta Psychol (Amst), 26 (1), 22--63, 1967.
• 31: Yoshinori Kuno , Kazuhisa Sadazuka , Michie Kawashima , Keiichi Yamazaki , Akiko Yamazaki , Hideaki Kuzuoka, Museum guide robot based on sociological interaction analysis, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240804]
• 32: Libby, W. L. Eye contact and direction of looking as stable individual differences. J. Exp. Research in Personality, 4, 303--312, 1970.
• 33: Matsusaka, Y. et al. Modeling of Conversational Strategy for the Robot Participating in the Group Conversation. In Proc. EUROSPEECH'01, 2001.
• 34: Mutlu, B. et al. A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior. In Proc. of HUMANOIDS'06, 2006.
• 35: Nielsen, G. Studies in Self-Confrontation. Monksgaard, 1962.
• 36: Matthias Rehm , Elisabeth André, Where do they look?: Gaze behaviors of multiple users interacting with an embodied conversational agent, Lecture Notes in Computer Science, Springer-Verlag, London, 2005 [doi>10.1007/11550617_21]
• 37: Sacks, H. et al. A simplest systematics for the organization of turn-taking for conversation. Language, 50 (4), 696--735, 1974.
• 38: Schegloff, E. A. Sequencing in Conversational Openings. American Anthropologist, 70 (6), 1075--1095, 1968.
• 39: Schegloff, E. A. Overlapping talk and the organization of turn-taking for conversation. Language in Society, 29 (1), 1--63, 2000.
• 40: Candace L. Sidner , Cory D. Kidd , Christopher Lee , Neal Lesh, Where to look: a study of human-robot engagement, Proceedings of the 9th international conference on Intelligent user interfaces, January 13-16, 2004, Funchal, Madeira, Portugal [doi>10.1145/964442.964458]
• 41: J. Gregory Trafton , Magda D. Bugajska , Benjamin R. Fransen , Raj M. Ratwani, Integrating vision and audition within a cognitive architecture to track conversations, Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction, March 12-15, 2008, Amsterdam, The Netherlands [doi>10.1145/1349822.1349849]
• 42: Vertegaal, R., et al. Effects of Gaze on Multiparty Mediated Communication. In Proc. Graphics Interface'00, 92--102, 2000.
• 43: Roel Vertegaal , Robert Slagter , Gerrit van der Veer , Anton Nijholt, Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes, Proceedings of the SIGCHI conference on Human factors in computing systems, p.301-308, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365119]
• 44: Weisbrod, R. M. Looking behavior in a discussion group. Unpublished paper, Department of Psychology, Cornell University, 1965.
• 45: Wilkes-Gibbs, D. and Clark, H. H. Coordinating beliefs in conversation. J. Memory and Language, 31 (2), 183--194, 1992.
• 46: Akiko Yamazaki , Keiichi Yamazaki , Yoshinori Kuno , Matthew Burdelski , Michie Kawashima , Hideaki Kuzuoka, Precision timing in human-robot interaction: coordination of head movement and utterance, Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, April 05-10, 2008, Florence, Italy [doi>10.1145/1357054.1357077]
• 47: Yoshikawa, Y. et al. Responsive robot gaze to interaction partner. In Proc. Robotics: Science and Systems, 2006.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: User-centered design; Evaluation/methodology

General Terms:
Design, Human Factors

Keywords:
conversational participation, footing, gaze, participant roles, participation structure, robovie