The GAZE groupware system: mediating joint attention in multiparty communication and collaboration

ABSTRACT

In this paper, we discuss why, in designing multiparty mediated systems, we should focus first on providing non-verbal cues which are less redundantly coded in speech than those normally conveyed by video. We show how conveying one such cue, gaze direction, may solve two problems in multiparty mediated communication and collaboration: knowing who is talking to whom, and who is talking about what. As a candidate solution, we present the GAZE Groupware System, which combines support for gaze awareness in multiparty mediated communication and collaboration with small and linear bandwidth requirements. The system uses an advanced, desk- mounted eyetracker to metaphorically convey gaze awareness in a 3D virtual meeting room and within shared documents.

REFERENCES

• 1: Acker, S. and Levitt, S. Designing videoconference facilities for improved eye contact. Journal of Broadcasting & Electronic Media 31 (2), 1987.
• 2: Argyle, M. The Psychology of Interpersonal Behaviour. London: Penguin Books, 1967.
• 3: Argyle, M. and Cook, M. Gaze and Mutual Gaze. London: Cambridge University Press, 1976.
• 4: Argyle, M. and Graham, J. The Central Europe Experiment - looking at persons and looking at things. Journal of Environmental Psychology and Nonverbal Behaviour 1, 1977, pp. 6-16.
• 5: Steve Benford , John Bowers , Lennart E. Fahlén , Chris Greenhalgh , Dave Snowdon, User embodiment in collaborative virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.242-249, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223935]
• 6: Herbert L. Colston , Diane J. Schiano, Looking and lingering as conversational cues in video-mediated communication, Conference companion on Human factors in computing systems, p.278-279, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223673]
• 7: Dennett, D. Conciousness Explained. London: Penguin, 1991.
• 8: Descartes, R. Discours de la mdthode. Leiden: Jean Maire, 1637.
• 9: Duncan, S. Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology 23, 1972.
• 10: Hans Eriksson, MBONE: the multicast backbone, Communications of the ACM, v.37 n.8, p.54-60, Aug. 1994 [doi>10.1145/179606.179627]
• 11: Steve Harrison , Paul Dourish, Re-place-ing space: the roles of place and space in collaborative systems, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.67-76, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240193]
• 12: Christian Heath , Paul Luff, Disembodied conduct: communication through video in a multi-media office environment, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.99-103, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108859]
• 13: Ellen A. Isaacs , John C. Tang, What video can and can't do for collaboration: a case study, Proceedings of the first ACM international conference on Multimedia, p.199-206, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.166289]
• 14: Hiroshi Ishii , Minoru Kobayashi, ClearBoard: a seamless medium for shared drawing and conversation with eye contact, Proceedings of the SIGCHI conference on Human factors in computing systems, p.525-532, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142977]
• 15: Kendon, A. Some Function of Gaze Direction in Social interaction. Acta Psychologica 32, 1967, pp. 1-25.
• 16: LC Technologies. The Eyegaze Communication System. Fairfax, VA, 1997. http://www.lctinc.com
• 17: Hideyuki Nakanishi , Chikara Yoshida , Toshikazu Nishimura , Toru Ishida, FreeWalk: supporting casual meetings in a network, Proceedings of the 1996 ACM conference on Computer supported cooperative work, p.308-314, November 16-20, 1996, Boston, Massachusetts, United States [doi>10.1145/240080.240314]
• 18: Nicholas Negroponte, Being digital, Random House Inc., New York, NY, 1996
• 19: O'Connaill, B., Whittaker, S., and Wilbur, S. Conversations Over Video Conferences: An Evaluation of the Spoken Aspects of Video-Mediated Communication. Human Computer Interaction 8, 1993, pp. 389-428.
• 20: Ken-Ichi Okada , Fumihiko Maeda , Yusuke Ichikawaa , Yutaka Matsushita, Multiparty videoconferencing at virtual social distance: MAJIC design, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.385-393, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.193054]
• 21: Arne Raeithel , Boris M. Velichkovsky, Joint attention and co-construction: new ways to foster user-designer collaboration, Context and consciousness: activity theory and human-computer interaction, Massachusetts Institute of Technology, Cambridge, MA, 1995
• 22: Abigail J. Sellen, Speech patterns in video-mediated conversations, Proceedings of the SIGCHI conference on Human factors in computing systems, p.49-59, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142756]
• 23: Sellen, A.J. Remote conversations: the effects of mediating talk with technology. Human Computer Interaction 10(4), 1995.
• 24: Short, J., Williams, E., and Christie, B. The Social Psychology of Telecommunications. London: Wiley, 1976.
• 25: Silicon Graphics, Sony and ISO. The Virtual Reality Modeling Language- Part 1: Functional specification and UTF-8 encoding. ISO/IEC 14772-1:1998, 1998. http ://www. iso. c h/
• 26: Sony. Sony Community Place, 1997. http ://vs.spiw. com/vs/
• 27: Velichkovsky, B.M. Communicating attention: Gaze position transfer in cooperative problem solving. Pragmatics and Cognition, 3(2), 1995, pp. 199-222.
• 28: Boris Velichkovsky , Andreas Sprenger , Pieter Unema, Towards gaze-mediated interaction: Collecting solutions of the "Midas touch problem", Proceedings of the IFIP TC13 Interantional Conference on Human-Computer Interaction, p.509-516, July 14-18, 1997
• 29: Roel Vertegaal, Conversational awareness in multiparty VMC, CHI '97 extended abstracts on Human factors in computing systems: looking to the future, March 22-27, 1997, Atlanta, Georgia [doi>10.1145/1120212.1120217]
• 30: Roel Vertegaal , Boris Velichkovsky , Gerrit van der Veer, Catching the eye: management of joint attention in cooperative work, ACM SIGCHI Bulletin, v.29 n.4, p.87-92, Oct. 1997 [doi>10.1145/270950.270998]
• 31: Vertegaal, R. Look Who's Talking to Whom. PhD Thesis. Cognitive Ergonomics Department, Twente University, The Netherlands, 1998. ISBN 90 3651 1747.
• 32: Vertegaal, R. GAZE: Visual-Spatial Attention in Communication. Video Paper. In Proceedings of CSCW'98. Seattle, WA: ACM, 1998.
• 33: Roel Vertegaal , Harro Vons , Robert Slagter, Look who's talking: the GAZE groupware system, CHI 98 conference summary on Human factors in computing systems, p.293-294, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286772]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.3 Group and Organization Interfaces
          Subjects: Collaborative computing

General Terms:
Design, Experimentation, Human Factors, Theory

Keywords:
CSCW, VRML 2, attention, awareness, eyetracking, gaze direction, multiparty videoconferencing