Leveraging the asymmetric sensitivity of eye contact for videoconference

ABSTRACT

Eye contact is a natural and often essential element in the language of visual communication. Unfortunately, perceiving eye contact is difficult in most video-conferencing systems and hence limits their effectiveness. We conducted experiments to determine how accurately people perceive eye contact. We discovered that the sensitivity to eye contact is asymmetric, in that we are an order of magnitude less sensitive to eye contact when people look below our eyes than when they look to the left, right, or above our eyes. Additional experiments support a theory that people are prone to perceive eye contact, that is, we will think that someone is making eye contact with us unless we are certain that the person is not looking into our eyes. These experimental results suggest parameters for the design of videoconferencing systems. As a demonstration, we were able to construct from commodity components a simple dyadic videoconferencing prototype that supports eye contact

REFERENCES

• 1: S. Anstis, J. Mayhew, and T. Morley. The Perception of where a Face or Television 'Portrait' is Looking. American Journal of Psychology, pages 474--489, 1969.
• 2: M. Argyle and M. Cook. Gaze and Mutual Gaze. Cambridge University Press, 1976.
• 3: W. Buxton, A. Sellen, and M. Sheasby. Interfaces for Multiparty Videoconferences. Video-Mediated Communication (edited by K. Finn, A. Sellen, and S. Wilbur), Lawrence Erlbaum Associates, pages 385--400, 1997.
• 4: Milton Chen, Design of a virtual auditorium, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500147]
• 5: M. Cline. The Perception of Where a Person is Looking. American Journal of Psychology, pages 41--50, 1967.
• 6: J. Ellgring. Die Beurteilung des Blickes auf Punkte innerhalb des Gesichtes. Zeitschrift fur experimentelle und angewandte pshchologie, pages 600--607, 1970.
• 7: J. Ellgring and M. von Cranach. Processes of learning in the recognition of eye-signals. European Journal of Social Psychology, pages 33--43, 1972.
• 8: Jim Gemmell , Kentaro Toyama , C. Lawrence Zitnick , Thomas Kang , Steven Seitz, Gaze Awareness for Video-Conferencing: A Software Approach, IEEE MultiMedia, v.7 n.4, p.26-35, October 2000 [doi>10.1109/93.895152]
• 9: J. Gibson and A. Pick. Perception of Another Person's Looking Behavior. American Journal of Psychology, pages 386--394, 1963.
• 10: Hiroshi Ishii , Minoru Kobayashi, ClearBoard: a seamless medium for shared drawing and conversation with eye contact, Proceedings of the SIGCHI conference on Human factors in computing systems, p.525-532, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142977]
• 11: J. Jaspers, et al. Het observen van ogencontact. Nederlands Tijdschrift voor de Psychologie, 28, pages 67--81.
• 12: D. Knight, D. Langmeter, and D. Landgren. Eye-contact, Distance, and Affliliation: the Role of Observer Bias. Sociometry, pages 390--401, 1973.
• 13: K. Kruger and B. Huckstedt. Die Beurteilung von Blickrichtungen. Zeitschrift fur experimentelle und angewandte psychologie, pages 452--472, 1969.
• 14: Ken-Ichi Okada , Fumihiko Maeda , Yusuke Ichikawaa , Yutaka Matsushita, Multiparty videoconferencing at virtual social distance: MAJIC design, Proceedings of the 1994 ACM conference on Computer supported cooperative work, p.385-393, October 22-26, 1994, Chapel Hill, North Carolina, United States [doi>10.1145/192844.193054]
• 15: A. Sellen. Remote Conversations: The Effects of Mediating Talk with Technology. Human-Computer Interaction, pages 401--444, 1995.
• 16: B. Stapley. Visual Enhancement of Telephone Conversations. Ph.D. Thesis, University of London, 1972.
• 17: G. Stephenson and D. Rutter. Eye-contact, Distance and Affiliation: a Re-evaluation. British Journal of Psychology, pages 385--393, 1970.
• 18: R. Stokes. Human Factors and Appearance Design Considerations of the Mod II PicturePhone Station Set. IEEE Transactions on Communication Technology, pages 318--323, 1969.
• 19: Roel Vertegaal, The GAZE groupware system: mediating joint attention in multiparty communication and collaboration, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.294-301, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303065]
• 20: H. White, J. Hegarty, and N. Beasley. Eye Contact and Observer Bias: a Research Note. British Journal of Psychology, pages 271--273, 1970.
• 21: http://graphics.stanford.edu/~miltchen/gaze/

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human information processing
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications
          Subjects: Computer conferencing, teleconferencing, and videoconferencing

General Terms:
Human Factors, Measurement, Performance, Theory

Keywords:
eye contact, gaze perception, videoconferencing