Communicating facial affect: it's not the realism, it's the motion

ABSTRACT

Designers of video-mediated communication and affective computing applications must make tradeoffs to deal with limited bandwidth. Typically spatial resolution and color are preserved at the expense of temporal resolution and accuracy. Our data suggest that this may not be the appropriate tradeoff for communicating facial affect; preserving motion is critical and may even compensate for major losses in image realism.

REFERENCES

• 1: Bachmann, T. Identification of spatially quantised tachistoscope images of faces. European Journal of Cognitive Psychology, 3, (1991), 87-103.
• 2: Bassili, J. N. Emotion Recognition. Journal of Personality and Social Psychology, 37, (1979), 2049-2058.
• 3: Bruce, V. The role of the face in communication. Interacting with Computers, 8, (1996), 166-176.
• 4: Herbert L. Colston , Diane J. Schiano, Looking and lingering as conversational cues in video-mediated communication, Conference companion on Human factors in computing systems, p.278-279, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223355.223673]
• 5: Ekman, P. & Friesen, W. V. The Facial Action Coding System. Consulting Psychologists Press: Palo Alto, CA, 1978.
• 6: Kelly, M. H. & Freyd, J. J. Explorations of representational momentum. Cognitive Psychology, 19 (3), (1987), 369-401.
• 7: Lisetti, C. & Schiano, D. J. Automatic facial expression interpretation. Pragmatics, in press.
• 8: Diane J. Schiano , Sheryl M. Ehrlich , Krisnawan Rahardja , Kyle Sheridan, Face to interface: facial affect in (hu)man and machine, Proceedings of the SIGCHI conference on Human factors in computing systems, p.193-200, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332430]

INDEX TERMS

Keywords:
face, facial affect, facial expression of emotion, image degradation, nonverbal communication, video conferencing