Evaluating the emotional content of human motions on real and virtual characters

ABSTRACT

In order to analyze the emotional content of motions portrayed by different characters, we created real and virtual replicas of an actor exhibiting six basic emotions: sadness, happiness, surprise, fear, anger and disgust. In addition to the video of the real actor, his actions were applied to five virtual body shapes: a low and high resolution virtual counterpart, a cartoon-like character, a wooden mannequin, and a zombie-like character (Figure 1). Participants were asked to rate the actions based on a list of 41 more complex emotions. We found that the perception of emotional actions is highly robust and to the most part independent of the character's body.

REFERENCES

• 1: Atkinson, A. P., Dittrich, W. H., Gemmell, A. J., and Young, A. W. 2004. Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33, 6, 717--746.
• 2: Chaminade, T., Hodgins, J., and Kawato, M. 2007. Anthropomorphism influences perception of computer-animated characters' actions. Social Cognitive and Affective Neuroscience 2, 206--216.
• 3: Coulson, M. 2004. Attributing emotion to static body postures: Recognition accuracy, confusions, and viewpoint dependence. Journal of Nonverbal Behavior 28, 2, 117--139.
• 4: Elizabeth Crane , Melissa Gross, Motion Capture and Emotion: Affect Detection in Whole Body Movement, Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction, September 12-14, 2007, Lisbon, Portugal [doi>10.1007/978-3-540-74889-2_9]
• 5: Ekman, P. 1992. Are there basic emotions? Psychological Review 99, 3, 550--553.
• 6: Jessica K. Hodgins , James F. O'Brien , Jack Tumblin, Perception of Human Motion With Different Geometric Models, IEEE Transactions on Visualization and Computer Graphics, v.4 n.4, p.307-316, October 1998 [doi>10.1109/2945.765325]
• 7: Johansson, G. 1973. Visual perception of biological motion and a model for its analysis. Perception and Psychophysics 14, 2, 201--211.
• 8: Mar, R. A., Kelley, W. M., Heatherton, T. F., and Macrae, C. N. 2007. Detecting agency from the biological motion of veridical vs animated agents. Social Cognitive and Affective Neuroscience Adcance Access 2, 3, 199--205.
• 9: McDonnell, R., Dobbyn, S., and O'Sullivan, C. 2005. LOD human representations: A comparative study. In Proceedings of VCrowds, 101--115.
• 10: Rachel McDonnell , Sophie Jörg , Jessica K. Hodgins , Fiona Newell , Carol O'Sullivan, Virtual shapers & movers: form and motion affect sex perception, Proceedings of the 4th symposium on Applied perception in graphics and visualization, July 25-27, 2007, Tubingen, Germany [doi>10.1145/1272582.1272584]
• 11: Mori, M. 1970. The uncanny valley. Energy 7, 4, 33--35.
• 12: Kristine L. Nowak , Frank Biocca, The effect of the agency and anthropomorphism of users' sense of telepresence, copresence, and social presence in virtual environments, Presence: Teleoperators and Virtual Environments, v.12 n.5, p.481-494, October 2003 [doi>10.1162/105474603322761289]
• 13: Marco Pasch , Ronald Poppe, Person or Puppet? The Role of Stimulus Realism in Attributing Emotion to Static Body Postures, Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction, September 12-14, 2007, Lisbon, Portugal [doi>10.1007/978-3-540-74889-2_8]
• 14: Perani, D., Fazio, F., Borghese, N. A., Tettamanti, M., Ferrari, S., Decety, J., and Gilardi, M. C. 2001. Different brain correlates for watching real and virtual hand actions. NeuroImage 14, 749--758.
• 15: Byron Reeves , Clifford Nass, The media equation: how people treat computers, television, and new media like real people and places, Cambridge University Press, New York, NY, 1996
• 16: S. Han, Y. Jiang, G. W. H. T. Z., and Cai, P. 2005. Distinct neural substrates for the perception of real and virtual visual worlds. NeuroImage 24, 928--935.
• 17: Mel Slater , Anthony Steed, Meeting people vitually: experiments in shared virtual environments, The social life of avatars: presence and interaction in shared virtual environments, Springer-Verlag New York, Inc., New York, NY, 2002
• 18: Wallbott, H. G. 1998. Bodily expression of emotion. European Journal of Social Psychology 28, 6, 879--896.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Keywords:
motion-capture, perception