The EMOTE model for effort and shape

ABSTRACT

Human movements include limb gestures and postural attitude. Although many computer animation researchers have studied these classes of movements, procedurally generated movements still lack naturalness. We argue that looking only at the psychological notion of gesture is insufficient to capture movement qualities needed by animated charactes. We advocate that the domain of movement observation science, specifically Laban Movement Analysis (LMA) and its Effort and Shape components, provides us with valuable parameters for the form and execution of qualitative aspects of movements. Inspired by some tenets shared among LMA proponents, we also point out that Effort and Shape phrasing across movements and the engagement of the whole body are essential aspects to be considered in the search for naturalness in procedurally generated gestures. Finally, we present EMOTE (Expressive MOTion Engine), a 3D character animation system that applies Effort and Shape qualities to independently defined underlying movements and thereby generates more natural synthetic gestures.

REFERENCES

• 1: Kenji Amaya , Armin Bruderlin , Tom Calvert, Emotion from motion, Proceedings of the conference on Graphics interface '96, p.222-229, May 1996, Toronto, Ontario, Canada
• 2: Badler, N. A computational alternative to effort notation. In Gray, J.A., editor, Dance Technology: Current Applications and Future Trends. National Dance Association, VA, 1989.
• 3: Norman I. Badler , Diane M. Chi , Sonu Chopra, Virtual Human Animation Based on Movement Observation and Cognitive Behavior Models, Proceedings of the Computer Animation, p.128, May 26-28, 1999
• 4: Norman I. Badler , Stephen W. Smoliar, Digital Representations of Human Movement, ACM Computing Surveys (CSUR), v.11 n.1, p.19-38, March 1979 [doi>10.1145/356757.356760]
• 5: Norman I. Badler , Bonnie L. Webber , Welton Becket , Matthew Stone , Christopher Geib , Michael Moore , Catherine Pelachaud , Barry D. Reich, Planning for animation, Interactive computer animation, Prentice-Hall, Inc., Upper Saddle River, NJ, 1996
• 6: Bartenieff, I., Davis, M. Effort-Shape analysis of movement: The unity of expression and function. In Davis, M., editor, Research Approaches to Movement and Personality. Arno Press Inc., New York, 1972.
• 7: Bartenieff, I., Lewis, D. Body Movement: Coping with the Environment. Gordon and Breach Science Publishers, New York, 1980.
• 8: P. Becheiraz , D. Thalmann, A Model of Nonverbal Communication and Interpersonal Relationship Between Virtual Actors, Proceedings of the Computer Animation, p.58, June 03-04, 1996
• 9: Bishko, L. Relationships between Laban Movement Analysis and computer animation. In Dance and Technology 1: Moving Toward The Future, pp. 1-9, 1992.
• 10: Armin Bruderlin , Lance Williams, Motion signal processing, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.97-104, September 1995 [doi>10.1145/218380.218421]
• 11: Calvert, T.W., Chapman, J., Patla, A. Aspects of the kinematic simulation of human movement. 1EEE Computer Graphics & Applications, 2:41-48, November 1982.
• 12: Avatars in Networked Virtual Environments, John Wiley & Sons, Inc., New York, NY, 1999
• 13: Justine Cassell, Embodied conversational interface agents, Communications of the ACM, v.43 n.4, p.70-78, April 2000 [doi>10.1145/332051.332075]
• 14: Justine Cassell , Catherine Pelachaud , Norman Badler , Mark Steedman , Brett Achorn , Tripp Becket , Brett Douville , Scott Prevost , Matthew Stone, Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.413-420, July 1994 [doi>10.1145/192161.192272]
• 15: Diane M. Chi , Norman I. Badler, A motion control scheme for animating expressive arm movements, 1999
• 16: Davis, M. Effort-Shape analysis: Evaluation of its logic and consistency and its systematic use in research. In Bartenieff, I., Davis, M. and Paula, F., editors, Four Adaptations of Effort Theory in Research and Teaching. Dance Notation Bureau, Inc., New York, 1970.
• 17: Dell, C. A Primer for Movement Description: Using Effort-Shape and Supplementary Concepts. Dance Notation Bureau, Inc., New York, 1970.
• 18: Jack 2.2 Toolkit Reference Guide, Engineering Animation, Inc., 1999.
• 19: Kendon, A. Gesticulation and speech: Two aspects of the process of utterance. In Key, M.R., editor, The Relation between Verbal and Nonverbal Communication, pp. 207-227. Mouton, 1980.
• 20: Doris H. U. Kochanek , Richard H. Bartels, Interpolating splines with local tension, continuity, and bias control, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.33-41, January 1984
• 21: Yoshihito Koga , Koichi Kondo , James Kuffner , Jean-Claude Latombe, Planning motions with intentions, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.395-408, July 1994 [doi>10.1145/192161.192266]
• 22: Laban, R. The Mastery of Movement. Plays, Inc., Boston, 1971.
• 23: Laban, R., Lawrence, F. C. Effort: Economy in Body Movement. Plays, Inc., Boston, 1974.
• 24: Lamb, W. Posture and Gesture: An Introduction to the Study of Physical Behavior. Duckworth & Co., London, 1965.
• 25: John Lasseter, Principles of traditional animation applied to 3D computer animation, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.35-44, August 1987
• 26: Maletic, V. Body, Space, Expression: The Development of Rudolf Laban's Movement and Dance Concepts. Mouton de Gruyte, New York, 1987.
• 27: McNeil, D. Hand and Mind: What Gestures Reveal about Thought. University of Chicago, 1992.
• 28: Moore, C.-L., Yamamoto, K. Beyond Words: Movement Observation and Analysis. Gordon and Breach Science Publishers, New York, 1988.
• 29: C. L. Morawetz , T. W. Calvert, Goal-directed human animation of multiple movements, Proceedings on Graphics interface '90, p.60-67, June 1990, Halifax, Nova Scotia
• 30: James F. O'Brien , Victor Brian Zordan , Jessica K. Hodgins, Combining Active and Passive Simulations for Secondary Motion, IEEE Computer Graphics and Applications, v.20 n.4, p.86-96, July 2000 [doi>10.1109/38.851756]
• 31: Ken Perlin, Real Time Responsive Animation with Personality, IEEE Transactions on Visualization and Computer Graphics, v.1 n.1, p.5-15, March 1995 [doi>10.1109/2945.468392]
• 32: Craig W. Reynolds, Flocks, herds and schools: A distributed behavioral model, Proceedings of the 14th annual conference on Computer graphics and interactive techniques, p.25-34, August 1987
• 33: Charles Rose , Michael F. Cohen , Bobby Bodenheimer, Verbs and Adverbs: Multidimensional Motion Interpolation, IEEE Computer Graphics and Applications, v.18 n.5, p.32-40, September 1998 [doi>10.1109/38.708559]
• 34: Scott N. Steketee , Norman I. Badler, Parametric keyframe interpolation incorporating kinetic adjustment and phrasing control, Proceedings of the 12th annual conference on Computer graphics and interactive techniques, p.255-262, July 1985
• 35: Thomas, F., Johnston, O. lllusion of Life: Disney Animation. Hyperion, New York, 1995.
• 36: Tolani, D. Inverse Kinematics Methods for Human Modeling and Simulation. PhD thesis, University of Pennsylvania, 1998.
• 37: Xiaoyuan Tu , Demetri Terzopoulos, Artificial fishes: physics, locomotion, perception, behavior, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.43-50, July 1994 [doi>10.1145/192161.192170]
• 38: Munetoshi Unuma , Ken Anjyo , Ryozo Takeuchi, Fourier principles for emotion-based human figure animation, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.91-96, September 1995 [doi>10.1145/218380.218419]
• 39: Hannes Högni Vilhjálmsson , Justine Cassell, BodyChat: autonomous communicative behaviors in avatars, Proceedings of the second international conference on Autonomous agents, p.269-276, May 10-13, 1998, Minneapolis, Minnesota, United States [doi>10.1145/280765.280843]
• 40: Andrew Witkin , Zoran Popovic, Motion warping, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.105-108, September 1995 [doi>10.1145/218380.218422]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Motion; Modeling and recovery of physical attributes
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Physically based modeling
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Motion

General Terms:
Design, Human Factors, Measurement, Performance, Theory

Keywords:
animation systems, expression, gestures, human body simulation, procedural modeling