MAge-AniM: a system for visual modeling of embodied agent animations and their replay on mobile devices

ABSTRACT

Embodied agents are employed in several applications (e.g. computer-based presentations, help systems, e-learning and training, sign language communication for the deaf), but the process of developing them is still complex (e.g., modeling animations is one of the difficult and time-consuming tasks). Moreover, although mobile devices have recently reached a performance level that allows them to manage 3D graphics, most embodied agents run on desktop computers only. The aim of our research is twofold: (i) proposing a tool that allows novice users to approach the animation modeling process of 3D anthropomorphic agents in a simple way, and (ii) proposing a 3D player to display these animated agents on PDAs. Besides discussing in detail the proposed system, the paper reports about its informal evaluation and two of its applications: sign language animation for the deaf and mobile fitness training.

REFERENCES

• 1: Beth Adelson, Evocative agents and multi-media interface design, Proceedings of the SIGCHI conference on Human factors in computing systems, p.351-356, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142830]
• 2: Alias-Wavefront. Maya. http://www.aliaswavefront.com/en/products/maya/, 2005.
• 3: Elisabeth André , Thomas Rist , Jochen Müller, Guiding the user through dynamically generated hypermedia presentations with a life-like character, Proceedings of the 3rd international conference on Intelligent user interfaces, p.21-28, January 06-09, 1998, San Francisco, California, United States [doi>10.1145/268389.268394]
• 4: Autodesk Inc.. 3ds Max. http://www.discreet.com/products/3dsmax/, 2005.
• 5: Norman I. Badler , Martha S. Palmer , Rama Bindiganavale, Animation control for real-time virtual humans, Communications of the ACM, v.42 n.8, p.64-73, Aug. 1999 [doi>10.1145/310930.310975]
• 6: J. Baus, K. Cheverst, and C. Kray. A Survey of Map-based Mobile Guides. In L. Meng, A. Zipf, T. Reichenbacher (eds): Map-based mobile services - Theories, Methods, and Implementations, pages 197--216. Springer-Verlag, Berlin, Germany, 2005.
• 7: Timothy Bickmore, Towards the design of multimodal interfaces for handheld conversational characters, CHI '02 extended abstracts on Human factors in computing systems, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/506443.506598]
• 8: Timothy W. Bickmore , Rosalind W. Picard, Establishing and maintaining long-term human-computer relationships, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.2, p.293-327, June 2005 [doi>10.1145/1067860.1067867]
• 9: Bitmanagement Software GmbH. BS Contact VRML/X3D. http://www.bitmanagement.de, 2005.
• 10: Fabio Buttussi , Luca Chittaro , Daniele Nadalutti, H-animator: a visual tool for modeling, reuse and sharing of X3D humanoid animations, Proceedings of the eleventh international conference on 3D web technology, April 18-21, 2006, Columbia, Maryland [doi>10.1145/1122591.1122606]
• 11: M. P. Carretero, D. Oyarzun, A. Ortiz, I. Aizpurua, and J. Posada. Virtual Characters Facial and Body Animation through the Edition and Interpretation of Mark-up Languages. Computers and Graphics, 29:189--194, 2005.
• 12: J. Cassell , T. Bickmore , M. Billinghurst , L. Campbell , K. Chang , H. Vilhjálmsson , H. Yan, Embodiment in conversational interfaces: Rea, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.520-527, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303150]
• 13: Justine Cassell , Tim Bickmore , Lee Campbell , Hannes Vilhjálmsson , Hao Yan, Human conversation as a system framework: designing embodied conversational agents, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 14: Matthew Conway , Steve Audia , Tommy Burnette , Dennis Cosgrove , Kevin Christiansen, Alice: lessons learned from building a 3D system for novices, Proceedings of the SIGCHI conference on Human factors in computing systems, p.486-493, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332481]
• 15: James Davis , Maneesh Agrawala , Erika Chuang , Zoran Popović , David Salesin, A sketching interface for articulated figure animation, Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation, July 26-27, 2003, San Diego, California
• 16: R. Elliott , J. R. W. Glauert , J. R. Kennaway , I. Marshall, The development of language processing support for the ViSiCAST project, Proceedings of the fourth international ACM conference on Assistive technologies, p.101-108, November 13-15, 2000, Arlington, Virginia, United States [doi>10.1145/354324.354349]
• 17: Mario Gutiérrez , Frédéric Vexo , Daniel Thalmann, The Mobile Animator: Interactive Character Animation in Collaborative Virtual Environments, Proceedings of the IEEE Virtual Reality 2004 (VR'04), p.125, March 27-31, 2004 [doi>10.1109/VR.2004.77]
• 18: HCI Lab - University of Udine, MAge-AniM website, http://hcilab.uniud.it/mage-anim/.
• 19: Akanksha Huang , Z. Huang , B. Prabhakaran , C. R. Ruiz, Jr., Interactive visual method for motion and model reuse, Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australasia and South East Asia, February 11-14, 2003, Melbourne, Australia [doi>10.1145/604471.604479]
• 20: Humanoid Animation Working Group. ISO/IEC FDIS 19774 Humanoid Animation (H-Anim). http://h-anim.org, 2001.
• 21: M. W. Kadous and C. Sammut. InCA: A Mobile Conversational Agent. In PRICAI 2004: 8th Pacific Rim International Conference on Artificial Intelligence. Lecture Notes in Computer Science, volume 3157, pages 644--653. Springer-Verlag, Berlin, Germany, 2004.
• 22: K. Kamyab, F. Guerin, P. Goulev, and E. Mamdani. Designing Agents for a Virtual Marketplace. AISB Journal, 1(1):61--86, 2001.
• 23: K. Karpouzis, G. Caridakis, S. E. Fotinea, and E. Efthimiou. Educational Resources and Implementation of a Greek Sign Language Synthesis Architecture. Computers & Education, Special Issue in Web3D Technologies in Learning, Education and Training, In press.
• 24: Khronos Group. OpenGL ES. http://www.khronos.org/opengles/, 2003.
• 25: James C. Lester , Sharolyn A. Converse , Susan E. Kahler , S. Todd Barlow , Brian A. Stone , Ravinder S. Bhogal, The persona effect: affective impact of animated pedagogical agents, Proceedings of the SIGCHI conference on Human factors in computing systems, p.359-366, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258797]
• 26: Daniele Nadalutti , Luca Chittaro , Fabio Buttussi, Rendering of X3D content on mobile devices with OpenGL ES, Proceedings of the eleventh international conference on 3D web technology, April 18-21, 2006, Columbia, Maryland [doi>10.1145/1122591.1122594]
• 27: responDESIGN, Inc. Yourselffitness. http://www.yourselffitness.com/.
• 28: Thomas Rist , Elisabeth Andrࡕ , Stephan Baldes, A flexible platform for building applications with life-like characters, Proceedings of the 8th international conference on Intelligent user interfaces, January 12-15, 2003, Miami, Florida, USA [doi>10.1145/604045.604071]
• 29: Thomas Rist , Elisabeth André , Jochen Müller, Adding animated presentation agents to the interface, Proceedings of the 2nd international conference on Intelligent user interfaces, p.79-86, January 06-09, 1997, Orlando, Florida, United States [doi>10.1145/238218.238298]
• 30: Zsófia Ruttkay , Catherine Pelachaud, From brows to trust: evaluating embodied conversational agents, Kluwer Academic Publishers, Norwell, MA, 2004
• 31: Hirohiko Sagawa , Masaru Takeuchi, A teaching system of Japanese sign language using sign language recognition and generation, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641035]
• 32: Sony Computer Entertainment Europe and Nike Motion Works. Eyetoy: Kinetic. http://www.eyetoykinetic.com/.
• 33: S. C. L. Terra , R. A. Metoyer, Performance timing for keyframe animation, Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation, August 27-29, 2004, Grenoble, France [doi>10.1145/1028523.1028556]
• 34: Lynette van Zijl , Lesley Raitt, Implementation experience with collision avoidance in signing avatars, Proceedings of the 3rd international conference on Computer graphics, virtual reality, visualisation and interaction in Africa, November 03-05, 2004, Stellenbosch, South Africa [doi>10.1145/1029949.1029959]
• 35: Web3D Consortium. ISO/IEC 19775:2004 Extensible 3D (X3D). http://www.web3d.org/x3d/specifications/, 2004.
• 36: S. Wilcox , J. Scheibman , D. Wood , D. Cokely , W. C. Stokoe, Multimedia dictionary of American Sign Language, Proceedings of the first annual ACM conference on Assistive technologies, p.9-16, October 31-November 01, 1994, Marina Del Rey, California, United States [doi>10.1145/191028.191031]
• 37: Beifang Yi , Frederick C. Harris, Jr. , Sergiu M. Dascalu, From creating virtual gestures to "writing" in sign languages, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1057047]
• 38: Liwei Zhao , Karin Kipper , William Schuler , Christian Vogler , Norman I. Badler , Martha Palmer, A Machine Translation System from English to American Sign Language, Proceedings of the 4th Conference of the Association for Machine Translation in the Americas on Envisioning Machine Translation in the Information Future, p.54-67, October 10-14, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

General Terms:
Human Factors

Keywords:
embodied agents, mobile devices, visual animation modeling