Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Emergent game formats, such as machinima, that use game worlds as expressive 3D performance spaces have new expressive powers with an increase of the quality of their underlying graphic and animation systems. Nevertheless, they still lack intuitive control mechanisms. Set direction and acting are limited by tools that were designed to create and play video games rather than produce expressive performance pieces. These tools do a poor job of capturing the performative expression that characterizes more mature media such as film. Tangible interfaces can help open up the game systems for more intuitive character control needed for a greater level of expression in the digital real-time world.

The TUI3D project (Tangible User Interfaces for Real-Time 3D) addresses production and performative challenges involved in creating machinima through the development of tangible interfaces for controlling 3D virtual actors and environments in real-time. In this paper, we present the design and implementation of a tangible puppet prototype for virtual character control in the Unreal game engine and discuss initial user feedback.

REFERENCES

• 1: Espen J. Aarseth, Cybertext: perspectives on ergodic literature, Johns Hopkins University Press, Baltimore, MD, 1997
• 2: Center for Puppetry Arts, Atlanta, GA. http://www.puppet.org/
• 3: The Character Shop. http://www.character-shop.com/
• 4: Chris Esposito , W. Bradford Paley , JueyChong Ong, Of mice and monkeys: a specialized input device for virtual body animation, Proceedings of the 1995 symposium on Interactive 3D graphics, p.109-ff., April 09-12, 1995, Monterey, California, United States [doi>10.1145/199404.199424]
• 5: Half-Life 2, dev. Valve Corporation publ. by Valve Corporation (2004).
• 6: Hunt, D., Moore, J., West, A., Nitsche, M. (2006) "Puppet Show: Intuitive Puppet Interfaces for Expressive Character Control" in Medi@terra 2006, Gaming Realities: A Challenge for Digital Culture, Athens October 4-8, 2006, pp.159--167.
• 7: Hiroshi Ishii , Brygg Ullmer, Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, March 22-27, 1997, Atlanta, Georgia, United States [doi>10.1145/258549.258715]
• 8: Robert J. K. Jacob , Linda E. Sibert, The perceptual structure of multidimensional input device selection, Proceedings of the SIGCHI conference on Human factors in computing systems, p.211-218, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142792]
• 9: Michael Patrick Johnson , Andrew Wilson , Bruce Blumberg , Christopher Kline , Aaron Bobick, Sympathetic interfaces: using a plush toy to direct synthetic characters, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.152-158, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303028]
• 10: Jesper Juul, Half-Real: Video Games between Real Rules and Fictional Worlds, The MIT Press, 2005
• 11: Kirschner, F., MovieSandbox Tools, http://www.moviesandbox.com/
• 12: Brenda Laurel, Computers as theatre, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1991
• 13: Lehane, S. (2001) "Unrealcity. ILM Creates Artificial Cities for Artificial Intelligence" in Film and Video, Vol. 18, No. 7.
• 14: Marino, P. 3D Game-based Filmmaking. The Art of Machinima. Paraglyph, Scottsdale, 2004.
• 15: Metoyer, R., Xu, L., Srinivasan, M. (2003) "A Tangible Interface for High-Level Direction of Multiple Animated Characters" in Proceedings of Graphics Interface 2003, pp.167--176.
• 16: The Movies, dev. Lionhead Studios, publ. by Activision Publishing (2005).
• 17: Janet Horowitz Murray, Hamlet on the Holodeck: The Future of Narrative in Cyberspace, MIT Press, Cambridge, MA, 1998
• 18: Overholt, D. CREATE USB Interface (CUI) Board. http://www.create.ucsb.edu/~dano/CUI/
• 19: Processing programming environment. http://www.processing.org/
• 20: Quake, dev. id Software, publ. by id Software (1996).
• 21: M. Resnick , F. Martin , R. Sargent , B. Silverman, Programmable bricks: toys to think with, IBM Systems Journal, v.35 n.3-4, p.443-452, 1996
• 22: Salen, K. Telefragging Monster Movies In King, L. (ed.) Game On. The History and Culture of Videogames. Laurence King Publ., London, 2002.
• 23: Katie Salen , Eric Zimmerman, Rules of Play: Game Design Fundamentals, The MIT Press, 2003
• 24: Shay, Don and Duncan, Jody (1993) The Making of Jurassic Park, New York, Ballantine Books.
• 25: The Sims 2, dev. Maxis Software publ. by Electronic Arts (2004).
• 26: Erik Strommen, When the interface is a talking dinosaur: learning across media with ActiMates Barney, Proceedings of the SIGCHI conference on Human factors in computing systems, p.288-295, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/274644.274685]
• 27: David J. Sturman , David Zeltzer, A Survey of Glove-based Input, IEEE Computer Graphics and Applications, v.14 n.1, p.30-39, January 1994 [doi>10.1109/38.250916]
• 28: David J. Sturman , David Zeltzer, A design method for “whole-hand” human-computer interaction, ACM Transactions on Information Systems (TOIS), v.11 n.3, p.219-238, July 1993 [doi>10.1145/159161.159159]
• 29: Tardif, H. (1991). "Character animation in real time," Panel: Applications of Virtual Reality I: Reports from the Field, ACM SIGGRAPH Panel Proceedings.
• 30: Ullmer, B., Ishii, H. (2001) "Emerging Frameworks for Tangible User Interfaces" in Human-Computer Interaction in the New Millennium, John M. Carroll, ed., Addison-Wesley, pp. 579--601.
• 31: Walters, G. (1989) "The story of Waldo C. Graphic" in 3D Character Animation by Computer, ACM SIGGRAPH '89 Course Notes #4, July 1989, pp. 65--79.
• 32: Noah Wardrip-Fruin , Pat Harrigan, First Person: New Media as Story, Performance, and Game, MIT Press, Cambridge, MA, 2004

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Animation

  J. Computer Applications
  J.5 ARTS AND HUMANITIES
      Subjects: Performing arts (e.g., dance, music)

  K. Computing Milieux
  K.8 PERSONAL COMPUTING
      K.8.0 General
          Subjects: Games

General Terms:
Design, Human Factors

Keywords:
3D space, game engine, machinima, puppetry, tangible interface, video games, virtual character