User centred virtual actor technology

ABSTRACT

This paper argues that the development of virtual actor technology must be guided by application and end user needs. Two objectives drive the development of the 'Senet' project described in this paper: to develop a set of design guidelines for the use of virtual actors in Collaborative Virtual Environments (CVEs) for learning, and to inform the development of the underlying virtual actor technology following a user centred approach. The methodological approach followed involves the development of prototype virtual learning environments in a series of distinct phases. These are based on an ancient Egyptian game (senet) and are aimed at children at Key Stage Level 2 of the National Curriculum for education in England. Two-dimensional multimedia technology has been used to develop robust prototypes, which were then observed in use by children. The result of this study derived a set of design guidelines, which were then used to guide the implementation of a 3D CVE using the Deva CVE technology.

REFERENCES

• 1: Atkinson, J.M., and Heritage, J. Structures of Social Actions: Studies in Conversation Analysis. Cambridge University Press, 1984.
• 2: Bandura, A. Social Learning Theory. General Learning Press 1971.
• 3: Steve Benford , John Bowers , Lennart E. Fahlén , Chris Greenhalgh , Dave Snowdon, User embodiment in collaborative virtual environments, Proceedings of the SIGCHI conference on Human factors in computing systems, p.242-249, May 07-11, 1995, Denver, Colorado, United States [doi>10.1145/223904.223935]
• 4: Boden, D., and Zimmerman, D.H. Talk and Social Structure: Studies in Ethnomethodology and Conversation Analysis, Polity, 1991.
• 5: Capin, T.K., Pandizc, I.S., Chauvineau, E., Thalmann, N.M., and Thalmann, D. Modeling and Animation of Virtual Humans. COVEN D4.1 1996, CEC Deliverable Number: AC040-GEN-MIR-DS-P-041.b0.
• 6: Carlsson, C., and Hagsand, O. DIVE- A Platform for Multiuser Virtual Environments. Computers and Graphics 17, 6, 1993, 663-669.
• 7: Justine Cassell , Tim Bickmore , Lee Campbell , Hannes Vilhjálmsson , Hao Yan, Human conversation as a system framework: designing embodied conversational agents, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 8: Cassell, J., Sullivan, J., Prevost, S., and Churchill, E. Embodied Conversational Agents. MIT Press 2000.
• 9: Cavazza, M.A. Conversational Agent for Interactive Television. In: Proceedings of the Workshop on Intelligent Virtual Agents VA'99 (Salford, September 1999), 57-66.
• 10: Elizabeth F. Churchill , Linda Cook , Peter Hodgson , Scott Prevost , Joseph W. Sullivan, “May I help you?”: designing embodied conversational agent allies, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 11: Collins, A., Brown, J.S., and Newman, S.E. Cognitive apprenticeship: teaching the crafts of reading, writing and mathematics. In: Knowing, Learning, and Instructions: Essays in Honor of Robert Claser, Resnick, L.B. (ed.), Hillsdale, 1989, 453-494.
• 12: Coulthard, M., Montgomery, M., and Brazil, D. Developing a Description of Spoken Discourse. In: Studies in Discourse Analysis, Coulthard, M., and Montgomery, M. (eds.), Routledge, 1981, 1-50.
• 13: DfEE Open for Learning, Open for Business: The Government's National Grid for Learning Challenge. Department of Education and Employment, U.K., November 1998, URL: http://www.dfee.gov.uk/grid.
• 14: Daphne Economou , William L. Mitchell , Tom Boyle, Requirements elicitation for virtual actors in collaborative learning environments, Computers & Education, v.34 n.3-4, p.225-239, April-May 2000 [doi>10.1016/S0360-1315(99)00047-0]
• 15: Economou, D., Mitchell, W.L., and Boyle, T. Towards a user-centred method for studying CVLEs. In: Proceedings of ERCIM WG UI4ALL joint Workshop with i3 Spring Days 2000 on Interactive Learning Environments for Children (Athens, March 2000).
• 16: Economou, D., Mitchell, W.L., and Boyle, T. A Phased Approach to Developing a Set of Requirements for the Use of Virtual Actors in Shared Virtual Learning Environments. In: Proceedings of ED-MEDIA & ED-TELECOM'98 (Freiburg, June 1998), AACE Press, 1620-1621.
• 17: EPFL, Geneva, IIS, TNO, Lancaster, UCL, Nottingham, SICS, Division, Thomson, KPN. Guidelines for building CVE applications. COVEN D2.6 1997. van Liempd, G. (ed.), CEC Deliverable Number: AC040-KPN-RESEARCH-DS-P-026.b1 http://chinin.thomson-csf.fr/projects/coven/.
• 18: John P. Granieri , Norman I. Badler, Simulating humans in virtual reality, Virtual reality applications, Academic Press Ltd., London, UK, 1995
• 19: Chris Greenhalgh , Steven Benford, MASSIVE: a collaborative virtual environment for teleconferencing, ACM Transactions on Computer-Human Interaction (TOCHI), v.2 n.3, p.239-261, Sept. 1995 [doi>10.1145/210079.210088]
• 20: Gunton, T. (ed.) Information systems practice: the complete guide. Manchester: NCC Blackwell, 1993.
• 21: Guye-Vuilleme, A., Capin, T.K., Pandzic, I.S., Thalmann, N.M., and Thalmann, D. Nonverbal Communication Interface for Collaborative Virtual Environments. In: Proceedings of Collaborative Virtual Environments CVE'98 (Manchester, June 1998), 105-112.
• 22: Johnson, W.L., Stiles, R., and Munro, A. Integrating Pedagogical Agents into Virtual Environments. Presence 7, 6, 1998, 523-546.
• 23: Jordan, B., and Henderson, A. Interaction Analysis: Foundations and Practice. The Journal of Learning Sciences 4, 1, 1995, 39-103.
• 24: Kaur, K. Designing virtual environments for usability. PhD Thesis, City University, 1998.
• 25: Koda, T., and Maes, P. Agents with Faces: The Effects of Personification of Agents. In: Proceedings of HCI'96 (London, August 1996), The British HCI Group, 98-103.
• 26: Laurel, B. Interface agents: Metaphor with character. In: The Art of Human-Computer Interface Design. Laurel B. (ed.), Addison-Wesley, 1990, 355-365.
• 27: James C. Lester , Stuart G. Towns , Charles B. Callaway , Jennifer L. Voerman , Patrick J. FitzGerald, Deictic and emotive communication in animated pedagogical agents, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 28: Mitchell, W.L. Moving the museum onto the Internet: The use of virtual environments in education about ancient Egypt. In: Virtual Worlds on the Internet, Vince, J.A., and Earnshaw, R.A. (eds.), IEEE Computer Society Press, 1999, 263-278.
• 29: Monsieurs, P., Coninx, K., and Flerackersm, E. Collision Avoidance and Map Construction Using Synthetic Vision. In: Proceedings of the Workshop on Intelligent Virtual Agents VA'99 (Salford, September 1999), 33-46.
• 30: Clifford Nass , Jonathan Steuer , Ellen R. Tauber, Computers are social actors, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.72-78, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191703]
• 31: Pettifer, S. An operating environment for large scale virtual reality. PhD Thesis, The University of Manchester, 1999.
• 32: Isabella Poggi , Catherine Pelachaud, Performative facial expressions in animated faces, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 33: Jeff Rickel , W. Lewis Johnson, Task-oriented collaboration with embodied agents in virtual worlds, Embodied conversational agents, MIT Press, Cambridge, MA, 2001
• 34: Roussos, M., Johnson, A., Moher, T., Leigh, J., Vasilakis, C., and Barnes, C. Learning and Building Together in an Immersive Virtual World. Presence 8, 3, 1998, 247-263.
• 35: Salomon, G. Interaction of Media, Cognition, and Learning. Jossey-Bass 1979.
• 36: Shu, L., and Flowers, W. Teledesign: groupware user experiments in three-dimensional computer-aided design. Collaborative Computing 1, 1, 1994, 1-14.
• 37: Silverman, D. Qualitative Research: theory, method and practice, Silverman, D. (ed.), Sage, 1997.
• 38: Stanney, K.M., Mourant, R.R., and Kennedy, R.S. Human Factors Issues in Virtual Environments: A Review of the Literature. Presence 7, 4, 1998, 327-351.
• 39: Stephanidis, C., Salvendy, G., Akoumianakis, D., Arnold, A., Bevan, N., Dardailler, D., Emiliani, P.L., Iakovidis, I., Jenkins, P., Karshmer, A., Korn, P., Marcus, A., Murphy, H., Oppermann, C., Stary, C., Tamura, H., Tscheligi, M., Ueda, H., Weber, G., and Ziegler, J. Towards an Information Society for All: HCI challenges and R&D recommendations. International Journal of Human-Computer Interaction 11, 1, 1999, 1-28.
• 40: Jason Stewart , Benjamin B. Bederson , Allison Druin, Single display groupware: a model for co-present collaboration, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.286-293, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303064]
• 41: Demetri Terzopoulos , Xiaoyuan Tu , Radek Grzeszczuk, Artificial fishes: autonomous locomotion, perception, behavior, and learning in a simulated physical world, Artificial Life, v.1 n.4, p.327-351, Summer 1994
• 42: Thórisson, K.R. Communicative Humanoids: A Computational Model of Psychosocial Dialogue Skills. Ph.D. Thesis, MIT, 1996.
• 43: Susanne Van Mulken , Elisabeth André , Jochen Müller, The Persona Effect: How Substantial Is It?, Proceedings of HCI on People and Computers XIII, p.53-66, January 1998
• 44: West, A.J., Howard, T.L.J., Hubbold, R.J., Murta, A.D., Snowdon, D.N., and Butler, D.A. A Generic Virtual Reality Interface for Real Applications. In: Virtual Reality Systems, R.A., Earnshaw, M.A., and J.H., Gigante, (eds.). Academic Press, 1993, 213-236.
• 45: Zeltzer, D., and Johnson, M.B. Virtual Actors and Virtual Environments. In: Interacting with Virtual Environments. MacDonald, L. & Vince, J.A. (eds.), John Wiley & Sons Ltd., 1994, 229-255.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Virtual reality

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries
          Subjects: User issues
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: 3D/stereo scene analysis

General Terms:
Design, Human Factors

Keywords:
collaborative virtual environments, design guidelines, evaluation, interaction analysis, pedagogy, technology requirements