Wizard of Oz prototyping of computer vision based action games for children

ABSTRACT

This paper describes the use of the Wizard of Oz (WOz) method in the design of computer vision based action games controlled with body movements. A WOz study was carried out with 34 children of ages 7 to 9 in order to find out the most intuitive movements for game controls and to evaluate the relationship between avatar and player actions. Our study extends the previous Wizard of Oz studies by showing that WOz prototyping of perceptive action games is feasible despite the delay caused by the wizard. The results also show that distinctive movement categories and gesture patterns can be found by observing the children playing games controlled by a human wizard. The approach minimizes the need for fully functional prototypes in the early stages of the design and provides video material for testing and developing computer vision algorithms, as well as guidelines for animating the game character.

REFERENCES

• 1: ACM/IEEE-CS Joint Task Force on Software Engineering Ethics and Professional Practices. Software engineering code of ethics and professional practice. http://www.acm.org/serving/se/code.htm
• 2: American Psychological Association (APA). Ethical principles of psychologists and code of conduct 2002. http://www.apa.org/ethics/code2002.html
• 3: Gerd Andersson , Kristina Höök , Dário Mourão , Ana Paiva , Marco Costa, Using a Wizard of Oz study to inform the design of SenToy, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, June 25-28, 2002, London, England [doi>10.1145/778712.778762]
• 4: Bobick, A., Intille, S., Davis, J., Baird, F., Pinhanez, C., Campbell, L., Ivanov, Y., Schutte, A., & Wilson, A. The KidsRoom: A perceptually-based interactive and immersive story environment. Presence: Teleoperators and Virtual Environments, 8(4), August 1999, 367-391
• 5: Oliver K. Burmeister, HCI professionalism: ethical concerns in usability engineering, Selected papers from the second Australian Institute conference on Computer ethics, p.11-17, November 01, 2000, Canberra, Australia
• 6: Cordes, C., & Miller, E. (Eds.). Fool's gold: A critical look at computers in childhood. College Park, MD: Alliance for Childhood, 2002. http://www.allianceforchildhood.net/projects/computers/computers_reports.htm
• 7: Coutaz, J., Salber, D., and Balbo, S. Towards the automatic evaluation of multimodal user interfaces. Special issue "Intelligent User Interfaces", Knowledge-Based Systems, 1993.
• 8: James L. Crowley , Joëlle Coutaz , François Bérard, Perceptual user interfaces: things that see, Communications of the ACM, v.43 n.3, p.54-ff., March 2000 [doi>10.1145/330534.330540]
• 9: Nils Dahlbäck , Arne Jönsson , Lars Ahrenberg, Wizard of Oz studies: why and how, Proceedings of the 1st international conference on Intelligent user interfaces, p.193-200, January 04-07, 1993, Orlando, Florida, United States [doi>10.1145/169891.169968]
• 10: D'Hooge, H. Game Design Principles for the Intel Play Me2Cam* Virtual Game System, Intel Technology Journal Q4, 2001.
• 11: Allison Druin , Ben Bederson , Angela Boltman , Adrian Miura , Debby Knotts-Callahan , Mark Platt, Children as our technology design partners, The design of children's technology, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 12: William T. Freeman , Paul A. Beardsley , Hiroshi Kage , Ken-Ichi Tanaka , Kazuo Kyuma , Craig D. Weissman, Computer vision for computer interaction, ACM SIGGRAPH Computer Graphics, v.33 n.4, p.65-68, Nov.2000 [doi>10.1145/345370.345417]
• 13: John D. Gould , John Conti , Todd Hovanyecz, Composing letters with a simulated listening typewriter, Communications of the ACM, v.26 n.4, p.295-308, April 1983 [doi>10.1145/2163.358100]
• 14: Hammerton, L., & Luckin, R. How to help? Investigating children's opinions on help: To inform the design of Metacognitive Software Scaffolding. In R. Luckin (Ed.), AIED2001 Workshop Proceedings: Help provision and help seeking in Interactive Learning Environments. San Antonio: St Mary's University, 2001.
• 15: Hämääinen, P., and Höysniemi, J. (2002). A Computer Vision and Hearing Based User Interface for a Computer Game for Children, in Proceedings of the 7th ERCIM Workshop "User Interfaces For All", 23-25 October 2002, Paris.
• 16: Höysniemi, J., Hämääinen, P., and Turkki, L. (2003). Using peer tutoring in evaluating the usability of a physically interactive computer game with children. Interacting with Computers, Vol. 15, Issue 2, 205-225.
• 17: J. F. Kelley, An iterative design methodology for user-friendly natural language office information applications, ACM Transactions on Information Systems (TOIS), v.2 n.1, p.26-41, Jan. 1984 [doi>10.1145/357417.357420]
• 18: Kelley, J. F., Where did the usability term Wizard of Oz come from?, http://www.musicman.net/oz.html.
• 19: David Maulsby , Saul Greenberg , Richard Mander, Prototyping an intelligent agent through Wizard of Oz, Proceedings of the SIGCHI conference on Human factors in computing systems, p.277-284, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169215]
• 20: Moeslund, Thomas B. Computer vision-based human motion capture - a survey. Aalborg: Aalborg University, Laboratory of Computer Vision and Media Technology, 1999. (LIA Report;LIA 99-02.-ISSN 0906-6233)
• 21: Rolf Molich , Brenda Laurel , Carolyn Snyder , Whitney Quesenbery , Chauncey E. Wilson, Ethics in HCI, CHI '01 extended abstracts on Human factors in computing systems, March 31-April 05, 2001, Seattle, Washington [doi>10.1145/634067.634197]
• 22: Jaime Montemayor , Allison Druin , Allison Farber , Sante Simms , Wayne Churaman , Allison D'Amour, Physical programming: designing tools for children to create physical interactive environments, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503430]
• 23: C. S. Pinhanez , J. W. Davis , S. Intille , M. P. Johnson , A. D. Wilson , A. F. Bobick , B. Blumberg, Physically interactive story environments, IBM Systems Journal, v.39 n.3-4, p.438-455, July 2000
• 24: Roberts, D. F., Foehr, U. G., Rideout, V. J., & Brodie, M. Kids and media @ the new millennium. Menlo Park, CA: Kaiser Family Foundation. 1999.http://www.kff.org
• 25: Judy Robertson , Peter M. Wiemer-Hastings, Feedback on Children's Stories via Multiple Interface Agents, Proceedings of the 6th International Conference on Intelligent Tutoring Systems, p.923-932, June 02-07, 2002
• 26: Yvonne Rogers , Mike Scaife , Eric Harris , Ted Phelps , Sara Price , Hilary Smith , Henk Muller , Cliff Randell , Andrew Moss , Ian Taylor , Danae Stanton , Claire O'Malley , Greta Corke , Silvia Gabrielli, Things aren't what they seem to be: innovation through technology inspiration, Proceedings of the conference on Designing interactive systems: processes, practices, methods, and techniques, June 25-28, 2002, London, England [doi>10.1145/778712.778766]
• 27: Anoop K. Sinha , James A. Landay, Visually prototyping perceptual user interfaces through multimodal storyboarding, Proceedings of the 2001 workshop on Perceptive user interfaces, November 15-16, 2001, Orlando, Florida [doi>10.1145/971478.971501]
• 28: Subrahmanyam, K., Kraut, R. E., Greenfield, P. M., & Gross, E. F., (2000), The impact of home computer use on children activities and development, Children and computer technology, 10(2), Fall/winter 2000.
• 29: Wren, C. R., Spacarino, F., Azarbayejani, A., Darrel, T., Davis, J., Starner, Kotani, A., Chao, C., Hlavac, M., Russel, K., Bobick, A., Pentland, A., Perceptive spaces for performance and entertainment (Revised), ATR Workshop on Virtual Environment, Kyoto, Japan, April 1998.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
Wizard-of-Oz method, children, computer games, computer vision, perceptual user interfaces, physical interaction