"Feed the Fish": an affect-aware game

ABSTRACT

In this paper we report on an affective gaming interface and a user study which evaluates user response to affective gaming. "Feed the Fish" is an affect-aware game system which takes a player's facial expressions as input and dynamically responds to the player by changing the game elements. The goal of this system is to use human expressions to build a communication channel between the game and players so playing the game can be more enjoyable. We describe the implementation of the game system and discuss the result of the user study we have conducted with 22 participants. Participants enjoyed the game with the affect-aware system more than a non affective version of the game, and they felt it was more exciting since the game was more challenging and dynamic.

REFERENCES

• 1: Face and Facial feature tracking for natural human computer interfaces, Vladimir Vezhnevevets.
• 2: Phillip Ian Wilson , John Fernandez, Facial feature detection using Haar classifiers, Journal of Computing Sciences in Colleges, v.21 n.4, p.127-133, April 2006
• 3: Zakharov, K., Mitrovic, T., and Johnston, L. Intellegent Tutoring Systems Respecting Human Nature. 5th New Zealand CSRSC, Hamilton, NZ, 2007.
• 4: Konstantin Zakharov. Affect Recognition and Support in Intelligent Tutoring Systems. Masters thesis, University of Canterbury, 2007.
• 5: Robert Forchheimer , Igor S. Pandzic , Algirdas Pakstas, MPEG-4 Facial Animation: The Standard,Implementation and Applications, John Wiley & Sons, Inc., New York, NY, 2002
• 6: Flores, V. C. (2005). Artnatomy/Artanatomia. http://www.artnatomia.net.
• 7: Rosalind W. Picard, Affective Computing for HCI, Proceedings of HCI International (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Ergonomics and User Interfaces-Volume I, p.829-833, August 22-26, 1999
• 8: J. Klein, Y. Moon and R. W. Picard (2002), "This Computer Responds to User Frustration," Interacting with Computers, Volume 14, No. 2, (2002), pp. 119--140.
• 9: Rani, P., Sarkar, N., & Liu, C. (2005). Maintaining optimal challenge in computer games through real-time physiological feedback. Proceedings of the 1st International Conference on Augmented Cognition, Las Vegas, NV, 22--27 July 2005.
• 10: B. Noureddin , P. D. Lawrence , C. F. Man, A non-contact device for tracking gaze in a human computer interface, Computer Vision and Image Understanding, v.98 n.1, p.52-82, April 2005 [doi>10.1016/j.cviu.2004.07.005]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION

Additional Classification:
  J. Computer Applications
  J.4 SOCIAL AND BEHAVIORAL SCIENCES

General Terms:
Experimentation, Human Factors

Keywords:
affect-aware system, computer games, computer vision, facial feature tracking