Measuring emotional valence during interactive experiences: boys at video game play

ABSTRACT

This paper describes the use of facial electromyography (EMG) as a measure of positive and negative emotional valence during interactive experience. Thirteen boys played a car racing video game on an Xbox platform while facial EMG data were collected. Through video review positive and negative events during play were identified. The zygomaticus muscle EMG, which controls smiling, was found to be significantly greater during positive events as compared to negative. The corrugator muscle EMG, which controls frowning, was found to be significantly greater during negative events. The results of this study demonstrate that positive valence can be measured during interactive experiences with physiologic measures. This study also found that the corrugator EMG can still measure negative valence during high intensity interactive play in spite of the confounding factor of mental effort. These methods appear useful for associating the player's emotion with game events, and could be applied to HCI in general.

REFERENCES

• 1: Jenni Anttonen , Veikko Surakka, Emotions and heart rate while sitting on a chair, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055040]
• 2: Pedro Branco , Peter Firth , L. Miguel Encarnação , Paolo Bonato, Faces of emotion in human-computer interaction, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056885]
• 3: Cacioppo, J.T., Bush L.K., and Tassinary, L.G. Microexpressive facial actions as a function of affective stimuli: Replication and extension. Psychological Science, 18, (1992), 515--526.
• 4: Kevin Cheng , Paul A. Cairns, Behaviour, realism and immersion in games, CHI '05 extended abstracts on Human factors in computing systems, April 02-07, 2005, Portland, OR, USA [doi>10.1145/1056808.1056894]
• 5: Derbaix, C.M. (1995).The impact of affective reactions on attitudes toward the advertisement and the brand: A step toward ecological validity. Journal of Marketing Research, 32, (1995), 470--479.
• 6: Ekman, P., and Friesen, W.V. Facial action coding system (FACS): A technique for the measurement of facial actions. Consulting Psychologists Press, Palo Alto, Ca, 1978.
• 7: Richard Hazlett, Measurement of user frustration: a biologic approach, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.765958]
• 8: Hazlett, R. L. and Benedek, J. Measuring the emotional reaction to passive first impression of software. In Proc. Designing Pleasurable Products and Interfaces 2005, Eindhoven, Netherlands, Springer-Verlag.
• 9: Kevin Keeker , Randy Pagulayan , Jonathan Sykes , Nicole Lazzaro, The untapped world of video games, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.986170]
• 10: Lang, P.J., Greenwald, M.K., Bradley, M.M, and Hamm, A.O. Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30, (1993), 261--273.
• 11: Larsen, J.T., Norris, C.J., and Cacioppo, J.T. Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. Psychophysiology, 40, (2003), 776--785.
• 12: Lazarro, N. Why we play games: Four keys to more emotion without story. http://www.xeodesign.com/ Access: 15 September 2005.
• 13: Regan Lee Mandryk, Objectively evaluating entertainment technology, CHI '04 extended abstracts on Human factors in computing systems, April 24-29, 2004, Vienna, Austria [doi>10.1145/985921.985977]
• 14: Regan L. Mandryk , Kori M. Inkpen, Physiological indicators for the evaluation of co-located collaborative play, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031625]
• 15: Partala, T., & Surakka, V. (2004). The effects of affective interventions in human-computer interaction. Interacting with Computers, 16, 295--309.
• 16: Timo Partala , Veikko Surakka , Toni Vanhala, Person-independent estimation of emotional experiences from facial expressions, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040883]
• 17: Pope, L.K. and Smith, C.A. On the distinct meanings of smiles and frowns. Cognition and Emotion, 8, (1994), 65--72.
• 18: Niklas Ravaja , Mikko Salminen , Jussi Holopainen , Timo Saari , Jari Laarni , Aki Järvinen, Emotional response patterns and sense of presence during video games: potential criterion variables for game design, Proceedings of the third Nordic conference on Human-computer interaction, p.339-347, October 23-27, 2004, Tampere, Finland [doi>10.1145/1028014.1028068]
• 19: Jocelyn Riseberg , Jonathan Klein , Raul Fernandez , Rosalind W. Picard, Frustrating the user on purpose: using biosignals in a pilot study to detect the user's emotional state, CHI 98 conference summary on Human factors in computing systems, p.227-228, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286715]
• 20: Penelope Sweetser , Peta Wyeth, GameFlow: a model for evaluating player enjoyment in games, Computers in Entertainment (CIE), v.3 n.3, July 2005 [doi>10.1145/1077246.1077253]
• 21: Jonathan Sykes , Simon Brown, Affective gaming: measuring emotion through the gamepad, CHI '03 extended abstracts on Human factors in computing systems, April 05-10, 2003, Ft. Lauderdale, Florida, USA [doi>10.1145/765891.765957]
• 22: Tassinary, L.G., Cacioppo, J.T., and Geen, T.R. A psychometric study of surface electrode placements for facial EMG recording: I. The brow and cheek muscle regions. Psychophysiology 26, (1989), 1--16.
• 23: Waterink, W., and Van Boxtel, A. Facial and jaw-elevator EMG activity in relation to changes in performance level during a sustained information task. Biological Psychology, 37, (1994), 183--198.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Additional Classification:
  K. Computing Milieux
  K.8 PERSONAL COMPUTING
      K.8.0 General

Keywords:
affect, evaluation methods, games, physiological measurements, testing children