Emotions and heart rate while sitting on a chair

ABSTRACT

New methods for unobtrusive monitoring of computer users' emotion psychophysiology are very much needed in human-computer interaction research. The present aim was to study heart rate changes during emotionally provocative stimulation. Six-second long auditory, visual, and audiovisual emotionally negative, neutral, and positive stimuli were presented to 24 participants. Heart rate responses were measured with a regular office chair embedded with electromechanical film (the EMFi chair) and with traditional earlobe photoplethysmography (PPG). Ratings of the stimuli were also collected. The results showed that the two heart rate measurements were significantly correlated, r = 0.99. In line with other studies the results showed that, in general, heart rate decelerated in response to emotional stimulation and it decelerated the most in response to negative stimuli as compared with responses to positive and neutral stimuli. Especially, emotional stimulation caused significant changes in heart rate at the 6th second from the stimulus onset. We suggest that the EMFi chair could be used in human-computer interaction for unobtrusive measurement of the user's emotional reactions.

REFERENCES

• 1: Jennifer Allanson, Electrophysiologically Interactive Computer Systems, Computer, v.35 n.3, p.60-65, March 2002 [doi>10.1109/2.989931]
• 2: Aula, A. and Surakka, V. (2002). Auditory Emotional Feedback Facilitates Human-Computer Interaction. Proc. HCI 2002, Springer-Verlag, 337--349.
• 3: Bradley, M. M., Cuthbert, B. N., and Lang, P. J. (1996). Picture media and emotion: effects of a sustained affective context. Psychophysiology, 33, 662--670.
• 4: Bradley, M. M. and Lang, P. J. (1994). Measuring emotion: the self-assessment manikin and the semantic differential. Journal of Behaviol Therapy and Experimental Psychiatry, 25, 1, 49--59.
• 5: Bradley, M. M. and Lang, P. J. (1999). The international affective digitized sounds (IADS): stimuli, instruction manual and affective ratings. Technical Report B-2, The Center for Research in Psychophysiology, University of Florida.
• 6: Bradley, M. M. and Lang, P. J. (2000). Affective reactions to acoustic stimuli. Psychophysiology, 37, 204--215.
• 7: Brosschot, J. F. and Thayer, J. F. (2003). Heart rate response is longer after negative emotions than after positive emotions. International Journal of Psychophysiology, 50, 3, 181--187.
• 8: Caccioppo, J. T., Berntson, G. G., Larsen, J. T., Poehlmann, K. M., and Ito, T. A. (2000). The Psychophysiology of Emotion. In Lewis, M. and Haviland, J. M. (eds.). Handbook of Emotions (pp. 173-191), 2nd Edition. The Guilford Press, New York.
• 9: Davidson, R. J. (2003). Seven sins in the study of emotion: correctives from affective neuroscience. Brain and Cognition, 52, 129--132.
• 10: Davidson, R. J. and Cacioppo, J. T. (1992). New developments in the scientific study of emotion: an introduction to the special section. Psychological Science, 3, 1, 21--22.
• 11: Harland, C. J., Clark, T. D., and Prance, R. J. (2002). Electric potential probes - new directions in the remote sensing of the human body. Measurement Science and Technology, 13, 163--169.
• 12: Isen, A. M., Daubman, K. A., and Nowicki, G. P. (1987). Positive affect facilitates creative problem solving. Journal of Personality and Social Psychology, 52, 6, 1122--1131.
• 13: Kapoor, A., Mota, S., and Picard, R. W. (2001). Towards a Learning Companion that Recognizes Affect. Proc. Emotional and Intelligent II: The Tangled Knot of Social Cognition, AAAI Fall Symposium 2001.
• 14: Klein, J., Moon, Y., and Picard, R. W. (2002). This computer responds to user frustration: theory, design and results. Interacting with computers, 14, 119--140.
• 15: Lang, P. J., Bradley. M.M., and Cuthbert, B.N. (1992). A motivational analysis of emotion: Reflex-cortex connections. Psychological Science, 3, 1, 44--49.
• 16: Lang, P. J., Bradley. M.M., and Cuthbert, B.N. (1999). International Affective Picture System (IAPS): instruction manual and affective ratings. Technical Report A-4, The Center for Research in Psychophysiology, University of Florida.
• 17: Clifford Nass , Jonathan Steuer , Ellen R. Tauber, Computers are social actors, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.72-78, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191703]
• 18: Don Norman, Emotion & design: attractive things work better, interactions, v.9 n.4, p.36-42, July 2002 [doi>10.1145/543434.543435]
• 19: Paajanen, M., Lekkala, J., and Kirjavainen, K. (2000) ElectroMechanical Film (EMFi) - a new multipurpose electret material. Sensors and Actuators, 84, 95--102.
• 20: Palomba D., Angrilli A., and Mini A. (1997). Visual evoked potentials, heart rate responses and memory to emotional pictorial stimuli. International Journal of Psychophysiology, 27, 1, 55--67.
• 21: Partala, T., Aula, A., and Surakka, V. (2001). Combined Voluntary Gaze Direction and Facial Muscle Activity as a New Pointing Technique. Proc. INTERACT 2001, IOS Press, 100--107.
• 22: Partala, T. and Surakka, V. (2004). The effects of affective interventions in human-computer interaction. Interacting with Computers, 16, 2, 295--309.
• 23: Timo Partala , Veikko Surakka , Toni Vanhala, Person-independent estimation of emotional experiences from facial expressions, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA [doi>10.1145/1040830.1040883]
• 24: Rosalind W. Picard, Affective computing, MIT Press, Cambridge, MA, 1997
• 25: Picard, R. W. and Healey, J. (1997). Affective Wearables. Personal Technologies, 1, 4, 231--240.
• 26: Rosalind W. Picard , Elias Vyzas , Jennifer Healey, Toward Machine Emotional Intelligence: Analysis of Affective Physiological State, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.10, p.1175-1191, October 2001 [doi>10.1109/34.954607]
• 27: Byron Reeves , Clifford Nass, The media equation: how people treat computers, television, and new media like real people and places, Cambridge University Press, New York, NY, 1996
• 28: Scheirer, J., Fernandez, R., Klein, J., and Picard, R. W. (2002). Frustrating the user on purpose: a step toward building an affective computer. Interacting with computers, 14, 2, 93--118.
• 29: Schneider, W., Eschman, A., and Zuccolotto, A. (2002). E-Prime User's Guide. Psychology Software Tools, Inc, Pittsburgh.
• 30: Schulkin, J., Thompson, B. L., and Rosen, J. B. (2003). Demythologizing the emotions: adaptation, cognition, and visceral representations of emotion in the nervous system. Brain and Cognition, 52, 15--23.
• 31: Surakka, V. (2005). Socially and emotionally significant human-computer interaction. To appear in Kappas, A. (ed.). Multi-channel communication on the Internet. Cambridge University Press, New York.
• 32: Veikko Surakka , Marko Illi , Poika Isokoski, Gazing and frowning as a new human--computer interaction technique, ACM Transactions on Applied Perception (TAP), v.1 n.1, p.40-56, July 2004 [doi>10.1145/1008722.1008726]
• 33: Matthew Turk , George Robertson, Perceptual user interfaces (introduction), Communications of the ACM, v.43 n.3, p.32-34, March 2000 [doi>10.1145/330534.330535]
• 34: Zajonc, R. B. (1980) Feeling and thinking: preferences need no inferences. American Psychologist, 35, 151--175.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.m Miscellaneous

Keywords:
affective computing, emotion, human-computer interaction, physiological user interfaces, psychophysiology, wireless monitoring