Measurement of user frustration: a biologic approach

ABSTRACT

This paper describes the use of facial EMG to provide a continuous measure of the user's emotional state. Facial EMG was recorded while female users performed five tasks to one of two web sites. Frustration index scores were developed from the corrugator EMG data by calculating a percentage score of a pre-task baseline. As predicted, the frustration index was greater for (1) novices as compared to experienced users, (2) incorrect as compared to correct answered tasks, and (3) for the web site that was rated more difficult. The frustration index was able to provide important information on web page performance.

REFERENCES

• 1: Ceaparu, I., Lazar, J., Bessiere, K., Robinson, J. & Shneiderman, B. Determining Causes and Severity of User Frustration. (Submitted for Publication).
• 2: Jocelyn Riseberg , Jonathan Klein , Raul Fernandez , Rosalind W. Picard, Frustrating the user on purpose: using biosignals in a pilot study to detect the user's emotional state, CHI 98 conference summary on Human factors in computing systems, p.227-228, April 18-23, 1998, Los Angeles, California, United States [doi>10.1145/286498.286715]
• 3: Hazlett, R.L., McLeod, D.M., & Hoehn-Saric, R. Muscle tension in generalized anxiety disorder: Elevated muscle tonus or agitated movement? Psychophysiology, 31, (1994), 189--195.
• 4: Cacioppo, J.T., Bush L.K., & Tassinary, L.G. Microexpressive facial actions as a function of affective stimuli: Replication and extension. Psychological Science, 18, (1992), 515--526.
• 5: Hazlett, R.L., & Hoehn-Saric, R. Effects of perceived physical attractiveness on female's facial displays and affect. Evolution and Human Behavior. 21, (2000), 49--57.
• 6: Pope, L.K. & Smith, C.A. On the distinct meanings of smiles and frowns. Cognition and Emotion, 8, (1994), 65--72.
• 7: Waterink, W., & Van Boxtel, A. Facial and jaw-elevator EMG activity in relation to changes in performance level during a sustained information task. Biological Psychology, 37, (1994), 183--198.
• 8: Hazlett, R.L., Hazlett, S.Y. Emotional response to television commercials: Facial EMG vs. self-report. Journal of Advertising Research, 39, (1999), 7--23.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
analysis methods (e.g. task/interaction modeling), e-Commerce, emotion and affective UI, usability testing and evaluation