An affective model of user experience for interactive art

ABSTRACT

The development of Affective Interface technologies makes it possible to envision a new generation of Digital Arts and Entertainment applications, in which interaction will be based directly on the analysis of user experience. In this paper, we describe an approach to the development of Multimodal Affective Interfaces that supports real-time analysis of user experience as part of an Augmented Reality Art installation. The system relies on a PAD dimensional model of emotion to support the fusion of affective modalities, each input modality being represented as a PAD vector. A further advantage of the PAD model is that it can support a representation of affective responses that relate to aesthetic impressions.

REFERENCES

• 1: Sharma, R. Pavlovic, V. I. Huang, T. S. 1998. Toward multimodal human-computer interface. Proceedings of the IEEE. Vol. 86(5), pp. 853--869.
• 2: Mehrabian, A. 1995. Framework for a comprehensive description and measurement of emotional states. Genetic, Social, and General Psychology Monographs, 121, 339--361.
• 3: Russell, J. A. 1980. A circumplex model of affect. Journal of personality and social psychology, 39, 1161--1178
• 4: Watson, D., Clark, L. A., & Tellegen, A. 1988. Development and validation of brief measures of Positive and Negative Affect: The PANAS Scales. Journal of personality and social psychology, 54, 1063--1070
• 5: Barrett, L. F. 1998. Independence and bipolarity in the structure of current affect. Journal of personality and social psychology, 74, 967--984
• 6: Mehrabian, A. 1996. Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament. Current Psychology: Developmental, Learning, Personality, Social, 14, 261--292
• 7: Porat, T., Liss, R., Tractinsky, N., 2007. E-Stores Design: Influence of E-Store Design and Product type on consumers' emotions and attitudes. 12th International Conference, HCI International 2007, Beijing, China, July 22--27, 2007, Proceedings, Part IV, LNCS 4553, pp. 712--721. Springer-Verlag.
• 8: Helfenstein, S. 2005. Product Meaning, Affective use and Transfer. Human Technology, 1. pp. 76--100, April 2005.
• 9: Becker, C., Kopp, S., Wachsmuth, I., 2004. Simulating the Emotion Dynamics of a Multimodal Conversational Agent. Affective Dialogue Systems. Tutorial and Research Workshop, ADS 2004, Kloster Irsee, Germany, June 14--16, 2004. Proceedings. LNCS 3068, pp. 154--165. Springer-Verlag.
• 10: Becker, C. Wachsmuth, I. 2006. Modeling Primary and Secondary Emotions for a Believable Communication Agent. International Workshop on Emotion and Computing, in conj. with the 29th annual German Conference on Artificial Intelligenz (KI2006), Bremen, Germany, pp 31--34, 2006.
• 11: J. Looser, R. Grasset, H. Seichter, M. Billinghurst. 2006. OSGART-A Pragmatic Approach to MR. In Industrial Workshop at ISMAR 2006, Santa Barbara, California, USA, October, 2006.
• 12: Hirokazu Kato , Mark Billinghurst, Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System, Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, p.85, October 20-21, 1999
• 13: Don Burns , Robert Osfield, Open Scene Graph A: Introduction, B: Examples and Applications, Proceedings of the IEEE Virtual Reality 2004, p.265, March 27-31, 2004 [doi>10.1109/VR.2004.57]
• 14: Fred Charles , Marc Cavazza , Steven J. Mead , Olivier Martin , Alok Nandi , Xavier Marichal, Compelling experiences in mixed reality interactive storytelling, Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, p.32-40, June 03-05, 2005, Singapore [doi>10.1145/1067343.1067347]
• 15: Fiala, M., 2007. Magic Mirror System with Hand-held and Wearable Augmentations, IEEE Virtual Reality Conference, 10--14 March 2007, pp. 251--254.
• 16: Przemyslaw Prusinkiewicz , Aristid Lindenmayer, The algorithmic beauty of plants, Springer-Verlag New York, Inc., New York, NY, 1996
• 17: J. A. Russell. 1989. Measures of Emotion. In Emotion: Theory, Research and Experience, ch. 4, pp. 83--111. Academic Press, Inc.
• 18: Popper, F. 2007. From Technological to Virtual Art. Cambridge (Mass.), MIT Press.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

General Terms:
Design, Theory

Keywords:
affective computing, augmented reality, interactive art, multimodal interaction