Multimodal affective driver interfaces for future cars

ABSTRACT

In this paper, we uncover a new potential application for multimedia technologies: car interfaces for enhanced driver's safety. We also describe the experiment we conducted in order to map certain physiological signals (galvanic skin response, heart beat, and temperature) to certain emotions (Neutral, Anger, Fear, Sadness, and Frustration). We demonstrate the results we gained and describe how we use these results to our Multimodal Affective Driver Interface for the drivers of the future cars.

REFERENCES

• 1: Wendy S. Ark , D. Christopher Dryer , Davia J. Lu, The Emotion Mouse, Proceedings of HCI International (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Ergonomics and User Interfaces-Volume I, p.818-823, August 22-26, 1999
• 2: BodyMedia Inc. <u>www.bodymedia.com</u>
• 3: Ekman P., Levenson R.W., and Friesen. W.V. Autonomic Nervous System Activity Distinguishes Between Emotions. Science, 221 (4616): 1208--1210, 1983.
• 4: Gross, J. J. and Levenson, R. W. Hiding Feelings: The Acute Effects of Inhibiting Negative and Positive Emotions. Journal of Abnormal Psychology, 106 (1): 95--103, 1997.
• 5: <u>www.haptek.com</u>
• 6: SmartCar: Detecting Driver Stress, Proceedings of the International Conference on Pattern Recognition, p.4218, September 03-08, 2000
• 7: James, L. Road Rage and Aggressive Driving. Amherst, NY: Prometheus Books, 2000.
• 8: Levenson, R.W., Ekman, P., and Friesen, W.V. Voluntary Facial Action Generates Emotion-Specific Autonomic Nervous System Activity. Psychophysiology, 27 (4): 363--384, July 1990.
• 9: Lewin, D. I. Smart cars in peace and war. IEEE Intelligent Systems & Their Applications, 16 (3): 4--6 May - June 2001.
• 10: Lisetti, C. L. MOUE: Building a Model of user's Emotions. To appear in AI Communications - The European Artificial Intelligence Journal.
• 11: Christine L. Lisetti , Fatma Nasoz, MAUI: a multimodal affective user interface, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641038]
• 12: Maybury, M.T. Human Computer Interaction: State of the Art and Further Development in the International Context - North America. Invited Talk. International Status Conference on MTI Program. saarbruecken, Germany 26--27 October 2001.
• 13: Rosalind W. Picard , Elias Vyzas , Jennifer Healey, Toward Machine Emotional Intelligence: Analysis of Affective Physiological State, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.10, p.1175-1191, October 2001 [doi>10.1109/34.954607]
• 14: Sinha, R. and Parsons, O. Multivariate Response Patterning of Fear and Anger. Cognition and Emotion, 10 (2): 173--198, 1996.
• 15: Vrana, S. The Psychophysiology of Disgust: Differentiating Negative Emotional Contexts with Facial EMG. Psychophysiology, 30 (3): 279--286, May 1993.

INDEX TERMS

General Terms:
Algorithms, Design, Experimentation, Human Factors, Measurement

Keywords:
drivers' safety, emotions, multi-modal affective intelligent interfaces, wearable computers