Emotion sharing via self-composed melodies on mobile phones

ABSTRACT

In their role as personal communication devices, mobile phones are a natural choice for sharing and communicating emotions. However, their functionalities are currently very limited in power to express affective messages. In this paper, we describe the design of a system that allows users to easily compose melodies and share them via mobile phones. We show that by using these melodies information about the current emotional state of the sender can be expressed and recognized synchronously by the receiver in a simple, quick, and unobtrusive way. Further, we reveal that self-composed melodies have a stronger impact than pre-composed or downloaded messages, similar to crafted pieces of art offered to a beloved person. We then present findings from a user study that assesses the implementation of a functional prototype and the adequacy of the system for emotional communication.

REFERENCES

• 1: Brave, S., Ishii, H., and Dahley, A. 1998. Tangible interfaces for remote collaboration and communication. In Proc. CSCW 1998. New York, 169--178.
• 2: Byrne, R. and Findlay, B. Preference for SMS versus Telephone Calls in Initiating Romantic Relationships. Australian Journal of Emerging Technologies and Society, Issue 2, 2004
• 3: Chang, A., Resner, B., Koerner, B., Wang, X., Ishii, H. LumiTouch: an emotional communication device. In Proc. CHI 2001, Seattle, 313--314.
• 4: Chung, H., Lee, C-H., and Selker, T. Lovers' Cup: Drinking interfaces as new communication channels. In Proc. CHI 2006, 375--380.
• 5: Goodman, E. & Misilim, M. The Sensing Bed. In Proc. Ubi-Comp 2003 Workshop.
• 6: Grinter, R. E. and Eldrige, M. A. Y Do Tngrs Luv 2 Txt Msg? Proc. ECSCW '01, Kluwer Academic, 2001, 219--238.
• 7: King, S. and Forlizzi, J. Slow messaging: Intimate communications for couples living at a distance. In Proc. DPPI 2007, 451--454.
• 8: Nettamo, E., Nirhamo, M., Häkkilä, J. A Cross-Cultural Study of Mobile Music -- Retrieval, Management and Consumption. In Proc. OZCHI, 2006, 87--94.
• 9: Ventä, L., Ahtinen, A., Ramiah, S., Isomursu, M. "My phone is a part of my soul" - How People Bond with Their Mobile Phones. In Proc. UBICOMM 2008.
• 10: Voida, A., Grinter, R. E., Ducheneaut, N., Edwards, W. K., Newman, M. W. In: Practices Surrounding iTunes Music Sharing. In Proc. CHI 2005, 191--200.
• 11: Werner, J., Wettach, R., Hornecker, E. United-Pulse: feeling your partner's pulse: In Proc. MobileHCI 2008, 535--538.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.3 Communications Applications

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design, Experimentation, Human Factors

Keywords:
composer, emotion sharing, mobile phone, synchronous