MobiToss: a novel gesture based interface for creating and sharing mobile multimedia art on large public displays

ABSTRACT

This paper presents MobiToss, a novel application for creating and sharing mobile multimedia art with an off-the-shelf mobile phone equipped with built-in accelerometer sensors allowing gesture control. The user first takes a photo or captures a video with the phone and then using a 'throwing' gesture transfers the clip onto a large public display for instant viewing and manipulation by tilting the phone in different directions. The system augments the user-created clip with other items such as music or brand labels and the encoded clip is automatically sent back to the phone as a personal artefact of the event. The clip is also uploaded to a dedicated community website for sharing the created multimedia art with others. MobiToss could be deployed e.g. in clubs, pubs and concerts as a participatory VJ-tool. In addition to the design the paper presents the results of a preliminary user evaluation, which highlight the novel art experience provided by MobiToss.

REFERENCES

• 1: Bertelsen, O. W., Petersen, M. G. and Pold S. (Eds.), 2004, Aesthetic Approaches to Human-Computer Interaction Proceedings of the NordiCHI 2004 Workshop.
• 2: Clay, A., Frey, T., Gutknecht, J. and Majoe, D. 2006, Motion Tracking Music with Mobile-Media Technology in Two Case Studies. In Proceedings of the International Symposium on Pervasive Computing and Applications 2006, 358--363.
• 3: ffmpeg: http://ffmpeg.mplayerhq.hu/.
• 4: Generation C. http://en.wikipedia.org/wiki/Generation_C.
• 5: Jitter: http://www.cycling74.com/products/jitter.
• 6: Juha Kela , Panu Korpipää , Jani Mäntyjärvi , Sanna Kallio , Giuseppe Savino , Luca Jozzo , Di Marca, Accelerometer-based gesture control for a design environment, Personal and Ubiquitous Computing, v.10 n.5, p.285-299, July 2006 [doi>10.1007/s00779-005-0033-8]
• 7: Majoe, D., Schubiger, S., Clay, A. and Arisona, S. M. 2007, SQEAK: A Mobile Multi Platform Phone and Networks Gesture Sensor. In Proceedings of the Pervasive Computing and Applications conference ICPCA 2007, 699--704.
• 8: Nintendo wii remote. http://wii.nintendo.com.
• 9: Scheible J., Tuulos V. 2007. Mobile Python - Rapid prototyping of applications on the mobile platform, John Wiley & Sons.
• 10: Using a mobile phone as a "Wii-like" controller for playing games on a large public display, International Journal of Computer Games Technology, v.2008 n.2, p.1-6, January 2008 [doi>10.1155/2008/539078]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation); Input devices and strategies (e.g., mouse, touchscreen)

General Terms:
Design, Experimentation, Human Factors

Keywords:
experimental evaluation, gesture control, interactive content, public display