MobiLenin combining a multi-track music video, personal mobile phones and a public display into multi-user interactive entertainment

ABSTRACT

This paper introduces a novel and creative approach for coupling multimedia art with a non-conventional distributed human-computer interface for multi-user interactive entertainment. The proposed MobiLenin system allows a group of people to interact simultaneously with a multi-track music video shown on a large public display using their personal mobile phones, effectively empowering the group with the joint authorship of the video. The system is realized with a client-server architecture which includes server-driven real-time control of the client UI to guarantee ease of use and a lottery mechanism as an incentive for interaction. Our analysis of the findings of an empirical user evaluation conducted in a true environment of use shows that the MobiLenin system is successful, addressing many of the challenges identified in the literature. The proposed system offers a new form of interactive entertainment for pubs and other public places, and the underlying architecture provides a framework for realizing similar installations with different types of multimedia content.

REFERENCES

• 1: Adams, M. and Moussouri, T. The interactive experience: Linking research and practice. In Proceedings of International Conference on Interactive Learning in Museums of Art and Design. Victoria and Albert Museum, London, 2002.
• 2: Agamanolis, S. Designing Displays for Human Connectedness. In O'Hara, K., Perry, M., Churchill, E. and Russell, D. (eds), Public and situated displays: Social and interactional aspects of shared display technologies, Kluwer, 2003.
• 3: Brignull, H. and Rogers, Y. Enticing People to Interact with Large Public Displays in Public Spaces. In Proceedings of INTERACT'03 (Znrich, Switzerland, Sep. 2003), 17--24.
• 4: Harry Brignull , Shahram Izadi , Geraldine Fitzpatrick , Yvonne Rogers , Tom Rodden, The introduction of a shared interactive surface into a communal space, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031616]
• 5: Antonio Camurri , Gualtiero Volpe , Giovanni De Poli , Marc Leman, Communicating Expressiveness and Affect in Multimodal Interactive Systems, IEEE MultiMedia, v.12 n.1, p.43-53, January 2005 [doi>10.1109/MMUL.2005.2]
• 6: Elizabeth F. Churchill , Les Nelson , Laurent Denoue , Jonathan Helfman , Paul Murphy, Sharing multimedia content with interactive public displays: a case study, Proceedings of the 2004 conference on Designing interactive systems: processes, practices, methods, and techniques, August 01-04, 2004, Cambridge, MA, USA [doi>10.1145/1013115.1013119]
• 7: Churchill, E. F., Nelson, L. and Denoue, L. Designing digital bulletin boards for social networking. In Proceedings of Workshop on Public, Community and Situated Displays at CSCW '02 (New Orleans, LA, Nov. 2002).
• 8: Elizabeth F. Churchill , Les Nelson , Laurent Denoue, Multimedia fliers: information sharing with digital community bulletin boards, Communities and technologies, Kluwer, B.V., Deventer, The Netherlands, 2003
• 9: Carpenter, L. Cinematrix, Video Imaging Method and Apparatus for Audience Participation. US Patents #5210604 (1993) and #5365266 (1994).
• 10: Carsten Magerkurth , Timo Engelke , Maral Memisoglu, Augmenting the virtual domain with physical and social elements: towards a paradigm shift in computer entertainment technology, Computers in Entertainment (CIE), v.2 n.4, October 2004 [doi>10.1145/1037851.1037870]
• 11: Tony Manninen, Contextual Virtual Interaction as Part of Ubiquitous Game Design and Development, Personal and Ubiquitous Computing, v.6 n.5-6, p.390-406, December 2002 [doi>10.1007/s007790200044]
• 12: Techniques for Interactive Audience Participation, Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p.15, October 14-16, 2002 [doi>10.1109/ICMI.2002.1166962]
• 13: McCarthy, J. Using Public Displays to Create Conversation Opportunities. In Proceedings of Workshop on Public, Community, and Situated Displays at CSCW'02 (New Orleans, LA, Nov. 2002).
• 14: O'Hara, K., Perry, M., Churchill, E.F. and Russell, D. Public and Situated Displays. Kluwer, 2003.
• 15: Tim Paek , Maneesh Agrawala , Sumit Basu , Steve Drucker , Trausti Kristjansson , Ron Logan , Kentaro Toyama , Andy Wilson, Toward universal mobile interaction for shared displays, Proceedings of the 2004 ACM conference on Computer supported cooperative work, November 06-10, 2004, Chicago, Illinois, USA [doi>10.1145/1031607.1031649]
• 16: Josephine Reid , Jenny Hyams , Kate Shaw , Mathew Lipson, "Fancy a Schmink?": a novel networked game in a cafe, Computers in Entertainment (CIE), v.2 n.3, July 2004 [doi>10.1145/1027154.1027173]
• 17: Stuart Reeves , Steve Benford , Claire O'Malley , Mike Fraser, Designing the spectator experience, Proceedings of the SIGCHI conference on Human factors in computing systems, April 02-07, 2005, Portland, Oregon, USA [doi>10.1145/1054972.1055074]
• 18: Rogers, Y. and Lindley, S. Collaborating around vertical and horizontal large displays: Which way is best? Interacting with Computer, 16 (2004), 1133--152.
• 19: Daniel M. Russell , Rich Gossweiler, On the Design of Personal & Communal Large Information Scale Appliances, Proceedings of the 3rd international conference on Ubiquitous Computing, p.354-361, September 30-October 02, 2001, Atlanta, Georgia, USA
• 20: Ryan, M. Narrative as Virtual Reality. Johns Hopkins University Press, 2001.
• 21: Daniel J. Sandin, Digital illusion, virtual reality, and cinema, Digital illusion: entertaining the future with high technology, ACM Press/Addison-Wesley Publishing Co., New York, NY, 1998
• 22: Tosa, N. Expression of emotion, unconsciousness with art and technology. In G. Hatano, N. Okada, and H. Tanabe (eds), Affective Minds. Elsevier, 2000, 183--201.
• 23: Daniel Vogel , Ravin Balakrishnan, Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users, Proceedings of the 17th annual ACM symposium on User interface software and technology, October 24-27, 2004, Santa Fe, NM, USA [doi>10.1145/1029632.1029656]
• 24: Bruce A. Epstein, Lingo in a Nutshell: A Desktop Quick Reference, O'Reilly & Associates, Inc., Sebastopol, CA, 1998

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology; Interaction styles (e.g., commands, menus, forms, direct manipulation); Input devices and strategies (e.g., mouse, touchscreen)
      H.5.3 Group and Organization Interfaces
          Subjects: Collaborative computing; Computer-supported cooperative work; Evaluation/methodology

General Terms:
Design, Experimentation, Human Factors

Keywords:
experimental evaluation, hybrid interfaces, multimedia art