Interaction and user experiences with multimedia technologies: challenges and future topics

ABSTRACT

In this paper, we investigate future topics and challenges of interaction and user experience in multimedia We bring together different perspectives from overlapping fields of research such as multimedia, human-computer interaction, information retrieval, networked multimedia, and creative arts. Based on potential intersections, we define three application domains to be investigated further, as they create high demand and good prospect for long-lasting developments in the future. These application domains are: media working environments, media enter-/edutainment, and social media engagement. Each application domain is analyzed along five dimensions, namely: information quality, presentation quality, ambience, interactivity, and user expectations. Based on this analysis, we identify the most pressing research questions and key challenges for each area. Finally, we advocate a user-centered approach to tackle these challenges and questions in order to develop relevant multimedia applications that best meet the users' expectations.

REFERENCES

• 1: S. Bocconi. Vox Populi: generating video documentaries from semantically annotated media repositories. PhD thesis, Technical University Eindhoven, Netherlands, 2006. Retrieved July 21, 2008, from http://www.di.unito.it/~sbocconi/CWI/Work/ Thesis/thesis.pdf.
• 2: Peter Brusilovsky , Mark T. Maybury, From adaptive hypermedia to the adaptive web, Communications of the ACM, v.45 n.5, May 2002 [doi>10.1145/506218.506239]
• 3: A. K. Dey and G. D. Abowd. Towards a Better Understanding of Context and Context-Awareness. Technical Report GIT-GVU-99-22, Graphics, Visualization and Usability Center and College of Computing, Georgia Institute of Technology, Atlanta, GA, USA, June 1999.
• 4: A. Ernevi, D. Eriksson, M. Jacobs, U. Löfgren, R. Mazé, J. Redström, J. Thoresson, and L. W. Worbin. Tic tac textiles. In J. Redström, M. Redström, and R. Mazé, editors, IT+Textiles. IT Press/Edita Publishing, Helsinki, Finland, 2005.
• 5: Josef Fink , Alfred Kobsa , Jörg Schreck, Personalized Hypermedia Information Provision Through Adaptive and Adaptable System Features: User Modelling, Privacy and Security Issues, Proceedings of the Fourth International Conference on Intelligence and Services in Networks: Technology for Cooperative Competition, p.459-467, May 27-29, 1997
• 6: Matthias Grossmann , Martin Bauer , Nicola Honle , Uwe-Philipp Kappeler , Daniela Nicklas , Thomas Schwarz, Efficiently Managing Context Information for Large-Scale Scenarios, Proceedings of the Third IEEE International Conference on Pervasive Computing and Communications, p.331-340, March 08-12, 2005 [doi>10.1109/PERCOM.2005.17]
• 7: L. Hallnäs and J. Redström. Interaction design : foundations, experiments. University College of Borås, University College of Borås, Swedish School of Textiles, Borås, Sweden, 2006. Retrieved July 16, 2008, from http://hdl.handle.net/2320/1554.
• 8: Lynda Hardman, Canonical processes of media production, Proceedings of the ACM workshop on Multimedia for human communication: from capture to convey, November 11-11, 2005, Hilton, Singapore [doi>10.1145/1099376.1099378]
• 9: L. Hardman, Z. Obrenovic, F. Nack, B. Kerherve, and K. Piersol. Canonical processes of semantically annotated media production. Special issue of the Multimedia Systems Journal on Canonical Process of Media Production, 2008.
• 10: M. A. Hearst. Design recommendations for hierarchical faceted search interfaces. In A. Z. Broder and Y. S. Maarek, editors, Proc. SIGIR 2006, Workshop on Faceted Search, pages 26--30, Aug. 2006.
• 12: Alejandro Jaimes , Daniel Gatica-Perez , Nicu Sebe , Thomas S. Huang, Guest Editors' Introduction: Human-Centered Computing--Toward a Human Revolution, Computer, v.40 n.5, p.30-34, May 2007 [doi>10.1109/MC.2007.169]
• 13: Alejandro Jaimes , Nicu Sebe , Daniel Gatica-Perez, Human-centered computing: a multimedia perspective, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180829]
• 14: Ramesh Jain, Experiential computing, Communications of the ACM, v.46 n.7, July 2003 [doi>10.1145/792704.792729]
• 15: Ramesh Jain , Pilho Kim , Zhao Li, Experiential meeting system, Proceedings of the 2003 ACM SIGMM workshop on Experiential telepresence, November 07, 2003, Berkeley, California [doi>10.1145/982484.982486]
• 16: Alfred Kobsa , Jürgen Koenemann , Wolfgang Pohl, Personalised hypermedia presentation techniques for improving online customer relationships, The Knowledge Engineering Review, v.16 n.2, p.111-155, March 2001 [doi>10.1017/S0269888901000108]
• 17: K. Munroe, B. Ludäscher, and Y. Papakonstantinou. BBQ: Blended Browsing and Querying of XML in a Lazy Mediator System. In Int. Conf. on Extending Database Technology, Mar. 2005.
• 18: F. Nack. From ontology-based semiosis to computational intelligence. In C. Dorai and S. Venkatesh, editors, Media computing - Computational media aesthetics, pages 159--196. Kluwer Academic Publishers, June 2002.
• 19: Frank Nack , Wolfgang Putz, Saying What it Means: Semi-Automated (News) Media Annotation, Multimedia Tools and Applications, v.22 n.3, p.263-302, March 2004 [doi>10.1023/B:MTAP.0000017031.26875.f7]
• 20: Philips Research. Philips HomeLab, 2008. Retrieved July 21, 2008, from http://www.research.philips.com/technologies/misc/homelab/.
• 21: Lawrence A. Rowe , Ramesh Jain, ACM SIGMM retreat report on future directions in multimedia research, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.1 n.1, p.3-13, February 2005 [doi>10.1145/1047936.1047938]
• 22: Ansgar Scherp , Ramesh Jain, Towards an ecosystem for semantics, Workshop on multimedia information retrieval on The many faces of multimedia semantics, p.3-12, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290067.1290069]
• 23: Ansgar Scherp , Ramesh Jain, Towards an ecosystem for semantics, Workshop on multimedia information retrieval on The many faces of multimedia semantics, p.3-12, September 28-28, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290067.1290069]
• 24: B. Schilit , N. Adams , R. Want, Context-Aware Computing Applications, Proceedings of the 1994 First Workshop on Mobile Computing Systems and Applications, p.85-90, December 08-09, 1994 [doi>10.1109/WMCSA.1994.16]
• 25: A. Schmidt, M. Beigl, and H.-W. Gellersen. There is more to context than location. Computers & Graphics, 23(6):893--901, 1999.
• 26: Semantic Web Challenge. Billion Triples Track, 2008. Retrieved July 21, 2008, from http://challenge.semanticweb.org/.
• 27: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972]
• 28: Utz Westermann , Ramesh Jain, {\rm E} - A Generic Event Model for Event-Centric Multimedia Data Management in eChronicle Applications, Proceedings of the 22nd International Conference on Data Engineering Workshops, p.106, April 03-07, 2006 [doi>10.1109/ICDEW.2006.1]
• 29: Utz Westermann , Ramesh Jain, Toward a Common Event Model for Multimedia Applications, IEEE MultiMedia, v.14 n.1, p.19-29, January 2007 [doi>10.1109/MMUL.2007.23]
• 30: Zhenyu Yang , Wanmin Wu , Klara Nahrstedt , Gregorij Kurillo , Ruzena Bajcsy, ViewCast: view dissemination and management for multi-party 3d tele-immersive environments, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291434]
• 31: Zhenyu Yang , Bin Yu , Wanmin Wu , Ross Diankov , Ruzena Bajscy, Collaborative dancing in tele-immersive environment, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180793]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.4 INFORMATION SYSTEMS APPLICATIONS
      H.4.m Miscellaneous

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Performance measures; Complexity measures

  J. Computer Applications
  J.m MISCELLANEOUS

General Terms:
Design, Human Factors, Measurement, Theory

Keywords:
creative arts, human-computer interaction, information retrieval, interaction, multimedia, networked multimedia, user experience