Adaptation of scalable multimedia documents

ABSTRACT

Several scalable media codecs have been standardized in recent years to cope with heterogeneous usage conditions and to aim at always providing audio, video and image content in the best possible quality. Today, interactive multimedia presentations are becoming accessible on handheld terminals and face the same adaptation challenges as the media elements they present: quite diversified screen, memory and processing power capabilities. In this paper, we address the adaptation of multimedia documents by applying the concept of scalability to their presentation.

The Scalable MSTI document model introduced in this paper has been designed with two main requirements in mind. First, the adaptation process must be simple to execute because it may be performed on limited terminals in broadcast scenarios. Second, the adaptation process must be simple to describe so that authored adaptation directives can be transported along with the document with a limited bandwidth overhead. The Scalable MSTI model achieves both objectives by specifying Spatial, Temporal and Interactive scalability axes on which incremental authoring can be performed to create progressive presentation layers.

Our experiments are conducted on scalable multimedia documents designed for Digital Radio services on DMB channels using MPEG-4 BIFS and also for web services using XHTML, SVG, SMIL and Flash. A scalable image gallery is described throughout this article and illustrates the features offered by our document model in a rich multimedia example.

REFERENCES

• 1: A. Vetro, C. Christopoulos, T. Ebrahimi, eds., Special Issue on Universal Multimedia Access, IEEE Signal Processing Magazine, vol. 20, no. 2, March 2003.
• 2: W. Li, Overview of Fine Granularity Scalability in MPEG-4 Video Standard, IEEE Trans. on Circuit Systems for Video Technology, vol. 11, no. 3, pp. 301--317, March 2001.
• 3: H. Schwarz, D. Marpe, T. Wiegand, Overview of the Scalable Video Coding Extension of the H.264/AVC Standard, IEEE Trans. on Circuit Systems for Video Technology, vol. 17, no. 9, pp. 1103--1120, Sept. 2007.
• 4: B. Pellan , C. Concolato, Media-Driven Dynamic Scene Adaptation, Proceedings of the Eight International Workshop on Image Analysis for Multimedia Interactive Services, p.67, June 06-08, 2007 [doi>10.1109/WIAMIS.2007.56]
• 5: L. Villard, C. Roisin, N. Layaïda, A XML-based Multimedia Document Processing Model for Content Adaptation, Digital Documents and Electronic Publishing, LNCS 2023, Springer Verlag, pp.104--119, Sept. 2000.
• 6: Susanne Boll , Wolfgang Klas, ZYX-A Multimedia Document Model for Reuse and Adaptation of Multimedia Content, IEEE Transactions on Knowledge and Data Engineering, v.13 n.3, p.361-382, May 2001 [doi>10.1109/69.929895]
• 7: M. Bilasco, J. Gensel, M. Villanova-Oliver, STAMP: A Model for Generating Adaptable Multimedia Presentations, Multimedia Tools and Applications, Springer Netherlands, vol. 25, no. 3, pp. 361--375, March 2005.
• 8: O. Andersson, R. Berjon, E. Dahlström et al., Scalable Vector Graphics (SVG) Tiny 1.2 Specification, W3C, http://www.w3.org/TR/SVGMobile12, Aug. 2006.
• 9: D. Bulterman, G. Grassel, J. Jansen et al., Synchronized Multimedia Intergration Language (SMIL 2.1), W3C, http://www.w3.org/TR/SMIL, Dec 2005.
• 10: ISO/IEC 14496--11:2005, Information technology - Coding of audio-visual objects - Part 11: Scene description and application engine, 2005.
• 11: Marc Nanard , Jocelyne Nanard , Peter R. King , Ludovic Gaillard, Genre driven multimedia document production by means of incremental transformation, Proceedings of the 2007 ACM symposium on Document engineering, August 28-31, 2007, Winnipeg, Manitoba, Canada [doi>10.1145/1284420.1284452]
• 12: A. Scherp, S. Boll, MM4U: A Framework for Creating Personalized Multimedia Content, Managing Multimedia Semantics, IRM Press, pp. 246--287, Feb. 2005.
• 13: Kim Marriott , Bernd Meyer , Laurent Tardif, Fast and efficient client-side adaptivity for SVG, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511510]
• 14: Pierre Dragicevic , Stéphane Chatty , David Thevenin , Jean-Luc Vinot, Artistic resizing: a technique for rich scale-sensitive vector graphics, Proceedings of the 18th annual ACM symposium on User interface software and technology, October 23-26, 2005, Seattle, WA, USA [doi>10.1145/1095034.1095069]
• 15: Gwenael Durand , Gabriella Kazai , Mounia Lalmas , Uwe Rauschenbach , Patrick Wolf, A Metadata Model Supporting Scalable Interactive TV Services, Proceedings of the 11th International Multimedia Modelling Conference, p.386-391, January 12-14, 2005 [doi>10.1109/MMMC.2005.11]
• 16: Dick C. A. Bulterman , Lynda Hardman, Structured multimedia authoring, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), v.1 n.1, p.89-109, February 2005 [doi>10.1145/1047936.1047943]
• 17: P. Vuorimaa, D. Bulterman, P. Cesar, SMIL Timesheets 1.0, W3C, http://www.w3.org/TR/timesheets, Jan. 2008.
• 18: J. Marsh, D. Veillard, N. Walsh, xml:id Version 1.0, W3C, http://www.w3.org/TR/xml-id, Sept. 2005.
• 19: J. Clark, S. DeRose, XML Path Language (XPath), W3C, http://www.w3.org/TR/xpath, Nov. 1999.
• 20: R. Berjon, Remote Events for XML (REX) 1.0, W3C, http://www.w3.org/TR/rex, Oct. 2006.
• 21: H.W. Lie, T. Celik, D. Glazman, Media Queries, W3C, http://www.w3.org/TR/css3-mediaqueries, June 2007.
• 22: C. Kiss, Composite Capability/Preference Profiles (CC/PP): Structure and Vocabularies 2.0, W3C, http://www.w3.org/TR/CCPP-struct-vocab2, April 2007.
• 23: B. Pellan and C. Concolato, Spatial Scene Adaptation in Broadcast Environment, Proc. of the International Conference on Multimedia & Expo (ICME), pp. 389--392, Hannover, Germany, June 2008.
• 24: M. Ransburg, R. Cazoulat, B. Pellan, C. Concolato et al., Dynamic and Distributed Adaptation of Scalable Multimedia Content in a Context-Aware Environment, Proc. of EuMob, Alghero, Italy, Sept. 2006.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.2 Document Preparation
          Subjects: Languages and systems

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.2 Document Preparation
          Subjects: Multi/mixed media

General Terms:
Algorithms, Design, Languages

Keywords:
document adaptation, document model, multimedia scalability