A cross-media adaptation strategy for multimedia presentations

ABSTRACT

Adaptation techniques for multimedia presentations are mainly concerned with switching between different qualities of single media elements to reduce the data volume and by this to adapt to limited presentation resources. This kind of adaptation, however, is limited to an inherent lower bound, i.e., the lowest acceptable technical quality of the respective media type. To overcome this limitation, we propose cross-media adaptation in which the presentation alternatives can be media elements of different media type, even different fragments. Thereby, the alternatives can extremely vary in media type and data volume and this enormously widens the possibilities to efficiently adapt to the current presentation resources. However, the adapted presentation must still convey the same content as the original one, hence, the substitution of media elements and fragments must preserve the presentation semantics. Therefore, our cross-media adaptation strategy provides models for the automatic augmentation of multimedia documents by semantically equivalent presentation alternatives. Additionally, during presentation, substitution models enforce a semantically correct information flow in case of dynamic adaptation to varying presentation resources. The cross-media adaptation strategy allows for flexible reuse of multimedia content in many different environments and, at the same time, maintains a semantically correct information flow of the presentation.

REFERENCES

• 1: Susanne Boll , Wolfgang Klas, ZYX - A Semantic Model for Multimedia Documents and Presentations, Proceedings of the IFIP TC2/WG2.6 Eighth Working Conference on Database Semantics- Semantic Issues in Multimedia Systems, p.189-209, January 04-08, 1999
• 2: Susanne Boll , Wolfgang Klas, ZYX - A Semantic Model for Multimedia Documents and Presentations, Proceedings of the IFIP TC2/WG2.6 Eighth Working Conference on Database Semantics- Semantic Issues in Multimedia Systems, p.189-209, January 04-08, 1999
• 3: S. Boll, W. Klas, and U. Westermann. Multimedia Document Formats- Sealed Fate or Setting Out for New Shores? In Proc. ICMCS'99, volume 1, pages 604-610, Florence, Italy, June 1999.
• 4: Dick C. A. Bulterman, User-centered abstractions for adaptive hypermedia presentations, Proceedings of the sixth ACM international conference on Multimedia, p.247-256, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290778]
• 5: Dick C. A. Bulterman , Lloyd Rutledge , Lynda Hardman , Jacco van Ossenbruggen, Adaptive and Adaptible Semantics, Proceedings of the IFIP TC2/WG2.6 Eighth Working Conference on Database Semantics- Semantic Issues in Multimedia Systems, p.371-391, January 04-08, 1999
• 6: A Scalable Video-on-Demand Service for the Provision of VCR-Like Functions, Proceedings of the International Conference on Multimedia Computing and Systems, p.65, May 15-18, 1995 [doi>10.1109/MMCS.1995.484909]
• 7: M.-S. Chen , D. Kandlur , P. Yu, Support for fully interactive playout in disk-array-based video server, Proceedings of the second ACM international conference on Multimedia, p.391-398, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192708]
• 8: Silvia Hollfelder , Achim Kraiss , Thomas C. Rakow, A Client-Controlled Adaptation Framework for Multimedia Database Systems, Proceedings of the 4th International Workshop on Interactive Distributed Multimedia Systems and Telecommunication Services, p.397-409, September 10-12, 1997
• 9: P. Hoschka, S. Bugaj, D. Bulterman, et al.Synchronized Multimedia Integration Language- W3C Working Dra}t 2-February-98. W3C, URL: http://www.w3.org/TR/1998/WD-smil-0202, Feb 1998.
• 10: Wolfgang Klas , Christian Greiner , Reinhard Friedl, Cardio-OP: Gallery of Cardiac Surgery, Proceedings of the IEEE International Conference on Multimedia Computing and Systems Volume II-Volume 2, p.1092, June 07-11, 1999
• 11: Rakesh Mohan, John R. Smith, and Chung-Shen Li. Adapting Content to Client Resources in the Internet. In Proc. ICMCS'99, volume 1, pages 302-307, Florence, Italy, June 1999.
• 12: Frank Moser , Achim Kraiss , Wolfgang Klas, L/MRP: A Buffer Management Strategy for Interactive Continuous Data Flows in a Multimedia DBMS, Proceedings of the 21th International Conference on Very Large Data Bases, p.275-286, September 11-15, 1995
• 13: Prashant J. Shenoy , Harrick M. Vin, Efficient support for scan operations in video servers, Proceedings of the third ACM international conference on Multimedia, p.131-140, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215259]
• 14: H. Thimm , W. Klas , J. Walpole , C. Pu , C. Cowan, Managing adaptive presentation executions in distributed multimedia database systems, Proceedings of the 1996 International Workshop on Multi-Media Database Management Systems (IW-MMDBMS '96), p.152, August 14-16, 1996
• 15: Jonathan Walpole , Ling Liu , David Maier , Calton Pu , Charles Krasic, Quality of Service Semantics for Multimedia Database Systems, Proceedings of the IFIP TC2/WG2.6 Eighth Working Conference on Database Semantics- Semantic Issues in Multimedia Systems, p.393-412, January 04-08, 1999
• 16: J. Wandel. A Framework for an Adaptive Presentation Environment in the Internet Based on ZYX. Diploma Thesis, in German, University of Ulm, Computer Science Department, Databases and Information Systems, Germany, 1998.
• 17: S. Wirag. Specification and Scheduling of Adaptive Multimedia Documents. Technical Report 1999/04, University of Stuttgart, Computer Science Department, Germany, 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)

General Terms:
Design, Management, Theory

Keywords:
adaptation, multimedia authoring, multimedia presentation, quality of information