Multimedia meets computer graphics in SMIL2.0: a time model for the web

ABSTRACT

Multimedia scheduling models provide a rich variety of tools for managing the synchronization of media like video and audio, but generally have an inflexible model for time itself. In contrast, modern animation models in the computer graphics community generally lack tools for synchronization and structural time, but allow for a flexible concept of time, including variable pacing, acceleration and deceleration and other tools useful for controlling and adapting animation behaviors. Multimedia authors have been forced to choose one set of features over the others, limiting the range of presentations they can create. Some programming models addressed some of these problems, but provided no declarative means for authors and authoring tools to leverage the functionality. This paper describes a new model incorporated into SMIL 2.0 that combines the strengths of scheduling models with the flexible time manipulations of animation models. The implications of this integration are discussed with respect to scheduling and structured time, drawing upon experience with SMIL 2.0 timing and synchronization, and the integration with XHTML.

REFERENCES

• 1: P. Ackermann, Direct manipulation of temporal structures in a multimedia application framework, Proceedings of the second ACM international conference on Multimedia, p.51-58, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192621]
• 2: Alias|Wavefront, Learning Maya 3 Product tutorial. 2001.
• 3: James F. Allen, Maintaining knowledge about temporal intervals, Communications of the ACM, v.26 n.11, p.832-843, Nov. 1983 [doi>10.1145/182.358434]
• 4: Brian Bailey , Joseph A. Konstan , Robert Cooley , Moses Dejong, Nsync—a toolkit for building interactive multimedia presentations, Proceedings of the sixth ACM international conference on Multimedia, p.257-266, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290779]
• 5: R.H. Campbell and A.N. Habermann. The Specification of Process Synchronization by Path Expressions, volume 16 of Lecture Notes in Computer Science. Springer Verlag, 1974.
• 6: R. Carey, G. Bell, and C. Marrin. The Virtual Reality Modeling Language ISO/IEC DIS 14772-1, April 1997.
• 7: A. Cohen, et al. (eds). Synchronized Multimedia Integration Language (SMIL 2.0) Specification W3C Recommendation 7 August 2001. http://www.w3.org/TR/smil20/.
• 8: L. Dami, E. Fiume, O. Nierstrasz, and D. Tsichritzis, Temporal Scripting using TEMPO. In Active Object Environments, (ed. D. Tsichritzis) Centre Universitaire d'Informatique, Université de Genève, 1988.
• 9: J. Döllner and K. Hinrichs. Interactive, animated widgets. In Computer Graphics International, June 22--26, Hannover, Germany 1998.
• 10: S. Donikian and E. Rutten, Reactivity, concurrency, data-flow and hierarchical preemption for behavioral animation in Eurographics Workshop on Programming Paradigms in Graphics, Maastricht, The Netherlands, September 1995.
• 11: D.J. Duke, D.A. Duce, I. Herman and G. Faconti. Specifying the PREMO synchronization objects. Technical report 02/97-R048, European Research Consortium for Informatics and Mathematics (ERCIM), 1997.
• 12: Conal Elliott , Greg Schechter , Ricky Yeung , Salim Abi-Ezzi, TBAG: a high level framework for interactive, animated 3D graphics applications, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.421-434, July 1994 [doi>10.1145/192161.192276]
• 13: J. Ferraiolo (ed). Scalable Vector Graphics (SVG) 1.0 Specification. W3C Recommendation 4 September 2001. http://www.w3.org/TR/SVG/.
• 14: Simon Gibbs, Composite multimedia and active objects, Conference proceedings on Object-oriented programming systems, languages, and applications, p.97-112, October 06-11, 1991, Phoenix, Arizona, United States
• 15: M. Haindl, A new multimedia synchronization model, IEEE Journal on Selected Areas in Communications, Vol. 14, No.1, pp. 73--83, Jan. 1996
• 16: Lynda Hardman , Dick C. A. Bulterman , Guido van Rossum, The Amsterdam hypermedia model: adding time and context to the Dexter model, Communications of the ACM, v.37 n.2, p.50-62, Feb. 1994 [doi>10.1145/175235.175239]
• 17: Lynda Hardman , Dick C. A. Bulterman , Guido van Rossum, The Amsterdam hypermedia model: adding time and context to the Dexter model, Communications of the ACM, v.37 n.2, p.50-62, Feb. 1994 [doi>10.1145/175235.175239]
• 18: ISO/IEC 10744: Information technology. Hypermedia / Time-based Structuring Language (HyTime). Second edition 1997-08-01.
• 19: ISO/IEC. MHEG-5: Coding of multimedia and hypermedia information -- Part 5: Support for base-level interactive applications. 1997. International Standard ISO/IEC 13522-5:1997 (MHEG-5).
• 20: D. Kalra and A.H. Barr. Modeling with Time and Events in Computer Animation. Computer Graphics Forum (Proceedings of Eurographics `92) 11(3):45--58.
• 21: M. Kim et al., (eds). Study of ISO/IEC 14496-1:2001 / PDAM2. Working Draft. March 2001.
• 22: M. Kim et al., (eds). Study of ISO/IEC 14496-1:2001 / PDAM2. Working Draft. March 2001.
• 23: T. D. C. Little , A. Ghafoor, Interval-Based Conceptual Models for Time-Dependent Multimedia Data, IEEE Transactions on Knowledge and Data Engineering, v.5 n.4, p.551-563, August 1993 [doi>10.1109/69.234768]
• 24: D. Newman, P. Schmitz A. Patterson (eds). XHTML+SMIL Language Profile. W3C Working Draft. 7 August 2001. http://www.w3.org/TR/XHTMLplusSMIL/.
• 25: K. Rothermel and T. Helbig, Clock Hierarchies: An Abstraction for Grouping and Controlling Media Streams, IEEE Journal of Selected Areas in Communications, Vol.14, No.1, pp.174--184, January 1996.
• 26: Gavin Schmitz, Microsoft Liquid Motion by Design: An Example-packed Guide to Creting Web Animations Using Microsoft Liquid Motion, Microsoft Press, Redmond, WA, 1998
• 27: P. Schmitz. Unifying Scheduled Time Models with Interactive Event-based Timing. Microsoft Research Tech. Report MSR-TR-2000-114, November 2000. http://www.research.microsoft.com/scripts/pubs/view.asp?TR_ID=MSR-TR-2000-114 http://research.microsoft.com/~pschmitz/UnifyingNote.html.
• 28: P. Schmitz. The SMIL 2.0 Timing and Synchronization Model: Using Time in Documents. Microsoft Research Tech. Report MSR-TR-2001-1, January 2001. http://www.research.microsoft.com/scripts/pubs/view.asp?TR_ID=MSR-TR-2001-01.
• 29: P. Schmitz. A Unified Model for Representing Timing in XML Documents, WWW9 position paper. 15 May 2000. http://www.cwi.nl/~lynda/www9/TimingIntegrationPositionPaper.html.
• 30: W. ten Kate, P. Deunhouwer, R. Clout. Timesheets - Integrating Timing in XML, WWW9 position paper. 15 May 2000. http://www.cwi.nl/~lynda/www9/Timesheets.www9.html.
• 31: J. R. Ossenbruggen , Lynda Hardman , L. W. Rutledge, Integrating multimedia characteristics in web-based document languages, CWI (Centre for Mathematics and Computer Science), Amsterdam, The Netherlands, 2000
• 32: T. Wahl and K. Rothermel. Representing time in multimedia systems. In Proc. IEEE International Conference on Multimedia Computing and Systems., Boston, MA, May 1994.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Animations

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Standards; Languages

General Terms:
Design, Languages, Standardization, Theory

Keywords:
animation, multimedia, synchronization, timing