Enriching SMIL with assertions for temporal validation

ABSTRACT

In this paper we define a formal semantics for the language SMIL which can be used in a number of applications. First of all, we propose a computer aided authoring system which include a Semantic Validator Module for the evaluation of the temporal consistency of the resulting multimedia presentation. If any temporal conflict is found, the system returns to the user a message pointing out the tag which contains the error and its motivation. This helps the user to correct the error. We also introduce a notion of equivalence for SMIL tags which is useful to find a candidate for substitution in the development of complex multimedia structure, for example in the context adaptation process.

REFERENCES

• 1: James F. Allen, Maintaining knowledge about temporal intervals, Communications of the ACM, v.26 n.11, p.832-843, Nov. 1983 [doi>10.1145/182.358434]
• 2: Dick C. A. Bulterman , Lynda Hardman , Jack Jansen , K. Sjoerd Mullender , Lloyd Rutledge, GRiNS: a graphical interface for creating and playing SMIL documents, Proceedings of the seventh international conference on World Wide Web 7, p.519-529, April 1998, Brisbane, Australia
• 3: Dick Bulterman et al. Synchronized Multimedia Integration Language (SMIL) 3.0 Working Draft, December 2006.
• 4: E. Bertino, E. Ferrari, A. Perego, and D. Santi. A Constraint-Based Approach for the Authoring of Multi-Topic Multimedia Presentations. In ICME, pages 578--581, July 2005.
• 5: H. Eidenberger. SMIL and SVG in teaching. In Internet Imaging V, volume 5304, pages 69--80, Dec. 2003.
• 6: Susan Elias , K. S. Easwarakumar , Richard Chbeir, Dynamic consistency checking for temporal and spatial relations in multimedia presentations, Proceedings of the 2006 ACM symposium on Applied computing, April 23-27, 2006, Dijon, France [doi>10.1145/1141277.1141596]
• 7: Lynda Hardman , Dick C. A. Bulterman , Guido van Rossum, The Amsterdam hypermedia model: adding time and context to the Dexter model, Communications of the ACM, v.37 n.2, p.50-62, Feb. 1994 [doi>10.1145/175235.175239]
• 8: C. A. R. Hoare, An axiomatic basis for computer programming, Communications of the ACM, v.12 n.10, p.576-580, Oct. 1969 [doi>10.1145/363235.363259]
• 9: Jeff Ayars et al. Synchronized Multimedia Integration Language (SMIL) 2.0 Specification, January 2005.
• 10: Muriel Jourdan, A formal semantics of SMIL: a web standard to describe multimedia documents, Computer Standards & Interfaces, v.23 n.5, p.439-455, November 2001 [doi>10.1016/S0920-5489(01)00091-5]
• 11: Muriel Jourdan , Nabil Layaïda , Cécile Roisin , Loay Sabry-Ismaïl , Laurent Tardif, Madeus, and authoring environment for interactive multimedia documents, Proceedings of the sixth ACM international conference on Multimedia, p.267-272, September 13-16, 1998, Bristol, United Kingdom [doi>10.1145/290747.290780]
• 12: Oratrix. GRiNS. http://www.oratrix.com.
• 13: Patrick Schmitz and Jeff Ayars and Bridie Saccocio and Muriel Jourdan. The SMIL 2.0 Timing and Synchronization Module, March 2001.
• 14: Fabiano Borges Paulo , Paulo Cesar Masiero , Maria Cristina Ferreira de Oliveira, Hypercharts: Extended Statecharts to Support Hypermedia Specification, IEEE Transactions on Software Engineering, v.25 n.1, p.33-49, January 1999 [doi>10.1109/32.748917]
• 15: RealNetworks. RealPlayer 10.5.http://www.real.com/.
• 16: P. Sampaio and J.-P. Courtiat. An Approach for the Automatic Generation of RT-LOTOS Specifications from SMIL 2.0 Documents. Journal of the Brazilian Computer Society, 9(3):39--51, Apr. 2004.
• 17: P. Sampaio, C. Santos, and J.-P. Courtiat. About the Semantic Verification of SMIL Documents. In ICME, pages 1675--1678, New York, USA, Aug. 2000.
• 18: Luiz Fernando G. Soares , Rogério F. Rodrigues , Débora C. Muchaluat Saade, Modeling, authoring and formatting hypermedia documents in the HyperProp system, Multimedia Systems, v.8 n.2, p.118-134, March 2000 [doi>10.1007/s005300050155]
• 19: P. Valente and P. Sampaio. TLSA Player: A tool for presenting consistent SMIL 2.0 documents. In Proc. of ICEIS2007, Madeira, Portugal, June 2007.
• 20: C. Yang. Detection of the time conflicts for smil-based multimedia presentations. In Workshop on Computer Networks, Internet, and Multimedia, pages 57--63, 2000.
• 21: Huiqun Yu , Xudong He , Shu Gao , Yi Deng, Modeling and Analyzing SMIL Documents in SAM, Proceedings of the Fourth IEEE International Symposium on Multimedia Software Engineering, p.132, December 11-13, 2002

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Theory

Additional Classification:
  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.2 Document Preparation
          Subjects: Markup languages; Standards

General Terms:
Theory, Verification

Keywords:
SMIL, authoring, consistency checking