Direct manipulation of temporal structures in a multimedia application framework

ABSTRACT

The design of complex multimedia documents presents new challenges to authoring systems, because spatial and temporal features should be visualized and made accessible in an intuitive and direct-manipulative way. In this study, multimedia presentations are considered as hierarchical compositions of time objects that define serial or parallel synchronization of the inserted media objects. Media composition hierarchies support automatic temporal layout mechanisms. They are integrated into an object-oriented application framework called MET++. It provides direct manipulation interaction on temporal structures in a composition view that displays temporal and compositional relations, allows time transformations on composites, supports the definition of time-dynamic behavior of media objects through time functions, and has a flexible graphical layout in order to visualize context information.

REFERENCES

• 1: Kurt J. Schmucker, Object-oriented programming for the Macintosh, Hayden Books, Carmel, IN, 1986
• 2: Mark A. Linton , John M. Vissides , Paul R. Calder, Composing User Interfaces with InterViews, Computer, v.22 n.2, p.8-22, February 1989 [doi>10.1109/2.19829]
• 3: A. Weinand. E. Gamma, R. Malty: Design and Implementation of ET++, A Seamless Object-Oriented Application Framework; Structured Programming, Vol. 10, No. 2, June 1989, pp. 63-87.
• 4: NeXT Computer Inc.: NeXTStep Developer's Library; Addison- Wesley, Reading MA, 1992.
• 5: Glenn E. Krasner , Stephen T. Pope, A cookbook for using the model-view controller user interface paradigm in Smalltalk-80, Journal of Object-Oriented Programming, v.1 n.3, p.26-49, Aug./Sept. 1988
• 6: E. Gamma, A. Weinand, R. Marry: ET++ - An Object-Oriented Application Framework in C++; in Proc. EUUG, pp. 159-I74, Cascais, Portugal, 3-7 October 1988.
• 7: E. Gamma: Objektorientierte Sofiware-Entwicklung am Beispiel yon ET+ +; Springer Verlag, Berlin 1992.
• 8: Andre Weinand: Objektorientierte Architektur far graphische Benutzeroberfl~ichen - Realisierung der portablen FenstersystemschnittsteUe yon ET+ +; Springer Verlag, Berlin 1992.
• 9: Philipp Ackermann: Object-oriented Modelling of Time Synchronisation in a Multimedia Application Framework; in: Audio Engineering Society AES 95th Convention, Preprints, Audio Engineering Society, New York, October 1993.
• 10: Philipp Ackermann , Dominik Eichelberg, Combining 2D user interface components and interactive 3D graphics in ET++, Proceedings of the eleventh international conference on Technology of object-oriented languages and systems, p.291-302, December 1993, Santa Barbara, California, United States
• 11: Thomas D. Little, Arif Ghafoor: Synchronisation and Storage Models for Multimedia Objects; IEEE Journal on Selected Areas in Communications 8(3):413-427, April 1990.
• 12: Dennis Tsichritzis, Simon Gibbs, Laurent Dami: Active Media; in: Object Composition; Centre Universitaire d'Informatique, p.115- 132, Genb, ve, 1992.
• 13: Macromind Inc.: Macromind Director lnteractivity Manual; 1992.
• 14: George D. Drapeau, Howard Greenfield: MAEstro- A Distributed Multimedia Authoring Environment; USENIX Summer '91 Proceedings, p.315-328, Nashville, TN, 1991.
• 15: Lon Poole: QuickTime in Motion, MacWorld (9)!992:154-159.
• 16: Rei Hamakawa , Jun Rekimoto, Object composition and playback models for handling multimedia data, Proceedings of the first ACM international conference on Multimedia, p.273-281, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.168399]
• 17: M. Cecelia Buchanan , Polle T. Zellweger, Automatic temporal layout mechanisms, Proceedings of the first ACM international conference on Multimedia, p.341-350, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.168415]
• 18: Guido van Rossum , Jack Jansen , K. Sjoerd Mullender , Dick C. A. Bulterman, CMIFed: a presentation environment for portable hypermedia documents, Proceedings of the first ACM international conference on Multimedia, p.183-188, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.166287]
• 19: Donald Ervin Knuth, TEX: The Program, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1986

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

Additional Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications

          Nouns: C++

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Audio input/output; Animations
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Design, Documentation, Languages