Finding the story: broader applicability of semantics and discourse for hypermedia generation

ABSTRACT

Generating hypermedia presentations requires processing constituent material into coherent, unified presentations. One large challenge is creating a generic process for producing hypermedia presentations from the semantics of potentially unfamiliar domains. The resulting presentations must both respect the underlying semantics and appear as coherent, plausible and, if possible, pleasant to the user. Among the related unsolved problems is the inclusion of discourse knowledge in the generation process. One potential approach is generating a discourse structure derived from generic processing of the underlying domain semantics, transforming this to a structured progression and then using this to steer the choice of hypermedia communicative devices used to convey the actual information in the resulting presentation.This paper presents the results of the first phase of the Topia project, which explored this approach. These results include an architecture for this more domain-independent processing of semantics and discourse into hypermedia presentations. We demonstrate this architecture with an implementation using Web standards and freely available technologies.

REFERENCES

• 1: Aidministrator Nederland B.V., Sesame.
• 2: Aidministrator Nederland B.V., Sesame.
• 3: André, E., The Generation of Multimedia Documents, in. Dale, R, Moisl, H. and Somers, H. (eds.), A Handbook of Natural Language Processing: Techniques and Applications for the Processing of Language as Text, Marcel Dekker Inc., 2000, 305--327.
• 4: John Bateman , Jörg Kleinz , Thomas Kamps , Klaus Reichenberger, Towards constructive text, diagram, and layout generation for information presentation, Computational Linguistics, v.27 n.3, p.409-449, September 2001 [doi>10.1162/089120101317066131]
• 5: Bos, B., Lie, H.W., Lilley, C., and Jacobs, I. (eds). Cascading Style Sheets, Level 2. World Wide Web Consortium (W3C) Recommendation, May 1998.
• 6: Brickley, D., and Guha, R.V. RDF Vocabulary Description Language 1.0: RDF Schema. World Wide Web Consortium (W3C) Working Draft, January 2003. (work in progress)
• 7: Simon Buckingham Shum , Victoria Uren , Gangmin Li , John Domingue , Enrico Motta, Visualizing internetworked argumentation, Visualizing argumentation: software tools for collaborative and educational sense-making, Springer-Verlag, London, 2003
• 8: Clark, J. (ed). XSL Transformations (XSLT) Version 1.0. World Wide Web Consortium (W3C) Recommendation, November 1999.
• 9: Czajka, K. Design of interactive and adaptive interfaces to exploit large media-based knowledge spaces in the domain of museums for the fine arts. Masters Thesis, University of Applied Science Darmstadt, June 2002.
• 10: De Bra, P. and Calvi, L. AHA! An open Adaptive Hypermedia Architecture. The New Review of Hypermedia and Multimedia, 1998, 115--139.
• 11: Stefan Decker , Sergey Melnik , Frank Van Harmelen , Dieter Fensel , Michel Klein , Jeen Broekstra , Michael Erdmann , Ian Horrocks, The Semantic Web: The Roles of XML and RDF, IEEE Internet Computing, v.4 n.5, p.63-74, September 2000 [doi>10.1109/4236.877487]
• 12: Dublin Core Community. Dublin Core Element Set, Version 1.1, 1999.
• 13: Ganter, B., and Wille, R., Applied Lattice Theory: Formal Concept Analysis. Preprints http://wwwbib.mathematik.tu-darmstadt.de/Math-Net/Preprints/Listen/pp97.html, 1997.
• 14: Geurts, J., Bocconi, S., van Ossenbruggen, J.R., Hardman, L. Towards Ontology-driven Discourse: From Semantic Graphs to Multimedia Presentations, CWI Technical Report INS-R0305, May 2003.
• 15: Heflin, J. and Hendler, J., Searching the Web with SHOE, AAAI-2000 Workshop on AI for Web Search, 2000.
• 16: Gregory Karvounarakis , Sofia Alexaki , Vassilis Christophides , Dimitris Plexousakis , Michel Scholl, RQL: a declarative query language for RDF, Proceedings of the 11th international conference on World Wide Web, May 07-11, 2002, Honolulu, Hawaii, USA [doi>10.1145/511446.511524]
• 17: Kamps, T., Diagram Design : A Constructive Theory, Springer Verlag, 1999.
• 18: Lassila, O. and Swick, R.R. (eds), Resource Description Framework (RDF) Model and Syntax Specification. World Wide Web Consortium (W3C) Recommendation, February 22nd, 1999.
• 19: Suzanne Little , Joost Geurts , Jane Hunter, Dynamic Generation of Intelligent Multimedia Presentations through Semantic Inferencing, Proceedings of the 6th European Conference on Research and Advanced Technology for Digital Libraries, p.158-175, September 16-18, 2002
• 20: Mark T. Maybury , Inderjeet Mani, Advances in Automatic Text Summarization, MIT Press, Cambridge, MA, 1999
• 21: Microsoft, Inc. Internet Explorer 6. 2002.
• 22: Dharmendra S. Modha , W. Scott Spangler, Clustering hypertext with applications to web searching, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.143-152, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336351]
• 23: Newman, D., Schmitz, P., and Patterson, A. (eds). XHTML+SMIL Profile. World Wide Web Consortium (W3C) Note, 31 January 2001.
• 24: Jacco van Ossenbruggen , Joost Geurts , Frank Cornelissen , Lynda Hardman , Lloyd Rutledge, Towards second and third generation web-based multimedia, Proceedings of the 10th international conference on World Wide Web, p.479-488, May 01-05, 2001, Hong Kong, Hong Kong [doi>10.1145/371920.372143]
• 25: Rijksmuseum Amsterdam, Rijksmuseum Amsterdam Website. http://www.rijksmuseum.nl/.
• 26: Rutledge, L., Davis, J., van Ossenbruggen, J., and Hardman, L. Inter-dimensional Hypermedia Communicative Devices for Rhetorical Structure. In: Proceedings of the International Conference on Multimedia Modeling 2000 (MMM00), Nagano, Japan, November 2000, World Scientific, 89--105.
• 27: Jill Walker, Piecing together and tearing apart: finding the story in afternoon, Proceedings of the tenth ACM Conference on Hypertext and hypermedia : returning to our diverse roots: returning to our diverse roots, p.111-117, February 21-25, 1999, Darmstadt, Germany [doi>10.1145/294469.294496]
• 28: Mark Bernstein , David E. Millard , Mark J. Weal, On writing sculptural Hypertext, Proceedings of the thirteenth ACM conference on Hypertext and hypermedia, June 11-15, 2002, College Park, Maryland, USA [doi>10.1145/513338.513355]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Architectures

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation

  I. Computing Methodologies
  I.7 DOCUMENT AND TEXT PROCESSING
      I.7.2 Document Preparation
          Subjects: Hypertext/hypermedia; Multi/mixed media; Standards; Markup languages

General Terms:
Design, Documentation, Experimentation, Standardization

Keywords:
RDF, SMIL, clustering, concept lattices, discourse, hypermedia, narrative, semantics