Towards 'cinematic' hypertext

ABSTRACT

This paper proposes the paradigm of 'Cinematic' Hypertext (CH), in which discourse form is represented following principles that underpin the expression of narrative patterns in cinema. Primarily tackling hypertext discourse coherence in the non-linear medium, CH is conceived as a way of thinking the hypertext medium that is consistent with its characteristics. CH envisages the consistent and concurrent use of the medium's formal features, grounded in structuring principles, in order to allow the emergence of a local language. Relational primitives based on Cognitive Coherence Relations are proposed as a structuring principle to define hypertext links, while the use the medium's graphic features is proposed to render these relational primitives as patterns that will take shape during navigation. Taking scholarly hypertext as a domain, this paper articulates the theoretical basis for cinematic hypertext, presents the elements of a prototype visual language to express a sub-set of CCR, provides experimental evidence of its significance, and finally envisages the realisation of a cinematic hypertext environment.

REFERENCES

• 1: Mark Bernstein, Patterns of hypertext, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.21-29, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276630]
• 2: Bertin, J. (2000/2001). Matrix Theory of Graphics. Information Design Journal, 10(1), pp.5--19
• 3: Buckingham Shum, S., Uren, V., Li, G., Domingue, J., Motta, E., Mancini, C. (2002). Designing Representational Coherence into an Infrastructure for Collective Sensemaking. 2nd International Workshop on Infrastructures for Distributed Collective Practices, San Diego, 6-9 February
• 4: Buckingham Shum, S., Uren, V., Li, G., Domingue, J., Motta, E. (2003). Visualizing Argumentation. In Kirschner, P.A., Buckingham Shum, S., Carr, Ch.S. (Eds) Software Tools for Collaborative and Educational Sense-Making. Springer-Verlag
• 5: Campbell, K.S. (1995). Coherence, Continuity, and Cohesion. Theoretical Foundations for Document Design. Lawrence Erlbaum Associates Publishers
• 6: Locke M. Carter, Arguments in hypertext: a rhetorical approach, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.85-91, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336332]
• 7: Casetti, F., Di Chio, F., (1990). Analisi del film. Bompiani
• 8: Grice, H.P. (1975). Logic and Conversation. In Cole, P., Morgan, J. (Eds.), Syntax and Semantics. Academy Press of New York, Vol. 3, pp.41--58
• 9: Knoch, W.G. (2000/2001). Jaques Bertin's Theory of Graphics and Its Development and Influence on Multimedia Cartography. Information Design Journal, 10(1), pp.37--43
• 10: Knott, A., Dale, R. (1994). Using Linguistic Phenomena to Motivate a Set of Coherence Relations. Discourse Processes, 18(1), pp.35--62
• 11: David Kolb, Scholarly hypertext: self-represented complexity, Proceedings of the eighth ACM conference on Hypertext, p.29-37, April 06-11, 1997, Southampton, United Kingdom [doi>10.1145/267437.267441]
• 12: Kolb, D. (1995). Socrates in the Labyrinth: Hypertext, Argument, Philosophy. Eastgate Systems
• 13: Kumpf, E.P. (2000). Visual Metadiscourse: Designing the Considerate Text. Technical Communication Quarterly, 9(4), pp.401--24
• 14: Louwerse, M. (2001). An Analytic and Cognitive Parametrization of Coherence Relations. Cognitive Linguistics, 12 (3), pp. 291--315
• 15: Marjorie C. Luesebrink, The moment in hypertext: a brief lexicon of time, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.106-112, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276639]
• 16: Clara Mancini, From cinematographic to hypertext narrative, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.236-237, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336396]
• 17: Mancini, C. (2003). Towards Cinematic Hypertext: a Theoretical and Empirical Investigation. Ph.D. thesis. Knowledge media Institute, The Open University, Milton Keynes, UK.
• 18: Clara Mancini , Simon Shum Buckingham, Cognitive coherence relations and hypertext: from cinematic patterns to scholarly discourse, Proceedings of the twelfth ACM conference on Hypertext and Hypermedia, August 14-18, 2001, Århus, none, Denmark [doi>10.1145/504216.504261]
• 19: Catherine C. Marshall , Frank G. Halasz , Russell A. Rogers , William C. Janssen, Jr., Aquanet: a hypertext tool to hold your knowledge in place, Proceedings of the third annual ACM conference on Hypertext, p.261-275, December 15-18, 1991, San Antonio, Texas, United States [doi>10.1145/122974.123000]
• 20: Metz, Ch. (1972). Essai sur la Signification au Cinema -II. Editions Klincksieck
• 21: Miles, A. (2000). Hypertext Syntagmas: Cinematic Narration with Links. Journal of Digital Information, 1(7). http://jodi.ecs.soton.ac.uk/Articles/v01/i07/Miles/
• 22: Adrian Miles, Hypertext structure as the event of connection, Proceedings of the twelfth ACM conference on Hypertext and Hypermedia, August 14-18, 2001, Århus, none, Denmark [doi>10.1145/504216.504236]
• 23: Timothy Miles-Board , Leslie Carr , Wendy Hall, Looking for linking: associative links on the Web, Proceedings of the thirteenth ACM conference on Hypertext and hypermedia, June 11-15, 2002, College Park, Maryland, USA [doi>10.1145/513338.513360]
• 24: Pander Maat, H. (1999). The Differential Linguistic Realisation of Comparative and Additive Coherence Relations. Cognitive Linguistics, 10(2), pp.147--184
• 25: Riley, K., Parker, F. (1998). Parallels Between Visual and Textual Processing. IEEE Transactions on Professional Communication, 41(3), pp.175--185
• 26: Rosenberg, J. (2001). And And: conjunctive hypertext and the structure acteme juncture. In Proceedings of ACM Hypertext '02, pp.51--60
• 27: Rosenberg, J. (2002). Conditional Spatiality. Second Workshop on Spatial Hypertext, ACM Hypertext '02, 12 June, University of Maryland
• 28: Sanders, T.J.M, Spooren, W. (2001). Text Representation as an Interface Between Language and its Users. In Sanders, T.J.M., Schilperoord, J., Spooren, W. (Eds.), Text Representation. Linguistic and psycholinguistic aspects. University of Utrecht, University of Tilburg, Free University of Amsterdam Press, pp.1--26
• 29: Sanders, T.J.M., Spooren, W.P.M., Noordman, L.G.M. (1993). Coherence Relations in a Cognitive Theory of Discourse Representation. Cognitive Linguistics, 4(2), pp.93--133
• 30: Sanders, T.J.M. (1997). Semantic and Pragmatic Sources of Coherence: On the Categorisation of Coherence Relations in Context. Discourse processes, 24, pp.119--147
• 31: Frank M. Shipman, III , Catherine C. Marshall, Spatial hypertext: an alternative to navigational and semantic links, ACM Computing Surveys (CSUR), v.31 n.4es, Dec. 1999 [doi>10.1145/345966.346001]
• 32: John Slatin, Reading hypertext: order and coherence in a new medium, Hypermedia and literary studies, MIT Press, Cambridge, MA, 1991
• 33: Randall H. Trigg , Mark Weiser, TEXTNET: a network-based approach to text handling, ACM Transactions on Information Systems (TOIS), v.4 n.1, p.1-23, Jan. 1986 [doi>10.1145/5401.5402]
• 34: Wertheimer, M. (1938). Laws of organization in perceptual forms. In Ellis, W.B. (Eds), A Sourcebook of Gestalt Psycychology. Routledge and Kegan Paul, pp. 71--88.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Animations

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation; Architectures; Theory

General Terms:
Design, Experimentation, Languages, Theory

Keywords:
cinematic language, cognitive coherence relations, discourse patterns, dynamic visual patterns, hypertext discourse coherence, hypertext languages, visual languages