Context perception in video-based hypermedia spaces

ABSTRACT

Multimedia hypertext has grown from the basic addition of dynamic media only at "leaf" nodes of the hypertext, to higher structured attempts to compose and integrate the different media. One of the core problems in this evolution has been, and still is, the construction and perception of context, making explicit which part of a presentation is relevant when media elements are integrated. The search for contextualized integration of video material with other sources of information has emerged from the work in several domains and from mutually reinforcing needs. The work presented here is centered on this problem: how to provide the perception of context to users or readers, when navigating through a space of heterogeneous media elements, where video plays an important role.

REFERENCES

• 1: Barry Arons, Hyperspeech: navigating in speech-only hypermedia, Proceedings of the third annual ACM conference on Hypertext, p.133-146, December 15-18, 1991, San Antonio, Texas, United States [doi>10.1145/122974.122989]
• 2: Herve Benoit, Digital Television: MPEG-1, MPEG-2 and Principles of the DVB System, John Wiley & Sons, Inc., New York, NY, 1997
• 3: Tim Boyle, Design for multimedia learning, Prentice-Hall, Inc., Upper Saddle River, NJ, 1997
• 4: Brøndmo, H.P,. and Davenport,G., Creating and viewing the Elastic Charles - a hypermedia journal, in R.McAleese and C.Green (eds.) Hypertext: State of the Art, Oxford: Intellect, 1991, 43--51
• 5: Mark Bernstein, Patterns of hypertext, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.21-29, June 20-24, 1998, Pittsburgh, Pennsylvania, United States [doi>10.1145/276627.276630]
• 6: Mark Bernstein, More than legible: on links that readers don't want to follow, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.216-217, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336370]
• 7: Bower,G.H., Clark,M.C., Lesgold,A.M., and Winzenz, D. "Hierarchical retrieval schemes in recall of categorized word lists", Journal of Verbal Learning and Verbal Behaviour, 8, 1969, 323--343
• 8: M. Cecelia Buchanan , Polle T. Zellweger, Specifying temporal behavior in hypermedia documents, Proceedings of the ACM conference on Hypertext, p.262-271, November 30-December 04, 1992, Milan, Italy [doi>10.1145/168466.171513]
• 9: Buzan,T.,Buzan,B., The Mindmap Book, BBC Books, 1995
• 10: Caseiro,D., and Trancoso, I., "Spoken language identification using the speachdat corpus", International Conference on Spoken Language Processing, Sydney, Australia, 1998
• 11: Chambel,T., Bidarra de Almeida, J., and Guimarães, N., "Multimedia Artifacts That Help Us Learn: Perspectives of the UNIBASE Project on Distance Learning", Workshop on Multimedia and Educational Practice, ACM Multimedia'98, Bristol, UK, September 1998
• 12: Chambel, T., Correia, N., and Guimarães, N., "Hypervideo on the Web: Models and Techniques for Video Integration", International Journal of Computers & Applications, Acta Press, Vol. 23, #2, 2001, 90--98
• 13: Chambel, T. and Guimarães, N., Communicating and Learning Mathematics with Hypervideo, in Multimedia Tools for Communicating Mathematics, Springer-Verlag, Berlin, Hidelberg, 2002. ISBN: 3-540-42450-4
• 14: Collis,B. and Peters,O., Educational Applications of WWW-Based Asynchronous Video. In Correia, N., Chambel, T., and Davenport, G. (eds), Multimedia'99, Springer-Verlag, 2000. ISBN: 3-211-83437-0
• 15: Nuno Correia , Nuno Guimarães, Components for video processing applications, Proceedings of the Eurographics Workshop on Multimedia '96, p.44-52, December 1996, Rostock, Germany
• 16: Nuno Correia , Teresa Chambel, Active video watching using annotation, Proceedings of the seventh ACM international conference on Multimedia (Part 2), p.151-154, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319878.319919]
• 17: Dakss,S., Agamanolis,S., Bove, V.M., and Chalom, E., Hyperlinked Video, Proc. SPIE Multimedia Systems and Applications, v. 3528, (in press), 1998
• 18: Yellowlees Douglas , Andrew Hargadon, The pleasure principle: immersion, engagement, flow, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.153-160, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336354]
• 19: Guimarães,N., Chambel,T., Bidarra,J., "From Cognitive Maps to Hypervideo: Supporting Flexible and Rich Learner-Centred Environments", IMEJ Journal, 2(2), October 2000. http://imej.wfu.edu/articles/2000/2/
• 20: Halasz,F., Schwartz,M., "The Dexter Hypertext Reference Model", Proceedings of the Hypertext Standardization Workshop, NIST, USA, 1990
• 21: Lynda Hardman , Dick C. A. Bulterman , Guido van Rossum, Links in hypermedia: the requirement for context, Proceedings of the fifth ACM conference on Hypertext, p.183-191, November 14-18, 1993, Seattle, Washington, United States [doi>10.1145/168750.168822]
• 22: Lynda Hardman , Dick C. A. Bulterman , Guido van Rossum, The Amsterdam hypermedia model: adding time and context to the Dexter model, Communications of the ACM, v.37 n.2, p.50-62, Feb. 1994 [doi>10.1145/175235.175239]
• 23: Annesa Hartman , Annessa Hartman, Producing Interactive Television, Charles River Media, Inc., Rockland, MA, 2001
• 24: Kahn,P., and Haan,B.J., Video in Hypermedia: The Design of InterVideo, in Visual Resources, Vol. VII, 1991, 353--360
• 25: Piet Kommers , Jan Lanzing, Students' concept mapping for hypermedia design: navigation through World Wide Web (WWW) space and self-assessment, Journal of Interactive Learning Research, v.8 n.3-4, p.421-455, Dec. 1997
• 26: George P. Landow, The rhetoric of hypermedia: some rules for authors, Hypermedia and literary studies, MIT Press, Cambridge, MA, 1991
• 27: George P. Landow , Paul Kahn, Where's the hypertext: The Dickens Web as a system-independent hypertext, Proceedings of the ACM conference on Hypertext, p.149-160, November 30-December 04, 1992, Milan, Italy [doi>10.1145/168466.168515]
• 28: Brenda Laurel, Computers as Theatre, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1993
• 29: Gunnar Liestøl, Aesthetic and rhetorical aspects of linking video in hypermedia, Proceedings of the 1994 ACM European conference on Hypermedia technology, p.217-223, September 19-23, 1994, Edinburgh, Scotland [doi>10.1145/192757.286994]
• 30: Liestøl,G., "Video on the Web: Principles of Continuity Linking and Narrative Flow". WebNet' 99, AACE, Honolulu, Hawaii, USA, October 1999
• 31: Clara Mancini, From cinematographic to hypertext narrative, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.236-237, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336396]
• 32: Matathia, I., Salzman, M., Next: trends for the near future, The Overlook Press 1999
• 33: John E. McEneaney, Visualizing and assessing navigation in hypertext, Proceedings of the tenth ACM Conference on Hypertext and hypermedia : returning to our diverse roots: returning to our diverse roots, p.61-70, February 21-25, 1999, Darmstadt, Germany [doi>10.1145/294469.294487]
• 34: Sugata Mukhopadhyay , Brian Smith, Passive capture and structuring of lectures, Proceedings of the seventh ACM international conference on Multimedia (Part 1), p.477-487, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319463.319690]
• 35: Nelson,T., "Branching presentational systems-Hypermedia", Dream Machines, 1974, 44--45
• 36: Jakob Nielsen, Multimedia and hypertext: the Internet and beyond, Academic Press Professional, Inc., San Diego, CA, 1995
• 37: Norman, D., "Things That Make Us Smart", Addison Wesley Publishing Company, 1993
• 38: Peter J. Nürnberg , John J. Leggett , Erich R. Schneider, As we should have thought, Proceedings of the eighth ACM conference on Hypertext, p.96-101, April 06-11, 1997, Southampton, United Kingdom [doi>10.1145/267437.267448]
• 39: Reimers, U., Digital Video Broadcasting, Springer-Verlag 2001
• 40: Jean François Rouet, Cognitive processing of hyperdocuments: when does nonlinearity help?, Proceedings of the ACM conference on Hypertext, p.131-140, November 30-December 04, 1992, Milan, Italy [doi>10.1145/168466.168508]
• 41: Nitin Sawhney , David Balcom , Ian Smith, HyperCafe: narrative and aesthetic properties of hypervideo, Proceedings of the the seventh ACM conference on Hypertext, p.1-10, March 16-20, 1996, Bethesda, Maryland, United States [doi>10.1145/234828.234829]
• 42: Alan Simpson, Official Microsoft Internet Explorer 4 Site Builder Toolkit with Cdrom, Microsoft Press, Redmond, WA, 1997
• 43: Jason McC. Smith , David Stotts , Sang-Uok Kum, An orthogonal taxonomy for hyperlink anchor generation in video streams using OvalTine, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.11-18, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336306]
• 44: Anne Morgan Spalter , Rosemary Michelle Simpson, Reusable hypertext structures for distance and JIT learning, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.29-38, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336311]
• 45: "Synchronized Multimedia Integration Language (SMIL 2.0) Specification", W3C Working Draft, 21 September 2000. www.w3.org/TR/2001/REC-smil20-20010807/
• 46: Suchman, L., Plans and Situated Actions, Cambridge Univ. Press 1987
• 47: Swann, P., TVdotCOM - The Future of Interactive Television, TV Books, New York, 2000
• 48: Susana Pajares Tosca, A pragmatics of links, Proceedings of the eleventh ACM on Hypertext and hypermedia, p.77-84, May 30-June 03, 2000, San Antonio, Texas, United States [doi>10.1145/336296.336327]
• 49: Guy Vardi, Navigation scheme for interactive movies with linear narrative, Proceedings of the tenth ACM Conference on Hypertext and hypermedia : returning to our diverse roots: returning to our diverse roots, p.131-132, February 21-25, 1999, Darmstadt, Germany [doi>10.1145/294469.294500]
• 50: Terry Winograd , Fernando Flores, Understanding Computers and Cognition: A New Foundation for Design, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1987
• 51: CutViewer-url: www.ergoprocesso.pt, also available through www.tucows.com
• 52: MS WindowsMedia, www.microsoft.com/windows/mediaplayer/
• 53: Sync-O-Matic 3000, www.egr.msu.edu/~crs/projects/syncomat/
• 54: "Touching Soap Films Booklet", www-sfb288.math.tu-berlin.de/~konrad/booklet/index.html

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.4 Hypertext/Hypermedia
          Subjects: Navigation

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)
      H.5.4 Hypertext/Hypermedia
          Subjects: User issues

General Terms:
Design, Experimentation, Human Factors, Languages

Keywords:
HTIMEL, cognitive processes, design, education, entertainment, hypervideo, integration in context, interactive video and TV, link awareness