MADCOW: a multimedia digital annotation system

ABSTRACT

Digital annotation of multimedia documents adds information to a document (e.g. a web page) or parts of it (a multimedia object such as an image or a video stream contained in the document). Digital annotations can be kept private or shared among different users over the internet, allowing discussions and cooperative work. We study the possibility of annotating multimedia documents with objects which are in turn of multimedial nature. Annotations can refer to whole documents or single portions thereof, as usual, but also to multi-objects, i.e. groups of objects contained in a single document. We designed and developed a new digital annotation system organized in a client-server architecture, where the client is a plug-in for a standard web browser and the servers are repositories of annotations to which different clients can login. Annotations can be retrieved and filtered, and one can choose different annotation servers for a document. We present a platform-independent design for such a system, and illustrate a specific implementation for Microsoft Internet Explorer on the client side and on JSP/MySQL for the server side.

REFERENCES

• 1: Annotea. http://www.w3.org/2001/Annotea.
• 2: Dublin core. http://dublincore.org.
• 3: Mpeg. http://www.mpeg.org.
• 4: Videoannex annotation tool. http://www.research.ibm.com/VideoAnnEx/.
• 5: Xpath. http://www.w3c.org/TR/xpath.
• 6: Xpointer. http://www.w3c.org/XML/Linking.
• 7: D. Bargeron, A. Gupta, J. Grudin, and E. Sanocki. Annotations for streaming video on the web: System design and usage studies. Technical report, Microsoft Research, 1999. http://research.microsoft.com/research/coet/MRAS/www8/paper.htm.
• 8: R. Bingler. Inote image annotation in java. Technical report, University of Virginia, 1998. http://jefferson.village.virginia.edu/inote/.
• 9: F. Bonifazi, S. Levialdi, P. Rizzo, and R. Trinchese. A web-based annotation tool supporting e-learning. In Proc. AVI '02, pages 123--128. ACM Press, 2002.
• 10: P. Bottoni, S. Levialdi, and P. Rizzo. An analysis and case study of digital annotation. In N. Bianchi-Berthouze, editor, Proc. DNIS-2003, pages 216--230. Springer, 2003.
• 11: J. Brinkley, R. Jakobovits, and C. Rosse. An online image management system for anatomy teaching. In Proceedings of the AMIA 2002 Annual Symposium, 2002.
• 12: C. Chronaki, X. Zabulis, and S. Orphanoudakis. I2cnet medical image annotation service. In Med In-form (Lond), 1997.
• 13: Donald Cox , Saul Greenberg, Supporting collaborative interpretation in distributed Groupware, Proceedings of the 2000 ACM conference on Computer supported cooperative work, p.289-298, December 2000, Philadelphia, Pennsylvania, United States [doi>10.1145/358916.359000]
• 14: W. Lober. Personal annotated image server (pais). Technical report, Washington University, 2000.
• 15: W. Lober and J. Brinkley. A portable image annotation tool for web-based anatomy atlases. In Proceedings of the AMIA 1999 Annual Symposium, 1999.
• 16: W. Lober and J. Brinkley. A personal annotated image server. Fellowship F38, LM00086, NLM, 2000.
• 17: W. Lober, L. Trigg, D. Bliss, and J. Brinkley. Iml: An image markup language. Fellowship F38, LM00086, NLM, 2000.
• 18: W. Mann and S. Thompson. Rhetorical structure theory: A framework for the analysis of texts. IPRA Papers in Pragmatics, 1:1--21, 1987.
• 19: C. Roisin, T. Tran Thuong, and L. Villard. Integration of structured video in a multimedia authoring system. In Proc. of the Eurographics Multimedia'99 Workshop, pages 133--142. Springer Computer Science, 1999. http://opera.inrialpes.fr/people/Tien.Tran-Thuong/Welcome.html Demos and Publication section.
• 20: R. Schroeter, J. Hunter, and D. Kosovic. Vannotea - a collaborative video indexing, annotation and discussion system for broadband networks. In K-CAP 2003 Workshop on "Knowledge Markup and Semantic Annotation", 2003.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

General Terms:
Design

Keywords:
annotation, multimedia document, plug-ins