Annotations as multiple perspectives of video content

ABSTRACT

This paper describes a video annotation tool based on a new and flexible model, that gives several perspectives over the same video content. The model was designed in a way that allows having multiple views over the same video data, enabling users with different requirements to have the most appropriate interface. These views, video-lenses, highlight a specific aspect of the video content that is being annotated. Annotations are made using a timeline based interface with multiple tracks, where each track corresponds to a given video-lens. The format used to store and exchange the information is the MPEG-7 standard. The annotation tool (VAnnotator) is being developed in the scope of Vizard, an ambitious project that aims to define a new paradigm for video navigation, annotation, editing and retrieval. The Vizard project includes users, both from the production/archiving area and from the consumer electronics area, that help to define and validate the annotation requirements and functionality.

REFERENCES

• 1: Frank Nack , Wolfgang Putz, Designing annotation before it's needed, Proceedings of the ninth ACM international conference on Multimedia, September 30-October 05, 2001, Ottawa, Canada [doi>10.1145/500141.500180]
• 2: Rehatschek, H. and Kienast, G., VIZARD -- An Innovative Tool for Video Navigation, Retrieval and Editing, Proceedings of the 23rd Workshop of PVA 'Multimedia and Middleware', Vienna, (2001)
• 3: Beverly L. Harrison , Ronald M. Baecker, Designing video annotation and analysis systems, Proceedings of the conference on Graphics interface '92, p.157-166, September 1992, Vancouver, British Columbia, Canada
• 4: Varlamis, I., Vaziargiannis M., Poulos, P., Akrivas, G. and Spiros, I., X-Database. A Middleware for Collaborative Video Annotation, Storage and Retrieval, in the proceedings of the 8th Panhellenic Conference. Cyprus, (2001)
• 5: Marc Davis, Media Streams: an iconic visual language for video representation, Human-computer interaction: toward the year 2000, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1995
• 6: Marc Eliot Davis, Media streams: representing video for retrieval and repurposing, Massachusetts Institute of Technology, Cambridge, MA, 1995
• 7: Nuno Correia , Teresa Chambel, Active video watching using annotation, Proceedings of the seventh ACM international conference on Multimedia (Part 2), p.151-154, October 30-November 05, 1999, Orlando, Florida, United States [doi>10.1145/319878.319919]
• 8: Sgouropoulou, C., Koutoumanos, A., Goodyear, P., and Skordalakis, E., WebOrama: A Web Based System for Ordered Asynchronous Multimedia Annotations, WebNet 98 - World Conference on the WWW, Internet, & Intranet, AACE Conferences, Orlando, Florida, USA, (1998)
• 9: Ahmed K. Elmagarmid , Haitao Jiang , Abdelsalam A. Helal , Magdy Ahmed , Anupam Joshi, Video Database Systems: Issues, Products and Applications, Kluwer Academic Publishers, Norwell, MA, 1997
• 10: ISO MPEG-7. Text of ISO/IEC FCD 15938-2 Information Technology -- Multimedia Content Description Interface -- Part 2 Description Definition Language, ISO/IEC JTC 1/SC 29/WG 11 N4002, (2001)
• 11: ISO MPEG-7. Text of ISO/IEC 15938-5/FCD Information Technology -- Multimedia Content Description Interface -- Part 5 Multimedia Description Schemes, ISO/IEC JTC 1/SC 29/WG 11 N3966, (2001)
• 12: Eric A. Bier , Maureen C. Stone , Ken Pier , William Buxton , Tony D. DeRose, Toolglass and magic lenses: the see-through interface, Proceedings of the 20th annual conference on Computer graphics and interactive techniques, p.73-80, September 1993 [doi>10.1145/166117.166126]
• 13: Bargeron, D., Gupta, A., Grudin, J. and Sanocki, E., Annotations for Streaming Video on the Web: System Design and Usage Studies, http://www.research.microsoft.com

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.0 General

General Terms:
Design, Documentation, Experimentation, Human Factors, Languages, Standardization

Keywords:
MPEG-7, authoring paradigms, timeline model, video annotation, video-lens