NLVS: a near-lossless video summarization system

ABSTRACT

This video demonstration presents a new system for video summarization, called ``Near-Lossless Video Summarization" (NLVS) to tackle with the challenges of storage and indexing brought by the current boom of videos for existing online video services. Unlike current techniques such as video compression and summarization which are still struggling to achieve the two often conflicting goals of low storage and high visual and semantic fidelity, NLVS is able to summarize a video stream with least information loss by using an extremely small piece of metadata. Although at a very low compression ratio (1/30 of H.264 baseline in average, where traditional compression techniques like H.264 fail to preserve the fidelity), the summary still can be used to reconstruct the original video (with the same duration) nearly without semantic information loss.

REFERENCES

• 1: ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC, Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification. March 2003.
• 2: ITU-T Rec. H.263, Video coding for low bit rate communication. version 1, Nov. 1995; version 2, Jan. 1998; version 3, Nov. 2000.
• 3: 3rd Generation Partnership Project. AMR speech Codec: General description. TS 26.071 version 5.0.0, June 2002.
• 4: Digital Compression and Coding of Continuoustone Still Images, Part 1. Requirements and guidelines. ISO/IEC JTC1 Draft International Standard 10918-1, Nov. 1991.
• 5: M. Irani and P. Anandan. Video indexing based on mosaic representations. Proceedings of the IEEE, 86(5):905--921, 1998.
• 6: C. Kim and J.-N. Hwang. Object-based video abstraction for video surveillance systems. IEEE Trans. on Circuit and Syst. for Video Tech., 12(12):1128--1138, 2002.
• 7: J. G. Kim, H. S. Chang, J. Kim, and H. M. Kim. Efficient camera motion characterization for mpeg video indexing. In Proceedings of ICME, pages 1171--1174, 2000.
• 8: H.-J. Zhang, A. Kankanhalli, and S. W. Smoliar. Automatic partitioning of full-motion video. Multimedia Systems, 1(1):10--28, 1993.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Video (e.g., tape, disk, DVI)

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods; Abstracting methods

General Terms:
Algorithms, Experimentation, Human Factors

Keywords:
video storage, video summarization