Content-based browsing of video sequences

ABSTRACT

A novel methodology to represent the contents of a video sequence is presented. The representation is used to allow the user to rapidly view a video sequence in order to find a particular point within the sequence and/or to decide whether the contents of the sequence are relevant to his or her needs. This system, referred to as content-based browsing, forms an abstraction to represent each shot of the sequence by using a representative frame, or an Rframe, and it includes management techniques to allow the user to easily navigate the Rframes. This methodology is superior to the current techniques of fast forward and rewind because rather than using every frame to view and judge the contents, only a few abstractions are used. Therefore, the need to retrieve the video from a storage system and to transmit every frame over the network in its entirety no longer exists, saving time, expenses, and bandwidth.

REFERENCES

• arman93e: Farshid Arman , Arding Hsu , Ming-Yee Chiu, Image processing on compressed data for large video databases, Proceedings of the first ACM international conference on Multimedia, p.267-272, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.166297]
• arman94: F. Arman, A. Hsu and M-Y. Chiu, Image Processing on Encoded Video Sequences, in Multimedia Systems Journal, vol 1, no. 5, 1994, pp 211-219.
• elliot93: E. Elliott, Watch, Grab, Arrange, See: Thinking with Motion images via Streams and Collages, Ph.D. Thesis, MIT, Feb 1993.
• gonzalez77: Rafael C. Gonzales , Paul Wintz, Digital image processing (2nd ed.), Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1987
• hu61: M.-K. Hu, Pauem Recognition by moment invariants, in Proc. IRE, vol. 49, 1961, p 1428.
• hu62: M.-K. Hu, Visual pattern recognition by moment invariants, in IRE Trans. Inform. Theory, vol. 8, Feb 1962, pp 179- 187.
• miller93: Gene Miller , Greg Baber , Mark Gilliland, News on-demand for multimedia networks, Proceedings of the first ACM international conference on Multimedia, p.383-392, August 02-06, 1993, Anaheim, California, United States [doi>10.1145/166266.168432]
• mills92: Michael Mills , Jonathan Cohen , Yin Yin Wong, A magnifier tool for video data, Proceedings of the SIGCHI conference on Human factors in computing systems, p.93-98, May 03-07, 1992, Monterey, California, United States [doi>10.1145/142750.142764]
• novak92: C. L. Novak and S. A. Sharer, Anatomy of a Color Histogram, in Proceeding of Computer Vision and Pattern Recognition, Champaign, IL, June, 1992, pp 599-605.
• reiss91: T. H. Reiss, The revised Fundamental Theorem of Moment Invariants, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.13 n.8, p.830-834, August 1991 [doi>10.1109/34.85675]
• swain91: Michael J. Swain , Dana H. Ballard, Color indexing, International Journal of Computer Vision, v.7 n.1, p.11-32, Nov. 1991 [doi>10.1007/BF00130487]
• tonomura90: Tonomura, Y. and Abe, S., Content Oriented Visual Interface Using Video Icons for Visual Database Systems, in Journal of Visual Languages and Computing, vol. 1, 1990, pp 183-198.
• tonomura93: Yoshinobu Tonomura , Akihito Akutsu , Kiyotaka Otsuji , Toru Sadakata, VideoMAP and VideoSpaceIcon: tools for anatomizing video content, Proceedings of the SIGCHI conference on Human factors in computing systems, p.131-136, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169117]
• udea91: Hirotada Ueda , Takafumi Miyatake , Satoshi Yoshizawa, IMPACT: an interactive natural-motion-picture dedicated multimedia authoring system, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.343-350, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108939]
• ueda93: Hirotada Ueda , Takafumi Miyatake , Shigeo Sumino , Akio Nagasaka, Automatic structure visualization for video editing, Proceedings of the SIGCHI conference on Human factors in computing systems, p.137-141, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169118]
• zhang94: H-J. Zhang and W. Smoliar, Developing Power Tools for Video Indexing and Retrieval, in proceedings of SPIE conference on Storage and Retrieval for Image and Video Databases, San Jose, CA, 1994.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Abstracting methods
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Algorithms, Design