Video-cuebik: adapting image search to video shots

ABSTRACT

We propose a new analysis for searching images in video libraries that goes beyond simple image search, which compares one still image frame to another. The key idea is to expand the definition of an image to account for the variability in the sequence of video frames that comprise a shot. A first implementation of this method for a QBIC-like image search engine shows a clear improvement over still image search. A combination of the traditional still image search and the new video image search provided the overall best results on the TREC video retrieval evaluation data.

REFERENCES

• 1: Arnold W. M. Smeulders , Marcel Worring , Simone Santini , Amarnath Gupta , Ramesh Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.12, p.1349-1380, December 2000 [doi>10.1109/34.895972]
• 2: James Hafner , Harpreet S. Sawhney , Will Equitz , Myron Flickner , Wayne Niblack, Efficient Color Histogram Indexing for Quadratic Form Distance Functions, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.17 n.7, p.729-736, July 1995 [doi>10.1109/34.391417]
• 3: The TREC Video Retrieval Track, http://www-nlpir.nist.gov/projects/t01v, 2001
• 4: E.M. Voorhees, and D.M. Tice, "The TREC-8 Question Answering Track Report," The Eighth Text Retrieval Conference (TREC-8), 2000
• 5: S.-F. Chang, W. Chen, H.J. Meng, H. Sundaram, and D. Zhong, "A Fully Automatic Content-Based Video Search Engine Supporting Multi-Object Spatio-Temporal Queries," IEEE Trans. on Circuits and Systems for Video Techn., 8(5), pp.602--615, Sep. 1998
• 6: A. Mojsilovic, J. Kovacevic, J. Hu, R.J. Safranek, and S.K. Ganapathy, "Matching and Retrieval Based on the Vocabulary and Grammar of Color Patterns," IEEE Trans. Image Processing, 9(1), pp. 38--54, 2000

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications

General Terms:
Algorithms, Experimentation, Measurement

Keywords:
image retrieval, query by image content, video search