Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Mining the video content itself can bring to light important information regarding the internal structure of large video databases, compensating for a lasting absence of extensive and reliable annotations. Many valuable links between video segments can be identified by content-based copy detection methods, where "copies" are transformed versions of original video sequences. To make this approach viable for large video databases, we put forward a new mining method relying on the definition of a compact keyframe-level descriptor and of a specific index structure. The performance obtained in detecting links between video segments is evaluated with the help of a ground truth and several illustrations are given. The scalability of the approach is then demonstrated for databases of up to 10,000 hours of video.

REFERENCES

• 1: Arvind Arasu , Venkatesh Ganti , Raghav Kaushik, Efficient exact set-similarity joins, Proceedings of the 32nd international conference on Very large data bases, September 12-15, 2006, Seoul, Korea
• 2: Roberto J. Bayardo , Yiming Ma , Ramakrishnan Srikant, Scaling up all pairs similarity search, Proceedings of the 16th international conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada [doi>10.1145/1242572.1242591]
• 3: Ondřej Chum , James Philbin , Michael Isard , Andrew Zisserman, Scalable near identical image and shot detection, Proceedings of the 6th ACM international conference on Image and video retrieval, p.549-556, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282359]
• 4: John M. Gauch , Abhishek Shivadas, Finding and identifying unknown commercials using repeated video sequence detection, Computer Vision and Image Understanding, v.103 n.1, p.80-88, July 2006 [doi>10.1016/j.cviu.2006.03.002]
• 5: Sébastien Poullot , Olivier Buisson , Michel Crucianu, Z-grid-based probabilistic retrieval for scaling up content-based copy detection, Proceedings of the 6th ACM international conference on Image and video retrieval, p.348-355, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282334]
• 6: T. Quack, V. Ferrari, and L. J. V. Gool. Video mining with frequent itemset configurations. In H. Sundaram, M. R. Naphade, J. R. Smith, and Y. Rui, eds., CIVR, LNCS vol. 4071, pp. 360--369. Springer, 2006.
• 7: Sunita Sarawagi , Alok Kirpal, Efficient set joins on similarity predicates, Proceedings of the 2004 ACM SIGMOD international conference on Management of data, June 13-18, 2004, Paris, France [doi>10.1145/1007568.1007652]
• 8: S. Satoh. News video analysis based on identical shot detection. In Proc. IEEE Intl. Conf. on Multimedia and Expo (ICME'02), pp. 69--72, 2002.
• 9: Shin'ichi Satoh , Masao Takimoto , Jun Adachi, Scene duplicate detection from videos based on trajectories of feature points, Proceedings of the international workshop on Workshop on multimedia information retrieval, September 24-29, 2007, Augsburg, Bavaria, Germany [doi>10.1145/1290082.1290115]
• 10: Josef Sivic , Andrew Zisserman, Video Google: A Text Retrieval Approach to Object Matching in Videos, Proceedings of the Ninth IEEE International Conference on Computer Vision, p.1470, October 13-16, 2003
• 11: M. Takimoto, S. Satoh, and M. Sakauchi. Identification and detection of the same scene based on flash light patterns. In Proc. IEEE Intl. Conf. on Multimedia and Expo (ICME'06), pp. 9--12, Los Alamitos, CA, USA, 2006. IEEE Computer Society.
• 12: Xiao Wu , Alexander G. Hauptmann , Chong-Wah Ngo, Novelty detection for cross-lingual news stories with visual duplicates and speech transcripts, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291274]
• 13: Xiao Wu , Alexander G. Hauptmann , Chong-Wah Ngo, Practical elimination of near-duplicates from web video search, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291280]
• 14: Xiao Wu , Wan-Lei Zhao , Chong-Wah Ngo, Near-duplicate keyframe retrieval with visual keywords and semantic context, Proceedings of the 6th ACM international conference on Image and video retrieval, p.162-169, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282309]
• 15: F. Yamagishi, S. Satoh, and M. Sakauchi. A news video browser using identical video segment detection. In K. Aizawa, Y. Nakamura, and S. Satoh, eds., PCM, LNCS vol. 3332, pp. 205--212. Springer, 2004.
• 16: Yun Zhai , Mubarak Shah, Tracking news stories across different sources, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101152]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Multimedia databases
      H.2.8 Database applications
          Subjects: Data mining

General Terms:
Design, Performance

Keywords:
content-based copy detection, similarity join, video mining