A general framework for automatic on-line replay detection in sports video

ABSTRACT

Replay detection is a pivotal step for sports video highlight extraction, which is a very promising application of multimedia analysis. In this paper, a general framework, which is based on a Bayesian network, is proposed to make full use of the multiple clues, including shot structure, gradual transition pattern, slow-motion, and sports scene. A novel algorithm based on motion vector reliability classification is proposed to analyze the gradual transition patterns, so that the replay detector can meet the requirements of automatic on-line applications. This is the first integrated general replay detection framework proposed in the literature. Extensive experiments on diversified sports games have proven the scheme efficient, accurate and robust.

REFERENCES

• 1: H. Pan, P. van Beek, et al, Detection of slow-motion replay segments in sports video for highlights generation, ICASSP 2001, vol. 3, pp. 1649--1652.
• 2: L. Wang, X. Liu, et al, Generic slow-motion replay detection in sports video, ICIP 2004, vol. 3, pp. 24--27.
• 3: L. Gu, D. Bone, et al, Replay detection in sports video sequences. Proc. the Eurographics Workshop on Multimedia 1999, Springer Verlag, pp. 3--12.
• 4: J. Wang, E. Chng, et al, "Soccer replay detection using scene transition structure analysis", ICASSP 2005, vol. 2, pp. 433--436.
• 5: H. Pan, B. Li, et al, Automatic detection of replay segments in broadcast sports programs by detection of logos in scene transitions, ICASSP 2002, vol. 4, pp. 3385--3388.
• 6: X. Tong, H. Lu, et al, Replay detection in broadcasting sports video, Int'l Conf Image & Graphics 2004, pp. 337--340.
• 7: Q. Huang, J. Hu, et al, A reliable logo and replay detector for sports video, ICME 2007, pp. 1695--1698.
• 8: B. Han, Y. Hu, et al, Enhanced Sports Video Shot Boundary Detection Based on Middle Level Features and a Unified Model, IEEE Trans. Consumer Electronics, vol. 53, no. 3, pp. 1168--1176, 2007.
• 9: Y. Hu, B. Han, et al, Enhanced Shot Change Detection using Motion Features for Soccer Video Analysis, ICME 2007, pp. 1555--1558.
• 10: D. Brezeale, and D. J. Cook, Automatic Video Classification: A Survey of the Literature, IEEE Trans. SMC - PART C, vol. 38, no. 3, pp. 416--430, 2008.
• 11: D. Comaniciu and P. Meer, Mean shift: a robust approach toward feature space analysis, IEEE Trans. PAMI, vol. 24, no. 5, pp. 603--619, 2002.
• 12: T. Yoshida, A. Miyamoto, et al, Reliability metric of motion vectors and its applications to motion estimation, Proc. SPIE, vol. 2501, VCIP 1995, pp. 799--809.
• 13: G. B. Rath, and A. Makur, Iterative least squares and compression based estimations for a four-parameter linear global motion model and global motion compensation, IEEE Trans. CSVT, vol. 9, no. 7, pp. 1075--1099, 1999.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Abstracting methods

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Computer vision

General Terms:
Algorithms, Experimentation

Keywords:
bayesian network, motion vector reliability, replay detection, sports video analysis