Low cost soccer video summaries based on visual rhythm

ABSTRACT

The visual rhythm is a spatio-temporal sampled representation of video data providing compact information while preserving several types of video events.We exploit these properties in the present work to propose two new low level descriptors for the analysis of soccer videos computed directly from the visual rhythm.The descriptors are related to dominant color and camera motion estimation.The new descriptors are applied in different tasks aiming the analysis of soccer videos such as shot transition detection, shot classification and attack direction estimation.We also present a simple automated soccer summary application to illustrate the use of the new descriptors.

REFERENCES

• 1: S. S. Beauchemin , J. L. Barron, The computation of optical flow, ACM Computing Surveys (CSUR), v.27 n.3, p.433-466, Sept. 1995 [doi>10.1145/212094.212141]
• 2: Marco Bertini , Alberto Del Bimbo , Walter Nunziati, Player identification in soccer videos, Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval, November 10-11, 2005, Hilton, Singapore [doi>10.1145/1101826.1101833]
• 3: Francisco Nivando Bezerra, A Longest Common Subsequence Approach to Detect Cut and Wipe Video Transitions, Proceedings of the Computer Graphics and Image Processing, XVII Brazilian Symposium on (SIBGRAPI'04), p.154-160, October 17-20, 2004
• 4: Alberto Del Bimbo, Visual information retrieval, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1999
• 5: A. Ekin, A. M. Tekalp,and R. Mehrotra. Automatic soccer video analysis and summarization.IEEE Transactions on Image Processing 12(7):796--807, 2003.
• 6: M. G. Chung et al. Automatic video segmentation based in spatio-temporal features. Korea Telecom Journal 4(1):4--14, 1999.
• 7: Pascual Figueroa , Neucimar Leite , Ricardo M. L. Barros , Isaac Cohen , Gerard Medioni, Tracking Soccer Players using the Graph Representation, Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4, p.787-790, August 23-26, 2004 [doi>10.1109/ICPR.2004.950]
• 8: Silvio Jamil Ferzoli Guimarães , Michel Couprie , Arnaldo de Albuquerque Araújo , Neucimar Jerônimo Leite, Video segmentation based on 2D image analysis, Pattern Recognition Letters, v.24 n.7, p.947-957, April 2003 [doi>10.1016/S0167-8655(02)00218-0]
• 9: Hyeokman Kim , Jinho Lee , Jae-Heon Yang , Sanghoon Sull , Woonkyung M. Kim , S. Moon-Ho Song, Visual Rhythm and Shot Verification, Multimedia Tools and Applications, v.15 n.3, p.227-245, December 2001 [doi>10.1023/A:1012452131892]
• 10: Akio Nagasaka , Yuzuru Tanaka, Automatic Video Indexing and Full-Video Search for Object Appearances, Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II, p.113-127, September 30-October 03, 1991
• 11: C. W. Ngo, T. C. Pong, and R. T. Chin. Detection of gradual transitions through temporal slide analysis. In IEEE CVPR pages 36--41, 1999.
• 12: M. Osian and L. Van Gool. Video shot characterization. In TREC Video Retrieval Evaluation NIST, 2003.
• 13: Pierre Soille, Morphological Image Analysis: Principles and Applications, Springer-Verlag New York, Inc., Secaucus, NJ, 2003
• 14: Pierre Soille , Hugues Talbot, Directional Morphological Filtering, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.23 n.11, p.1313-1329, November 2001 [doi>10.1109/34.969120]
• 15: Kongwah Wan , Xin Yan , Xinguo Yu , Changsheng Xu, Real-time goal-mouth detection in MPEG soccer video, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957079]
• 16: Lei Wang , Michael Lew , Guangyou Xu, Offense based temporal segmentation for event detection in soccer video, Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval, October 15-16, 2004, New York, NY, USA [doi>10.1145/1026711.1026754]
• 17: A. Whitehead, J. Bose, and R. Laganière. Feature based cut detection with automatic threshold selection. In International Symposium on Signal Processing and Applications pages 410--418, Paris, july 2004.
• 18: Ramin Zabih , Justin Miller , Kevin Mai, A feature-based algorithm for detecting and classifying scene breaks, Proceedings of the third ACM international conference on Multimedia, p.189-200, November 05-09, 1995, San Francisco, California, United States [doi>10.1145/217279.215266]
• 19: HongJiang Zhang , Atreyi Kankanhalli , Stephen W. Smoliar, Automatic partitioning of full-motion video, Multimedia Systems, v.1 n.1, p.10-28, June 1993 [doi>10.1007/BF01210504]
• 20: H. J. Zhang, C. Y. Low, Y. Gong, and S. Smoliar. Video parsing using compressed data.In Proceedings SPIE Image and Video Processing II volume 2172, pages 142--149, 1994.
• 21: HJ. Zhang and S. W. Smoliar. Developing power tools for video indexing and retrieval.In Storage and Retrieval for Image and Video Databases II volume 2185 of SPIE Proceedings Series pages 140--149, 1994.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Computer vision

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION

General Terms:
Algorithms

Keywords:
camera motion estimation, dominant color, mathematical morphology, soccer video analisys