Event tactic analysis based on player and ball trajectory in broadcast video

ABSTRACT

Most of existing approaches on sports video analysis are concentrated on semantic event detection which is general audience oriented and the extracted events are presented to the audience without further analysis from tactic perspective. In this paper, we propose a novel approach to extract the tactic information and recognize the tactic patterns from goal events in broadcast soccer video. We extract the goal events with far-view shots using the analysis and alignment of web-casting text and broadcast video. For a detected goal event, a multi-object detection and tracking algorithm is employed to obtain the players and ball trajectories. An effective tactic representation called aggregate trajectory are constructed based on multi-object trajectories using a novel analysis of temporal-spatial interaction among the players and ball. The interactive relationship of aggregate trajectory and the hypothesis testing of the trajectory temporal-spatial distribution are employed to discover the tactic patterns in a hierarchical coarse-to-fine framework. The experimental results on FIFA World Cup 2006 show that the proposed approach is more effective than our previous work.

REFERENCES

• 1: Chua Hock Chuan, Automatic Parsing of TV Soccer Programs, Proceedings of the International Conference on Multimedia Computing and Systems, p.167, May 15-18, 1995 [doi>10.1109/MMCS.1995.484921]
• 2: A. Ekin, A.M. Tekalp, and R. Mehrotra, "Automatic soccer video analysis and summarization," IEEE Trans. Image Processing, vol. 12, no. 7, pp. 796--807, 2003.
• 3: Yong Rui , Anoop Gupta , Alex Acero, Automatically extracting highlights for TV Baseball programs, Proceedings of the eighth ACM international conference on Multimedia, p.105-115, October 2000, Marina del Rey, California, United States [doi>10.1145/354384.354443]
• 4: Jürgen Assfalg , Marco Bertini , Carlo Colombo , Alberto Del Bimbo , Walter Nunziati, Semantic annotation of soccer videos: automatic highlights identification, Computer Vision and Image Understanding, v.92 n.2-3, p.285-305, November/December 2003 [doi>10.1016/j.cviu.2003.06.004]
• 5: N. Babaguchi, Y. Kawai, T. Ogura, and T. Kitahashi, "Personalized abstraction of broadcasted American football video by highlight selection," IEEE Trans. Multimedia, vol. 6, no. 4, pp. 575--586, 2004.
• 6: A. Hanjalic, "Adaptive extraction of highlights from a sport video based on excitement modeling," IEEE Trans. Multimedia, vol. 7, no. 6, pp. 1114--1122, 2005.
• 7: Ling-Yu Duan , Min Xu , Tat-Seng Chua , Qi Tian , Chang-Sheng Xu, A mid-level representation framework for semantic sports video analysis, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957020]
• 8: Lexing Xie , Peng Xu , Shih-Fu Chang , Ajay Divakaran , Huifang Sun, Structure analysis of soccer video with domain knowledge and hidden Markov models, Pattern Recognition Letters, v.25 n.7, p.767-775, May 2004 [doi>10.1016/j.patrec.2004.01.005]
• 9: Guangyu Zhu , Changsheng Xu , Qingming Huang , Wen Gao , Liyuan Xing, Player action recognition in broadcast tennis video with applications to semantic analysis of sports game, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180728]
• 10: Changsheng Xu , Jinjun Wang , Kongwah Wan , Yiqun Li , Lingyu Duan, Live sports event detection based on broadcast video and web-casting text, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180699]
• 11: Guangyu Zhu , Qingming Huang , Changsheng Xu , Yong Rui , Shuqiang Jiang , Wen Gao , Hongxun Yao, Trajectory based event tactics analysis in broadcast sports video, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291250]
• 12: G. Sudhir , John C. M. Lee , Anil K. Jain, Automatic Classification of Tennis Video for High-level Content-based Retrieval, Proceedings of the 1998 International Workshop on Content-Based Access of Image and Video Databases (CAIVD '98), p.81, January 03-03, 1998
• 13: G. S. Pingali , Y. Jean , I. Carlbom, Real-Time Tracking for Enhanced Tennis Broadcasts, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.260, June 23-25, 1998
• 14: Jenny R. Wang , Nandan Parameswaran, Analyzing Tennis Tactics from Broadcasting Tennis Video Clips, Proceedings of the 11th International Multimedia Modelling Conference, p.102-106, January 12-14, 2005 [doi>10.1109/MMMC.2005.20]
• 15: P. Wang, R. Cai, and S.Q. Yang, "A tennis video indexing approach through pattern discovery in interactive process," in Proc. Pacific-Rim Conf. Multimedia, Tokyo, 2004, pp. 49--56.
• 16: N. Babaguchi, Y. Kawai, and T. Kitahashi, "Event based indexing of broadcasted sports video by intermodal collaboration," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 68--75, 2002.
• 17: Mei Han , Wei Hua , Wei Xu , Yihong Gong, An integrated baseball digest system using maximum entropy method, Proceedings of the tenth ACM international conference on Multimedia, December 01-06, 2002, Juan-les-Pins, France [doi>10.1145/641007.641081]
• 18: T. Taki, J. Hasegawa, and T. Fukumura, "Development of motion analysis system for quantitative evaluation of teamwork in soccer games," in Proc. Int. Conf. Image Processing, Lausanne, 1996, vol. 3, pp. 815--818.
• 19: Shoji Hirano , Shusaku Tsumoto, Finding interesting pass patterns from soccer game records, Proceedings of the 8th European Conference on Principles and Practice of Knowledge Discovery in Databases, p.209-218, September 20-24, 2004, Pisa, Italy
• 20: Chan-Hyun Kang , Jung-Rae Hwang , Ki-Joune Li, Trajectory Analysis for Soccer Players, Proceedings of the Sixth IEEE International Conference on Data Mining - Workshops, p.377-381, December 18-22, 2006 [doi>10.1109/ICDMW.2006.160]
• 21: {Online}. Available: http://soccernet.espn.go.com
• 22: Yiqun Li , Changsheng Xu , Kong Wah Wan , Xin Yan , Xinguo Yu, Reliable Video Clock Time Recognition, Proceedings of the 18th International Conference on Pattern Recognition, p.128-131, August 20-24, 2006 [doi>10.1109/ICPR.2006.993]
• 23: G. Zhu, C. Xu, Q. Huang, and W. Gao, "Automatic multi-player detection and tracking in broadcast sports video using support vector machine and particle filter," in Proc. Int. Conf. Multimedia & Expo, Toronto, 2006, pp. 1629--1632.
• 24: X. Yu, H.W. Leong, C. Xu, and Q. Tian, "Trajectory-based ball detection and tracking in broadcast soccer video," IEEE Trans. Multimedia, vol. 8, no. 6, pp. 1164--1178, 2006.
• 25: F. Dufaux and J. Konrad, "Efficient, robust, and fast global motion estimation for video coding," IEEE Trans. Image Processing, vol. 9, no. 3, pp. 497--501, 2000.
• 26: G.A. Korn and T.M. Korn, Math Handbook for Scientists and Engineers, New York: McGraw-Hill, 1968.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Motion

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Video analysis
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking; Object recognition

General Terms:
Algorithms, Experimentation, Management, Performance

Keywords:
broadcast video, event detection, object tracking, tactic analysis, trajectory analysis