Semantic concept extraction from sports video for highlight generation

ABSTRACT

A multi-layered, hierarchical framework for generic sports event analysis has been proposed in this paper. Each layer uses different features such as short-time audio energy, short-time Zero Crossing Rate, color histogram, fractal dimension, motion, etc and classifiers such as Hidden Markov Model, threshold-based classifier, etc. We demonstrate our approach on sports video. The automated semantic concept extraction is ideally required for application such as highlight generation, indexing and retrieval.

REFERENCES

• 1: E. Kijak , G. Gravier , P. Gros , L. Oisel , F. Bimbot, HMM based structuring of tennis videos using visual and audio cues, Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 3 (ICME '03), p.309-312, July 06-09, 2003
• 2: J. Assfalg and M. Bertini and A. Del Bimbo and W. Nunziati and P. Pala, Detection and recognition of football highlights using HMM, in 9th Int. Conf. on Electronics, Circuits and Systems, vol. 3, pp. 1059--1062, 2002.
• 3: P. Chang and M. Han and Y. Gong, Extract Highlights from Baseball Game Video with Hidden Markov Models, in Proc. of Int. Conf. on Image Processing, vol. 1, pp. 609--612, 2002.
• 4: A. Hanjalic, Generic approach to highlights extraction from a sports video, in Proc. of IEEE Int. Conf. on Image Processing, vol. 1, pp. 1--4, 2003.
• 5: M. H. Kolekar, S. N. Talbar and T. R. Sontakke, Texture Segmentation using Fractal Signature, in IETE Journal of Research, vol. 5, pp. 319--323, 2000.
• 6: Dian Tjondronegoro , Yi-Ping Phoebe Chen , Binh Pham, The power of play-break for automatic detection and browsing of self-consumable sport video highlights, Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval, October 15-16, 2004, New York, NY, USA [doi>10.1145/1026711.1026755]
• 7: L. Baoxin and H. Pan and I. Sezan, A general framework for sports video summarization with its application to soccer, in Proc. of Int Conf on Acoustics, Speech and Signal Processing, vol. 3, pp. 169--172, 2003.
• 8: M. H. Kolekar and S. Sengupta, A Hierarchical Framework for Generic Sports Video Classification, in Lecture Notes on Computer Science (LNCS), Springer-Verlag Berlin Heidelberg, vol. 3852, pp. 633--642, 2006.
• 9: W. Hsu and L. Kennedy and C. W. Huang and S. F. Chang and C. Y. Lin and G. Iyengar, News video story segmentation using fusion of multi-level multi-modal features in TRECVID 2003, in Proc. of Int Conf on Acoustics, Speech and Signal Processing, vol. 3, pp. 645--648, 2004.
• 10: Xingquan Zhu , Xindong Wu , Ahmed K. Elmagarmid , Zhe Feng , Lide Wu, Video Data Mining: Semantic Indexing and Event Detection from the Association Perspective, IEEE Transactions on Knowledge and Data Engineering, v.17 n.5, p.665-677, May 2005 [doi>10.1109/TKDE.2005.83]
• 11: J. Fan and H. Luo and A. K. Elmagarmid, Concept-oriented indexing of video databases: toward semantic sensitive retrieval and browsing, in IEEE Transactions on Image Processing, vol. 7 (13), pp. 974--992, 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL

General Terms:
Algorithms, Experimentation

Keywords:
a priori algorithm, association, semantic concept, sports highlights