Exploiting temporal discontinuities for event detection and manipulation in video streams

ABSTRACT

Discontinuities in any information bearing signal serve to represent much of the vital or interesting content in that signal. A sharp loud noise in a movie could be a gun, or something breaking. In sports like tennis, cricket or snooker/pool it would indicate a point scoring event. In both cases the discontinuity is likely to be semantically relevant without further inference being necessary, once a particular domain is adopted. This paper discusses the importance of temporal motion discontinuities in inferring events in visual media. Two particular application domains are considered: content based audio/video synchronisation and event spotting in observational Psychology.

REFERENCES

• 1: J. Boreczky and L. A. Rowe. Comparison of video shot boundary detection techniques. In SPIE Proceedings of Storage and Retrieval for Image and Video Databases, pages 170--179, 1996.
• 2: P. Bouthémy, M. Gelgon, and F. Ganansia. A unified approach to shot change detection and camera motion characterization. IEEE Transactions on Circuits and Systems for Video Technology, 9:1030--1044, 1999.
• 3: H. Denman, N. Rea, and A. Kokaram. Content-based analysis for video from snooker broadcasts. Journal of Computer Vision and Image Understanding, Special Issue on Video Retrieval and Summarization, 92:141--306, November/December 2003.
• 4: A. Ekin, A. M. Tekalp, and R. Mehrotra. Automatic soccer video analysis and summarization. IEEE Transaction on Image Processing, 12(7):796--807, July 2003.
• 5: S. Goddard. A Teachers Window into a Child's Mind, A non-invasive approach to solving learning and behaviour problems. Fern Ridge Press, Oregon, 1996.
• 6: K. S. Holt. Child Development: Diagnosis and Assessment. Butterworth-Heineman Ltd, 1991.
• 7: R. S. Illingworth. The Development of the Infant and Young Child: Normal and Abnormal. Churchill Livingstone, 8th Edition, London, 1983.
• 8: L. Joyeux , E. Doyle , H. Denman , A. C. Crawford , A. Bousseau , A. Kokaram , R. Fuller, Content based access for a massive database of human observation video, Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval, October 15-16, 2004, New York, NY, USA [doi>10.1145/1026711.1026720]
• 9: A. Kokaram and P. Delacourt. A new global estimation algorithm and its application to retrieval in sport events. In IEEE International Workshop on Multimedia Signal Processing, October 2001.
• 10: Anil C. Kokaram, Motion Picture Restoration: Digital Algorithms for Artefact Suppression in Degraded Motion Picture Film and Video, Springer-Verlag, London, 1998
• 11: M. McPhillips, P. G. Hepper, and G. Mulhern. Effects of replicating primary-reflex movements on specific reading difficulties in children; a randomised double-blind, controlled trial. Lancet, 355:537--541, 2000.
• 12: J.-M. Odobez and P. Bouthemy. Robust multiresolution estimation of parametric motion models. Journal of Visual Communication and Image Representation, 6(4), December 1995.
• 13: P. Peer, J. Kovac, and F. Solina. Human skin colour clustering for face detection. In EUROCON 2003 - International Conference on Computer as a Tool, 2003.
• 14: N. Rea, R. Dahyot, and A. Kokaram. Modeling high level structure in sports with motion driven hmms. In IEEE International Conference on Acoustics, Speech, and Signal Processing, volume~3, pages 621--624, May 2004.
• 15: N. Rea, R. Dahyot, and A. Kokaram. Semantic event detection in sports through motion understanding. In 3rd International Conference on Image and Video Retrieval (CIVR 04), July 2004.
• 16: E. D. Scheirer. Tempo and beat analysis of acoustic musical signals. Journal of the Acoustic Society of America, 103(1):588-601, 1998.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing
          Subjects: Indexing methods

General Terms:
Algorithms

Keywords:
bayesian inference, event spotting, information retrieval, motion tracking, video retrieval