Tracking and video surveillance activity analysis

ABSTRACT

The explosion in the number of cameras surveilling the environment in recent years is generating a need for systems capable of analysing video streams for important events. This paper outlines a system for detecting noteworthy behaviours (from a security or surveillance perspective) which does not involve the enumeration of the event sequences of all possible activities of interest. Instead the focus is on calculating a measure of the abnormality of the action taking place. This raises the need for a low complexity tracking algorithm robust to the noise artefacts present in video surveillance systems. The tracking technique described herein achieves this goal by using a "future history" buffer of images and so delaying the classification and tracking of objects by the time quantum which is the buffer size. This allows disambiguation of noise blobs and facilitates classification in the case of occlusions and disappearance of people due to lighting, failures in the background model etc.

REFERENCES

• 1: Butler, D., Sridharan, S., and Bove, Jnr, V. 2003, Real-time adaptive background segmentation. In International Conference on Acoustics, Speech and Signal Processing, 349--352.
• 2: Dee, H., and Hogg, D. 2004. Detecting inexplicable behaviour. In British Machine Vision Conference, 477--486.
• 3: Thi V. Duong , Hung H. Bui , Dinh Q. Phung , Svetha Venkatesh, Activity Recognition and Abnormality Detection with the Switching Hidden Semi-Markov Model, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.838-845, June 20-26, 2005 [doi>10.1109/CVPR.2005.61]
• 4: Fenimore, C., Libert, J., and Roitman, P. 2000. Mosquito noise in mpeg-compressed video: test patterns and metrics. In Proc. SPIE Conf. Human Vision and Electronic Imaging.
• 5: Fishbein, M., and Ajzen, I. 1975. Belief, Attitude, Intention and Behaviour: An Introduction to Theory and Research. Addison-Wesley, Sydney.
• 6: Michael Isard , Andrew Blake, C$ONDENSATION$—Conditional Density Propagation forVisual Tracking, International Journal of Computer Vision, v.29 n.1, p.5-28, Aug. 1998 [doi>10.1023/A:1008078328650]
• 7: Jorge, P. M., Marques, J. S., and Abrantes, A. J. 2004. On-line tracking groups of pedestrians with bayesian networks. In 6th International Workshop on Performance Evaluation for tracking and Surveillance.
• 8: Nuria M. Oliver , Barbara Rosario , Alex P. Pentland, A Bayesian Computer Vision System for Modeling Human Interactions, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.831-843, August 2000 [doi>10.1109/34.868684]
• 9: Troscianko, T., Holmes, A., Stillman, J., Mirmehdi, M., Wright, D., and Wilson, A. 2004. What happens next? the predictability of natural behaviour viewed through cctv cameras. Perception 33, 1, 87--101.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking

Keywords:
tracking, video processing, video surveillance