Experiential Sampling for video surveillance

ABSTRACT

Due to the decreasing costs and increasing miniaturization of video cameras, the use of digital video based surveillance as a tool for real-time monitoring is rapidly increasing. In this paper, we present a new methodology for real-time video surveillance based on Experiential Sampling. We use this framework to dynamically model the evolving attention in order to perform efficient monitoring. We exploit the context and past experience information in order to detect and track moving objects in surveillance videos. Moreover, we take the situation of multiple surveillance cameras into account and utilize the experiential sampling technique to decide which surveillance video stream to be displayed on the main monitor. This can tremendously help in reducing the manual operator fatigue for multiple monitor situation. We have implemented the developed algorithms and experimental results have been presented to illustrate the utility of the proposed technique.

REFERENCES

• 1: Carpenter, J. Clifford, P. and Fearnhead, P. Building Robust Simulation-based Filters for Evolving Data Sets. Technical report, University of Oxford, Dept. of Statistics, 1999.
• 2: Richard O. Duda , Peter E. Hart , David G. Stork, Pattern Classification (2nd Edition), Wiley-Interscience, 2000
• 3: Arnaud Doucet , Simon Godsill , Christophe Andrieu, On sequential Monte Carlo sampling methods for Bayesian filtering, Statistics and Computing, v.10 n.3, p.197-208, July 2000 [doi>10.1023/A:1008935410038]
• 4: Gian Luca Foresti , Petri Mahonen , Carlo S. Regazzoni, Multimedia Video-Based Surveillance Systems: Requirements, Issues and Solutions, Kluwer Academic Publishers, Norwell, MA, 2000
• 5: Ghahramani, Z., and Hinton, G. Parameter Estimation for Linear Dynamical Systems. Technical Report CRG-TR-96-2, Dept. Comp. Sci., Univ. Toronto, 1996. http://www.cs.toronto.edu/~hinton/absps/tr96-2.html.
• 6: Gordon, N. J. Salmond, D. J. and Smith, A. F. M. Novel approach to nonlinear/Non-Gaussian bayesian state estimation, in IEEE Proceedings, 140(2):107--113, 1993.
• 7: Granelli, F. Oberti, F. and Regazzoni, C. S. Adaptive post-processing error concealment based on feedback from a video-surveillance system, in Proceedings of ICIP 2000, (Vancouver, Canada, September 2000).
• 8: Michael Isard , Andrew Blake, C$ONDENSATION$—Conditional Density Propagation forVisual Tracking, International Journal of Computer Vision, v.29 n.1, p.5-28, Aug. 1998 [doi>10.1023/A:1008078328650]
• 9: Isaac, C. Medioni, G. Detecting and tracking moving objects for video surveillance, in Proceedings of ICPR (Fort Collins CO. Jun. 23--25, 1999).
• 10: Ramesh Jain, Experiential computing, Communications of the ACM, v.46 n.7, July 2003 [doi>10.1145/792704.792729]
• 11: Jain, R. Out-of the-Box Data Engineering. Keynote Address at International Conference on Data Engineering (ICDE 2003), March 2003.
• 12: Jain, R. Semantics in Multimedia Systems. Keynote Address at International Conference on Multi-Media Modeling (MMM 2003), Taipei, January 2003.
• 13: C. Kuhmunch, On the detection and recognition of television commercials, Proceedings of the 1997 International Conference on Multimedia Computing and Systems (ICMCS '97), p.509, June 03-06, 1997 [doi>10.1109/MMCS.1997.609763]
• 14: Marchesotti, L. Marcenaro, L. Regazzoni C. S. Tracking and counting multiple interacting pedestrian in indoor scenes, in Proceedings of third IEEE international workshop on performance evaluation of tracking and surveillance, (Copenhagen Denmark, June 1, 2002).
• 15: Marchesotti, L. Marcenaro, L. Regazzoni, C. S. A video surveillance architecture for alarm generation and video sequences retrieval, in Proceedings of ICIP2002 (Rochester NewYork USA, September 2002).
• 16: Marcenaro, L. Gianluca, G. Regazzoni, C. Adaptive change detection approach for object detection in outdoor scenes under variable speed illumination changes, in Proceedings of Eusipco 2000 (Tampere, Finland).
• 17: Marcenaro, L. Oberti, F. and Regazzoni, C. Change detection methods for automatic scene analysis by using mobile surveillance cameras, in Proceedings of ICIP 2000, (Vancouver Canada, September 2000).
• 18: Marcenaro, L. Regazzoni, C. S. Image-stabilization for video-surveillance applications, In Proceedings of ICIP2001 Thessaloniki, Greece, 2001.
• 19: Oberti, F. Marcenaro, L. Regazzoni, C. S. Real-time change detection methods for video-surveillance systems with mobile camera, in Proceedings of XI EUSIPCO2002, Toulouse France, September 2002.
• 20: Carlo S. Regazzoni , Gianni Vernazza , Gianni Fabri, Advanced Video-Based Surveillance Systems, Kluwer Academic Publishers, Norwell, MA, 1998
• 21: Paolo Remagnino , Carlo S. Regazzoni , Graeme A. Jones , Nikos Paragios, Video-Based Surveillance Systems: Computer Vision and Distributed Processing, Kluwer Academic Publishers, Norwell, MA, 2001
• 22: Rubin, D. B. Using the SIR Algorithm to Simulate Posterior Distributions (with discussion), in Bayesian Statistics 3, eds. J. M. Bernard, M. H. DeGroot, D. V. Lindley, and A. F. M. Smith, New York: Oxford University Press, pp. 395--402. 1998.
• 23: Stringa, E. Regazzoni, C. S. Content-based retrieval and real time detection from video sequences acquired by surveillance systems, in Proceedings of ICIP98 (Chicago Illinois, Oct. 1998), Vol. III, pp. 138--142.
• 24: Stringa, E. Sacchi, C. Regazzoni, C. S. A multimedia system for surveillance of unattended railway stations, in Proceedings of Eusipco1998 (Rhodes Greece, 1998), pp. 1709--1712.
• 25: Viola, P. and Jones, M. J. Robust real-time object detection. tech. rep. CRL 2001/01, Compaq Cambridge Research Laboratory, Cambridge, MA, 2001.
• 26: Jun Wang , Mohan S. Kankanhalli, Experience based sampling technique for multimedia analysis, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957081]
• 27: Yi Wu , Long Jiao , Gang Wu , Edward Chang , Yuan-Fang Wang, Invariant Feature Extraction and Biased Statistical Inference for Video Surveillance, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, p.284, July 21-22, 2003
• 28: http://www.comp.nus.edu.sg/~mohan/ebs/VideoSurveil.htm

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis

Additional Classification:
  I. Computing Methodologies
  I.6 SIMULATION AND MODELING
      I.6.5 Model Development

General Terms:
Algorithms, Design, Experimentation, Performance

Keywords:
dynamical systems, experiential computing, real-time, sampling, video surveillance