Multimedia surveillance systems

ABSTRACT

The integration of video technology and sensor networks constitutes the fundamental infrastructure for new generations of multimedia surveillance systems, where many different media streams (audio, video, images, textual data, sensor signals) will concur to provide an automatic analysis of the controlled environment and a real-time interpretation of the scene. New solutions can be devised to enlarge the view of traditional surveillance systems by means of distributed architectures with fixed and active cameras, to enhance their view with other sensed data, to explore multi-resolution views with zooming and omnidirectional cameras. Applications regard surveillance of wide indoor and outdoor area and particularly people surveillance: in this case, multimedia surveillance systems can be enriched with biometric technology; the best views of detected persons and their extracted visual features (e.g. faces, voices, trajectories) can be exploited for people identification.VSSN05 is the third edition of the workshop, co-located at ACM Multimedia Conference, that embraces research reports on video surveillance and, since the edition of 2004, sensor networks. This paper gives a short overview of the hot topics in multimedia surveillance systems and introduces some research activities currently engaged in the world and presented at VSSN05.

REFERENCES

• 1: Proc. of ACM Workshop of Video Surveillance, Nov 2003.
• 2: Proc. of the second ACM Workshop of Video Surveillance & Sensor Networks, oct 2004.
• 3: J. K. Aggarwal , Q. Cai, Human motion analysis: a review, Computer Vision and Image Understanding, v.73 n.3, p.428-440, March 1999 [doi>10.1006/cviu.1998.0744]
• 4: J. Aldrige and C. Gilbert. Testing on cctv perimeter surveillance systems. In PSDB Publication, (14), 1995.
• 5: S. Birchfield, Elliptical Head Tracking Using Intensity Gradients and Color Histograms, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p.232, June 23-25, 1998
• 6: K.W. Bowyer. Face recognition technology and the security versus privacy tradeoff. In IEEE Technology and Society, volume 1, pages 9--20, 2004.
• 7: R.R. Brooks, P. Ramanathan, and A.M. Sayeed. Distributed target classification and tracking in sensor networks. In Proc. of the IEEE, volume 91, pages 1163--1171, 2003.
• 8: S. Calderara, R. Vezzani, A Prati, and R. Cucchiara. Entry edge of field of view for multi camera tracking in distributed video surveillance. In IEEE Int'l Conf. on Advanced Video and Signal-Based Surveillance, 2005.
• 9: R.T. Collins, A.J. Lipton, H. Fujiyoshi, and T. Kanade. Algorithms for cooperative multisensor surveillance. In Proc. of the IEEE, volume 89, pages 1456--1477, Oct. 2001.
• 10: Cash J. Costello , Christopher P. Diehl , Amit Banerjee , Hesky Fisher, Scheduling an active camera to observe people, Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks, October 15-15, 2004, New York, NY, USA [doi>10.1145/1026799.1026808]
• 11: R. Cucchiara, C. Grana, A. Prati, and R. Vezzani. Probabilistic posture classification for indoor surveillance. IEEE Trans. on Systems, Man, and Cybernetics - Part A, 35(1):42--54, jan 2005.
• 12: R. Cucchiara, A. Prati, and R. Vezzani. Ambient intelligence for security in public parks: the laica project. In Proc. of IEE International Symposium on Imaging for Crime Detection and Prevention, 2005.
• 13: T. Ebrahimi, Y. Abdeljaoued, R. Figueras i Ventura, and O. Divorra Escoda. Mpeg-7 camera. In Proc. of IEEE Int'l Conf. on Image Processing, volume 3, pages 600--603, 2001.
• 14: Douglas A. Fidaleo , Hoang-Anh Nguyen , Mohan Trivedi, The networked sensor tapestry (NeST): a privacy enhanced software architecture for interactive analysis of data in video-sensor networks, Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks, October 15-15, 2004, New York, NY, USA [doi>10.1145/1026799.1026809]
• 15: Tarak Gandhi , Mohan M. Trivedi, Calibration of a reconfigurable array of omnidirectional cameras using a moving person, Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks, October 15-15, 2004, New York, NY, USA [doi>10.1145/1026799.1026804]
• 16: D. M. Gavrila, The visual analysis of human movement: a survey, Computer Vision and Image Understanding, v.73 n.1, p.82-98, Jan. 1999 [doi>10.1006/cviu.1998.0716]
• 17: E. Hjelm and B.K. Low. Face detection: A survey. Computer Vision and Image Understanding, 83(3):236--274, 2001.
• 18: http://www.intel.com/research/mrl/research/opencv/. OpenCV library, Intel.
• 19: W. Hu, T. Tan, L. Wang, and S. Maybank. A survey on visual surveillance of object motion and behaviors. IEEE Trans. on Systems, Man, and Cybernetics - Part C, 34(3):334--352, August 2004.W. Hu, T. Tan, L. Wang, and S. Maybank. A survey on visual surveillance of object motion and behaviors. IEEE Trans. on Systems, Man, and Cybernetics - Part C, 34(3):334--352, August 2004.
• 20: Michael J. Jones , James M. Rehg, Statistical color models with application to skin detection, International Journal of Computer Vision, v.46 n.1, p.81-96, January 2002 [doi>10.1023/A:1013200319198]
• 21: Jinman Kang, I. Cohen, and G. Medioni. Continuous tracking within and across camera streams. In Proc. of IEEE Int'l Conf. on Computer Vision and Pattern Recognition, volume 1, pages I--267--I--272, 2003.
• 22: S. Khan and M. Shah. Consistent labeling of tracked objects in multiple cameras with overlapping fields of view. IEEE Trans. on Pattern Analysis and Machine Intelligence, 25(10):1355--1360, October 2003.
• 23: Young-Ouk Kim , Joonki Paik , Jingu Heo , Andreas Koschan , Besma Abidi , Mongi Abidi, Automatic Face Region Tracking for Highly Accurate Face Recognition in Unconstrained Environments, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, p.29, July 21-22, 2003
• 24: P. Kumar, S. Ranganath, Huang Weimin, and K. Sengupta. Framework for real-time behavior interpretation from traffic video. IEEE Transactions on Intelligent Transportation Systems, 6(1):43--53, March 2005.
• 25: Kam-Yiu Lam , Calvin K. H. Chiu, Adaptive visual object surveillance with continuously moving panning camera, Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks, October 15-15, 2004, New York, NY, USA [doi>10.1145/1026799.1026806]
• 26: R.J. Lopes, A.T. Lindsay, and D. Hutchison. The utility of mpeg-7 systems in audio-visual applications with multiple streams. IEEE Trans. Circuits Systems for Video Technology, 13(1):16--25, 2003.
• 27: D. Maio and D. Maltoni. Real-time face location on gray-scale static images. Pattern Recognition, 33(9):1525--1539, sep 2000.
• 28: Thomas B. Moeslund , Erik Granum, A survey of computer vision-based human motion capture, Computer Vision and Image Understanding, v.81 n.3, p.231-268, March 2001 [doi>10.1006/cviu.2000.0897]
• 29: M. Valera and S.A. Velastin. Intelligent distributed surveillance systems: a review vision. In Image and Signal Processing, IEE Proceedings, volume 152, pages 192--204, April 2005.
• 30: P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In Proc. of IEEE Int'l Conf. on Computer Vision and Pattern Recognition, 2001.
• 31: L. Wang, W. Hu, T. Tan, and S. Maybank. A survey on visual surveillance of object motion and behaviors. IEEE Trans. on Systems, Man and Cybernetics, 3:334--352, 2004.
• 32: Ming-Hsuan Yang , David J. Kriegman , Narendra Ahuja, Detecting Faces in Images: A Survey, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.1, p.34-58, January 2002 [doi>10.1109/34.982883]
• 33: Tao Zhao , Ram Nevatia, Tracking Multiple Humans in Complex Situations, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.26 n.9, p.1208-1221, September 2004 [doi>10.1109/TPAMI.2004.73]
• 34: W. Zhao , R. Chellappa , P. J. Phillips , A. Rosenfeld, Face recognition: A literature survey, ACM Computing Surveys (CSUR), v.35 n.4, p.399-458, December 2003 [doi>10.1145/954339.954342]
• 35: Xuhui Zhou , Robert T. Collins , Takeo Kanade , Peter Metes, A master-slave system to acquire biometric imagery of humans at distance, First ACM SIGMM international workshop on Video surveillance, November 02-08, 2003, Berkeley, California [doi>10.1145/982452.982467]
• 36: B. Zitova and J. Flusser. Image registration methods: a survey. Image and Vision Computing, (21):977--1000, 2003.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis

General Terms:
Algorithms, Design, Security

Keywords:
multiple cameras, sensor network, survey, video surveillance