Interactive retrieval for multi-camera surveillance systems featuring spatio-temporal summarization

ABSTRACT

An interactive interface is presented for near-synchronized and distributed multi-camera surveillance systems. Human tracking using multiple cameras is conducted employing a particle filter in conjunction with linear least-square trajectory extrapolation and color histogram matching. Spatial and temporal statistical information such as histograms of the number of pedestrians on a timeline-basis, pedestrians' trajectories over a certain period, pedestrian flow, and so forth is efficiently summarized and visualized. In addition, a sketch-based retrieval interface is also developed. As a result, our system facilitates operators to easily extract and access to important scenes from a huge amount of surveillance data. The real-life experiments in the public street demonstrated the validity of our system.

REFERENCES

• 1: R. Visvanathan, C. Regazzoni and G. Foresti, "Scanning the issue technology - special issue on video communications, processing and understanding for third generation surveillance systems," Proc. IEEE, vol. 89, no. 10, pp. 1355--1367, Oct. 2001.
• 2: W. Hu, T. Tan, L. Wang, and S. Maybank, "A survey on visual surveillance of object motion and behaviors," IEEE TSMC, vol. 34, no. 3, Aug. 2004.
• 3: M. Valera and S. A. Velastin, "Intelligent distributed surveillance systems: a review," IEE Proceedings vision, image & signal processing, vol. 152, no. 2, pp. 192--204, Apr. 2005.
• 4: R. T. Collins, A. J. Lipton, T. Kanade, H. Fujiyoshi, D. Duggins, Y. Tsin, D. Tolliver, N. Enomoto, O. Hasegawa, P. Burt, and L. Wixson, "A System for Video Surveillance and Monitoring. VSAM Final Report," Technical report CMURI-TR-00-12, Robotics Institute, CMU, May, 2000.
• 5: T.-J. Fan , G. Medioni , R. Nevatia, Recognizing 3-D Objects Using Surface Descriptions, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.11 n.11, p.1140-1157, November 1989 [doi>10.1109/34.42853]
• 6: S. Calderara, R. Cucchiara, and A. Prati, "A distributed outdoor system for detection of abnormal people trajectories," Proc. ACM/IEEE ICDSC2007, pp. 364--371, 2007.
• 7: Ismail Haritaoglu , Davis Harwood , Larry S. David, W4: Real-Time Surveillance of People and Their Activities, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.809-830, August 2000 [doi>10.1109/34.868683]
• 8: O. Ozturk, T. Hayashi, T. Yamasaki, and K. Aizawa, "Content-aware bit-rate and replenishment control for video transmission of wireless multi-camera surveillance systems," Proc. ACM/IEEE ICDSC2007, pp. 394--395, 2007.
• 9: Andreas Girgensohn , Frank Shipman , Anthony Dunnigan , Thea Turner , Lynn Wilcox, Support for effective use of multiple video streams in security, Proceedings of the 4th ACM international workshop on Video surveillance and sensor networks, October 27-27, 2006, Santa Barbara, California, USA [doi>10.1145/1178782.1178787]
• 10: J. Black, T. Ellis, and D. Makris, "A hierarchical database for visual surveillance applications," Proc. IEEE ICME2004, pp. 1571--1574, 2004.
• 11: Gamhewage C. de Silva , Toshihiko Yamasaki , Kiyoharu Aizawa, Spatial querying for retrieval of locomotion patterns in smart environments, Proceedings of the 15th international conference on Multimedia, September 25-29, 2007, Augsburg, Germany [doi>10.1145/1291233.1291415]
• 12: R. Tsai, "A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf tv cameras and lenses," IEEE JRA, vol. 3, no. 4, pp. 323--344, Aug. 1987.
• 13: Michael Isard , Andrew Blake, C$ONDENSATION$—Conditional Density Propagation forVisual Tracking, International Journal of Computer Vision, v.29 n.1, p.5-28, Aug. 1998 [doi>10.1023/A:1008078328650]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking

General Terms:
Algorithms

Keywords:
multi-camera, sketch-based retrieval, surveillance