DOTS: support for effective video surveillance

ABSTRACT

DOTS (Dynamic Object Tracking System) is an indoor, real-time, multi-camera surveillance system, deployed in a real office setting. DOTS combines video analysis and user interface components to enable security personnel to effectively monitor views of interest and to perform tasks such as tracking a person. The video analysis component performs feature-level foreground segmentation with reliable results even under complex conditions. It incorporates an efficient greedy-search approach for tracking multiple people through occlusion and combines results from individual cameras into multi-camera trajectories. The user interface draws the users. attention to important events that are indexed for easy reference at a later time. Different views within the user interface provide spatial information for easier navigation. Our system, with over twenty video cameras installed in hallways and other public spaces in our office building, has been in constant use for almost a year.

REFERENCES

• 1: VR Security. http://www.3vr.com/
• 2: F. Arman , R. Depommier , A. Hsu , M.-Y. Chiu, Content-based browsing of video sequences, Proceedings of the second ACM international conference on Multimedia, p.97-103, October 15-20, 1994, San Francisco, California, United States [doi>10.1145/192593.192630]
• 3: Edoardo Ardizzone , Marco La Cascia , Giuseppe Lo Re , Marco Ortolani, An integrated architecture for surveillance and monitoring in an archaeological site, Proceedings of the third ACM international workshop on Video surveillance & sensor networks, November 11-11, 2005, Hilton, Singapore [doi>10.1145/1099396.1099413]
• 4: Pradeep K. Atrey , Mohan S. Kankanhalli , Ramesh Jain, Timeline-based information assimilation in multimedia surveillance and monitoring systems, Proceedings of the third ACM international workshop on Video surveillance & sensor networks, November 11-11, 2005, Hilton, Singapore [doi>10.1145/1099396.1099416]
• 5: Axis Communications. http://www.axis.com/
• 6: Rita Cucchiara, Multimedia surveillance systems, Proceedings of the third ACM international workshop on Video surveillance & sensor networks, November 11-11, 2005, Hilton, Singapore [doi>10.1145/1099396.1099399]
• 7: R. Cucchiara , C. Grana , G. Tardini, Track-based and object-based occlusion for people tracking refinement in indoor surveillance, Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks, October 15-15, 2004, New York, NY, USA [doi>10.1145/1026799.1026814]
• 8: Gareth Daniel , Min Chen, Video Visualization, Proceedings of the 14th IEEE Visualization 2003 (VIS'03), p.54, October 22-24, 2003 [doi>10.1109/VISUAL.2003.1250401]
• 9: Energy Control, Inc. http://energyctrl.com/security.htm
• 10: Andreas Girgensohn , Frank Shipman , Thea Turner , Lynn Wilcox, Effects of presenting geographic context on tracking activity between cameras, Proceedings of the SIGCHI conference on Human factors in computing systems, April 28-May 03, 2007, San Jose, California, USA [doi>10.1145/1240624.1240801]
• 11: Guardian Solutions. http://www.guardiansolutions.com/
• 12: A. Hampapur, L. M. Brown, J. Connell, M. Lu, H. Merkl, S. Pankanti, A. W. Senior, C.-F. Shu, and Y.-L. Tian. Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking. IEEE Signal Processing Magazine, Vol. 22, No. 2, pp. 38--51, 2005.
• 13: Larry Huston , Rahul Sukthankar , Jason Campbell , Padmanabhan Pillai, Forensic video reconstruction, Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks, October 15-15, 2004, New York, NY, USA [doi>10.1145/1026799.1026805]
• 14: Giancarlo Iannizzotto , Carlo Costanzo , Francesco La Rosa , Pietro Lanzafame, A multimodal perceptual user interface for video-surveillance environments, Proceedings of the 7th international conference on Multimodal interfaces, October 04-06, 2005, Torento, Italy [doi>10.1145/1088463.1088475]
• 15: Johnson Controls. http://www.johnsoncontrols.com/security/Default.htm
• 16: S. Khan and M. Shah. Consistent labeling of tracked objects in multiple cameras with overlapping fields of view. Proc. IEEE Trans. on Pattern Analysis and Machine Intelligence, Volume 25, No. 10, pages 1355--1360, October 2003.
• 17: D. Kimber, T. Dunnigan, A. Girgensohn, F. Shipman, T. Turner, and T. Yang. Trailblazing: video playback control by direct object manipulation. ICME, 2007.
• 18: Pavel Korshunov , Wei Tsang Ooi, Critical video quality for distributed automated video surveillance, Proceedings of the 13th annual ACM international conference on Multimedia, November 06-11, 2005, Hilton, Singapore [doi>10.1145/1101149.1101172]
• 19: L3 Communications. http://www.l3praetorian.com/
• 20: J. P. Lewis. Fast normalized cross-correlation. In Vision Interface, 1995.
• 21: S. McKenna, S. Jabri, Z. Duric, and H. Wechsler. Tracking Groups of People. Proc. Computer Vision and Image Understanding, 2000.
• 22: MySQL. http://www.mysql.com/
• 23: ObjectVideo. http://www.objectvideo.com/products/
• 24: Panasonic. Security Products. http://www.panasonic.com/business/security/
• 25: Padmanabhan Pillai , Yan Ke , Jason Campbell, Multi-fidelity storage, Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks, October 15-15, 2004, New York, NY, USA [doi>10.1145/1026799.1026812]
• 26: F. Porikli , A. Divakaran, Multi-camera calibration, object tracking and query generation, Proceedings of the 2003 International Conference on Multimedia and Expo, p.653-656, July 06-09, 2003
• 27: H. S. Sawhney , A. Arpa , R. Kumar , S. Samarasekera , M. Aggarwal , S. Hsu , D. Nister , K. Hanna, Video flashlights: real time rendering of multiple videos for immersive model visualization, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 28: Ismail Oner Sebe , Jinhui Hu , Suya You , Ulrich Neumann, 3D video surveillance with Augmented Virtual Environments, First ACM SIGMM international workshop on Video surveillance, November 02-08, 2003, Berkeley, California [doi>10.1145/982452.982466]
• 29: Chris Stauffer , W. Eric L. Grimson, Learning Patterns of Activity Using Real-Time Tracking, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.747-757, August 2000 [doi>10.1109/34.868677]
• 30: Vidient. http://www.vidient.com/
• 31: VistaScape Security System. http://www.vistascape.com/
• 32: Guangyu Wang , Tien-Tsin Wong , Pheng-Ann Heng, Real-time surveillance video display with salience, Proceedings of the third ACM international workshop on Video surveillance & sensor networks, November 11-11, 2005, Hilton, Singapore [doi>10.1145/1099396.1099403]
• 33: Jun Wang , Mohan S Kankanhalli , Weiqi Yan , Ramesh Jain, Experiential Sampling for video surveillance, First ACM SIGMM international workshop on Video surveillance, November 02-08, 2003, Berkeley, California [doi>10.1145/982452.982462]
• 34: Gang Wu , Yi Wu , Long Jiao , Yuan-Fang Wang , Edward Y. Chang, Multi-camera spatio-temporal fusion and biased sequence-data learning for security surveillance, Proceedings of the eleventh ACM international conference on Multimedia, November 02-08, 2003, Berkeley, CA, USA [doi>10.1145/957013.957126]
• 35: T. Yang, F. Chen, D. Kimber, and J. Vaughan. Robust people detection and tracking in a multi-camera indoor visual surveillance system. ICME, 2007.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Tracking; Motion

General Terms:
Algorithms, Design, Human Factors

Keywords:
multiple video streams, person tracking, security cameras, video surveillance