Middleware for video surveillance networks

ABSTRACT

Automated video surveillance networks are a class of sensor networks with the potential to enhance the protection of facilities such as airports and power stations from a wide range of threats. However, current systems are limited to networks of tens of cameras, not the thousands required to protect major facilities. Realising thousand camera automated surveillance networks demands middleware and architectural support; replacing the ad hoc approaches used in current systems with robust and scalable methods.This paper introduces middleware supporting both computation and communication in automated video surveillance networks. The computational approach is based on the Blackboard architectural style, which is widely used in signal processing and AI. Communication on the surveillance network follows the service oriented model, with publish/subscribe messaging; providing scalability, availability and the ability to integrate separately developed surveillance services. The middleware is demonstrated through its application to an important class of surveillance algorithms.

REFERENCES

• 1: Robert T. Collins , Alan J. Lipton , Takeo Kanade, Special Section on Video Surveillance, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.745-746, August 2000 [doi>10.1109/TPAMI.2000.868676]
• 2: D. Corkill. Blackboard systems. AI Expert, 6(9):40--47, September 1991.
• 3: H. Detmold, A. R. Dick, K. Falkner, D. S. Munro, A. van den Hengel, and R. Morrison. Scalable surveillance software architecture. In Proceedings of the IEEE International Conference on Advanced Video and Signal-based Surveillance (poster). (To appear), IEEE, November 2006.
• 4: A. Dick and M. J. Brooks. Issues in automated video surveillance. In Proc. 7th International Conference on Digital Image Computing: Techniques and Applications (DICTA'03), pages 1:195--204, Sydney, 2003.
• 5: A. Dick and M. J. Brooks. A stochastic approach to tracking objects across multiple cameras. In Proc. Australian Joint Conference on Artificial Intelligence, pages 160--170, 2004.
• 6: R. Enficiaud, B. Lienard, N. Allezard, R. Sebbe, S. Beucher, X. Desurmont, P. Sayd, and J. Delaigl. Clovis - a generic framework for general purpose visual surveillance applications. In IEEE Workshop on Visual Surveillance, pages 177--184, 2006.
• 7: Thomas Erl, Service-Oriented Architecture: Concepts, Technology, and Design, Prentice Hall PTR, Upper Saddle River, NJ, 2005
• 8: Barbara Hayes-Roth, A blackboard architecture for control, Artificial Intelligence, v.26 n.3, p.251-321, July 1985 [doi>10.1016/0004-3702(85)90063-3]
• 9: Penny Nii, Blackboard systems part two: Blackboard application systems, AI Magazine, v.7 n.3, p.82-106, August 1986
• 10: C. Regazzoni, V Ramesh, and G. Foresti. Scanning the issue/technology: Special issue on video communications, processing and understanding for third generation surveillance systems. Proc, of the IEEE, 89(10):1355--1366, 2001.
• 11: David Thomas , Andrew Hunt, Programming Ruby: the pragmatic programmer's guide, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2000
• 12: M. Valera Espina and S. A. Velastin. Intelligent distributed surveillance systems: A review. IEE Proceedings - Vision, Image and Signal Processing, 152(2):192--204, April 2005.
• 13: A. van den Hengel, A. R. Dick, and R. Hill. Activity topology estimation for large networks of cameras. In Proceedings of the IEEE International Conference on Advanced Video and Signal-based Surveillance. (To appear), IEEE, November 2006.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.11 Software Architectures
            Subjects: Patterns (e.g., client/server, pipeline, blackboard)

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems

General Terms:
Design, Performance

Keywords:
middleware, video surveillance networks