Smoke detection in video surveillance: the use of ViSOR (video surveillance on-line repository)

ABSTRACT

ViSOR (Video Surveillance Online Repository) is a large video repository, designed for containing annotated video surveillance footages, comparing annotations, evaluating system performance, and performing retrieval tasks. The web interface allows video browse, query by annotated concepts or by keywords, compressed video preview, media download and upload. The repository contains metadata annotations, both manually created ground-truth data and automatically obtained outputs of particular systems. An example of application is the collection of videos and annotations for smoke detection, an important video surveillance task. In this paper we present the architecture of ViSOR, the build-in surveillance ontology which integrates many concepts, also coming from LSCOM, and MediaMill, the annotation tools and the visualization of results for performance evaluation. The annotation is obtained with an automatic smoke detection system, capable to detect people, moving objects, and smoke in real-time.

REFERENCES

• 1: H. O. S. D. Branch. i-lids - imagery library for intelligent detection systems. Website, 2006. http://scienceandresearch.homeoffice.gov.uk/hosdb/.
• 2: R. Cucchiara, C. Grana, M. Piccardi, and A. Prati. Detecting moving objects, ghosts and shadows in video streams. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(10):1337--1342, Oct. 2003.
• 3: Tools and Techniques for Video Performance Evaluation, Proceedings of the International Conference on Pattern Recognition, p.4167, September 03-08, 2000
• 4: Alexandre R. J. Francois , Ram Nevatia , Jerry Hobbs , Robert C. Bolles, VERL: An Ontology Framework for Representing and Annotating Video Events, IEEE MultiMedia, v.12 n.4, p.76-86, October 2005 [doi>10.1109/MMUL.2005.87]
• 5: L. Kennedy. Revision of lscom event/activity annotations, dto challenge workshop on large scale concept ontology for multimedia. Technical report, Columbia University ADVENT, 2006.
• 6: S. G. Mallat, A Theory for Multiresolution Signal Decomposition: The Wavelet Representation, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.11 n.7, p.674-693, July 1989 [doi>10.1109/34.192463]
• 7: M. Naphade, L. Kennedy, J. R. Kender, S.-F. Chang, S. J. R., P. Over, and A. Hauptmann. A light scale concept ontology for multimedia understanding for trecvid 2005. Technical report, IBM Research, 2005.
• 8: Ram Nevatia , Jerry Hobbs , Bob Bolles, An Ontology for Video Event Representation, Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 7, p.119, June 27-July 02, 2004
• 9: A.-T. Nghiem, F. Bremond, M. Thonnat, and V. Valentin. Etiseo, performance evaluation for video surveillance systems. In Proceedings of AVSS 2007, 2007.
• 10: István Petrás , Csaba Beleznai , Yiğithan Dedeoğlu , Montse Pardàs , Levente Kovács , Zoltán Szlávik , László Havasi , Tamás Szirányi , B. Uğur Töreyin , Uğur Güdükbay , A. Enis Çetin , Cristian Canton-Ferrer, Flexible test-bed for unusual behavior detection, Proceedings of the 6th ACM international conference on Image and video retrieval, p.105-108, July 09-11, 2007, Amsterdam, The Netherlands [doi>10.1145/1282280.1282297]
• 11: P. Piccinini, S. Calderara, and R. Cucchiara. Reliable smoke detection system in the domains of image energy and color. In in press on 6th International Conference on Computer Vision Systems, Vision for Cognitive Systems, 2008.
• 12: Cees G. M. Snoek , Marcel Worring , Jan C. van Gemert , Jan-Mark Geusebroek , Arnold W. M. Smeulders, The challenge problem for automated detection of 101 semantic concepts in multimedia, Proceedings of the 14th annual ACM international conference on Multimedia, October 23-27, 2006, Santa Barbara, CA, USA [doi>10.1145/1180639.1180727]
• 13: C. Stauffer and W. Grimson. Adaptive background mixture models for real-time tracking. In Proceedings IEEE Conference on Computer Vision and Pattern Recognition, pages 246--252, 1999.
• 14: Visor portal. Website, 2007. http://imagelab.ing.unimore.it/visor.
• 15: Viper toolkit at sourceforge. Website, 2005. http://viper-toolkit.sourceforge.net/.
• 16: VSSN '06: Proceedings of the 4th ACM international workshop on Video surveillance and sensor networks, New York, NY, USA, 2006. ACM. General Chair-Jake K. Aggarwal and General Chair--Rita Cucchiara and Program Chair-Andrea Prati.
• 17: Pets: Performance evaluation of tracking and surveillance. Website, 2000-2007. http://www.cvg.cs.rdg.ac.uk/slides/pets.html.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries
          Subjects: Collection

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.7 Digital Libraries
          Subjects: Systems issues; Dissemination

General Terms:
Design, Management, Performance

Keywords:
annotation, smoke detection, video repository, video surveillance ontology