Real-time surveillance video display with salience

ABSTRACT

In this paper, we aim at providing a means for efficient display of surveillance video. In video surveillance, usually, there are certain regions of interest (ROIs), such as entrance or exit, and moving objects or persons, which should be paid more attention. By tracking and locally zooming the ROI, the proposed method adds salience on it to help surveillant to locate such important region effectively. Here, salience means highlighting special region locally. Given an input video signal, the ROI is detected first. The original video frame is mapped as a texture on a deformed mesh to produce the zoom effect. The position and shape of the ROI determine the mesh deformation. By experiment, we show that the proposed method is effective and efficient.

REFERENCES

• 1: David A. Forsyth , Jean Ponce, Computer Vision: A Modern Approach, Prentice Hall Professional Technical Reference, 2002
• 2: A. S. Glassner, "Cubism and cameras: Free-form optics for computer graphics," Microsoft Research MSR-TR-2000-05 January 2000.
• 3: ..,"Digital cubism,"Computer Graphics and Applications, IEEE vol.24,no.3, pp.82--90, May-June 2004.
• 4: Andrew Glassner, Digital Cubism, Part 2, IEEE Computer Graphics and Applications, v.24 n.4, p.84-95, July 2004 [doi>10.1109/MCG.2004.4]
• 5: Daniel N. Wood , Adam Finkelstein , John F. Hughes , Craig E. Thayer , David H. Salesin, Multiperspective panoramas for cel animation, Proceedings of the 24th annual conference on Computer graphics and interactive techniques, p.243-250, August 1997 [doi>10.1145/258734.258859]
• 6: S. Vallance and P. R. Calder, "Multi-perspective images for visualisation."in Visual Information Processing 2001, pp. 69--76.
• 7: H. T. Nguyen and A. W. M. Smeulders, "Fast occluded object tracking by a robust appearance filter,"IEEE Trans. Pattern Anal. Machine Intell. super-vol.26,no.8,pp.1099--1104, August 2004.
• 8: Hui-Huang Hsu , Timothy K. Shih , Chia-Tong Tang , Yi-Chun Liao, Real-Time Multiple Tracking Using a Combined Technique, Proceedings of the 19th International Conference on Advanced Information Networking and Applications, p.111-116, March 25-30, 2005 [doi>10.1109/AINA.2005.290]
• 9: Tao Yang , Stan Z. Li , Quan Pan , Jing Li, Real-time and accurate segmentation of moving objects in dynamic scene, Proceedings of the ACM 2nd international workshop on Video surveillance & sensor networks, October 15-15, 2004, New York, NY, USA [doi>10.1145/1026799.1026822]
• 10: G. Unal,H. Krim,and A. Yezzi,"Fast incorporation of optical .ow into active polygons,"IEEE Transactions on Image Processing vol.14,no.6, pp. 745--759, June 2005.
• 11: B.D. Lucas, "An iterative registration technique with an application to stereo vision,"in Proceedings DARPA Image Understanding Workshop April 1981, pp. 121--130.
• 12: B. Li and R. Chellappa, "A generic approach to simultaneous tracking and veri .cation in video," IEEE Transactions on Image Processing vol.11,no.5,pp. 530--544, May 2002.
• 13: A. Blake and M. Isard, Active Contours London, U.K.: Springer Verlag, 1998.
• 14: Masaaki Oka , Kyoya Tsutsui , Akio Ohba , Yoshitaka Kurauchi , Takashi Tago, Real-time manipulation of texture-mapped surfaces, ACM SIGGRAPH Computer Graphics, v.21 n.4, p.181-188, July 1987
• 15: P. Haeberli and M. Segal, "Texture mapping as a fundamental drawing primitive," 1993. {Online}. Available: http://www.sgi.com/misc/grafica/texmap/
• 16: V. Peri and S. Nayar, "Generation of perspective and panoramic video from omnidirectional video," in Proc. of DARPA Image Understanding Workshop 1997, pp. 243--246.
• 17: V. Setlur, "Optimizing computer imagery for communication." {Online}. Available: http://www.cs.northwestern.edu/~vidya/VidyaResearchDescription.pdf

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis

Additional Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.3 Enhancement

General Terms:
Algorithms

Keywords:
image warping, texture mapping, tracking, video surveillance