Real-time and accurate segmentation of moving objects in dynamic scene

ABSTRACT

Fast and accurate segmentation of moving objects in video sequences is a basic task in many computer vision and video analysis applications. It has a critical impact on the performance of object tracking and classification and activity analysis. This paper presents effective methods for solving this problem. Firstly, a fast and efficient algorithm is presented for background update to handle various sources of scene changes, including ghosts, left objects, camera shaking, and abrupt illumination changes. This is done by analyzing properties of object motion in image pixels and temporal frames, and combining both levels of constraints. Moreover, the algorithm does not need training sequence. Secondly, a real-time and accurate moving object segmentation algorithm is presented for moving object localization. Here, a novel filtering method is presented based on multiple scale and fast connected blob extraction. An intelligent video surveillance system is developed to test the performance of the algorithms. Experiments are performed using long video sequences under different conditions indoor and outdoor. The results show that the proposed algorithm is effective and efficient in real-time and accurate background update and moving object segmentation.

REFERENCES

• 1: Collins, Lipton, Kanade, Fujiyoshi, Duggins, Tsin, Tolliver, Enomoto, and Hasegawa. A System for Video Surveillance and Monitoring.VSAM Final Report, <http://www.ri.cmu.edu/pubs/pub_3325.html> Technical report CMU-RI-TR-00-12, Robotics Institute, Carnegie Mellon University, May, 2000.
• 2: Ismail Haritaoglu , Davis Harwood , Larry S. David, W4: Real-Time Surveillance of People and Their Activities, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.809-830, August 2000 [doi>10.1109/34.868683]
• 3: Pakorn KaewTrakulPong, Richard Bowden. A real time adaptive visual surveillance system for tracking low resolution colour targets in dynamically chaning scenes. Image and Vision Computing 21,2003, 913--929.
• 4: Cucchiara, R., Grana, C., Piccardi, M., Prati, A..Detecting moving objects, ghosts, and shadows in video streams. IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume: 25, Issue: 10, Oct. 2003,1337--1342.
• 5: Xu, H., Younis, A.A., Kabuka, M.R..Automatic Moving Object Extraction for Content-Based Applications. IEEE Transactions on Circuits and Systems for Video Technology,Volume: 14, Issue: 6, June 2004,796--812.
• 6: Shu-Ching Chen, Mei-Ling Shyu; Peeta, S., Chengcui Zhang. Learning-based spatio-temporal vehicle tracking and indexing for transportation multimedia database systems. IEEE Transactions on Intelligent Transportation Systems, Volume: 4, Issue: 3, Sept. 2003,154--167.
• 7: J. L. Barron , D. J. Fleet , S. S. Beauchemin, Performance of optical flow techniques, International Journal of Computer Vision, v.12 n.1, p.43-77, Feb. 1994 [doi>10.1007/BF01420984]
• 8: Chris Stauffer , W. Eric L. Grimson, Learning Patterns of Activity Using Real-Time Tracking, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.747-757, August 2000 [doi>10.1109/34.868677]
• 9: P. KawTraKulPong, R.Bowden. An improved adaptive background mixture model for real-time tracking with shadow detection. In Second European Workshop on Advanced Video-based Surveillance Systems,2001.
• 10: Liyuan Li , Weimin Huang , Irene Y. H. Gu , Qi Tian, Foreground Object Detection in Changing Background Based on Color Co-Occurrence Statistics, Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision, p.269, December 03-04, 2002
• 11: K. Toyama, J. Krumm, B. Brumitt, and B.Meyers. Wallflower: Principles and practice of background maintenance. Proceedings of IEEE International Conference on Computer Vision, 255--261,1999.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.6 Segmentation
          Subjects: Pixel classification

General Terms:
Algorithms

Keywords:
background modeling, foreground segmentation, video processing, video surveillance