Localization and mapping of surveillance cameras in city map

ABSTRACT

Many large cities have installed surveillance cameras to monitor human activities for security purposes. An important surveillance application is to track the motion of an object of interest, e.g., a car or a human, using one or more cameras, and plot the motion path in a city map. To achieve this goal, it is necessary to localize the cameras in the city map and to determine the correspondence mappings between the positions in the city map and the camera views. Since the view of the city map is roughly orthogonal to the camera views, there are very few common features between the two views for a computer vision algorithm to correctly identify corresponding points automatically. This paper proposes a method for camera localization and position mapping that requires minimum user inputs. Given approximate corresponding points between the city map and a camera view identified by a user, the method computes the orientation and position of the camera in the city map, and determines the mapping between the positions in the city map and the camera view. Both quantitative tests and practical application test have been performed. It can obtain the best-fit solutions even though the user-specified correspondence is inaccurate. The performance of the method is assessed in both quantitative tests and practical application. Quantitative test results show that the method is accurate and robust in camera localization and position mapping. Application test results are very encouraging, showing the usefulness of the method in real applications.

REFERENCES

• 1: K. S. Arun , T. S. Huang , S. D. Blostein, Least-squares fitting of two 3-D point sets, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.9 n.5, p.698-700, Sept. 1987 [doi>10.1109/TPAMI.1987.4767965]
• 2: M. Betke and L. Gurvits. Mobile robot localization using landmarks. IEEE Trans. on Robotics and Automation, 13(2):251--262, 1997.
• 3: J.-Y. Bouguet. Camera Calibration Toolbox for Matlab, www.vision.caltech.edu/~bouguetj/calib doc/.
• 4: R. Collins, A. Lipton, H. Fujiyoshi, and T. Kanade. Algorithms for cooperative multisensor surveillance. Proc. of the IEEE, 89(10):1456--1477, 2001.
• 5: Rita Cucchiara, Multimedia surveillance systems, Proceedings of the third ACM international workshop on Video surveillance & sensor networks, November 11-11, 2005, Hilton, Singapore [doi>10.1145/1099396.1099399]
• 6: P. Debevec and H. Hoberman. Viewfinder. interactive.usc.edu/viewfinder/.
• 7: Globsl positioning system, en.wikipedia.org/wiki/gps.
• 8: Ismail Haritaoglu , Davis Harwood , Larry S. David, W4: Real-Time Surveillance of People and Their Activities, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.8, p.809-830, August 2000 [doi>10.1109/34.868683]
• 9: Janne Heikkila , Olli Silven, A Four-step Camera Calibration Procedure with Implicit Image Correction, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.1106, June 17-19, 1997
• 10: Y. Hel-Or and M. Werman. Absolute orientation from uncertain data: A unified approach. In Proc. CVPR, pages 77--82, 1992.
• 11: B. K. P. Horn, H. M. Hilden, and S. Negahdaripour. Cloed-form solution of absolute orientation using orthonormal matrices. J. Optical Society of America A, 5(7):1127--1135, 1988.
• 12: W. Hu, T. Tan, L. Wang, and S. Maybank. A survey on visual surveillance of object motion and behaviors. IEEE Trans. on SMC, Part C, 34(3):334--352, 2004.
• 13: K. Josephson, M. Byrod, F. Kahl, and K. Astrom. Image-based localization using hybrid feature correspondences. In Proc. IEEE CVPR, 2007.
• 14: P. Newman, J. Leonard, J. Neira, and J.Tardos. Explore and return: Experimental validation of real time concurrent mapping and localization. In Proc. Int. Conf. Robotics and Automation, pages 1802--1809, 2002.
• 15: F. Qureshi and D. Terzopoulos. Surveillance in virtual reality: System design and multicamera control. In Proc. of IEEE CVPR, 2007.
• 16: E. G. Rieffel, A. Girgensohn, D. Kimber, T. Chen, and Q. Liu. Geometric tools for multicamera surveillance systems. In Porc. IEEE Int. Conf. on Distributed Smart Camera, 2007.
• 17: S. Se, D. Lowe, and J. Little. Vision-based global localization and mapping for mobile robots. IEEE Trans. on Robotics, 21(3):364--375, 2005.
• 18: S. Thrun, M. Beetz, M. Bennewitz, W. Burgard, A. B. Cremers, F. Dellaert, D. Fox, D. Hähnel, C. Rosenberg, N. Roy, J. Schulte, and D. Schulz. Probabilistic algorithms and the interactive museum tour-guide robot minerva. Int. J. of Robotics Research, 19(11):972--999, 2000.
• 19: R. Y. Tsai. A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robotics and Automation, 3(4):323--344, 1987.
• 20: Shinji Umeyama, Least-Squares Estimation of Transformation Parameters Between Two Point Patterns, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.13 n.4, p.376-380, April 1991 [doi>10.1109/34.88573]
• 21: Zhengyou Zhang, A Flexible New Technique for Camera Calibration, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.11, p.1330-1334, November 2000 [doi>10.1109/34.888718]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.9 Applications

General Terms:
Algorithms, Experimentation

Keywords:
camera localization, position mapping, surveillance