Distributed localization of networked cameras

ABSTRACT

Camera networks are perhaps the most common type of sensor network and are deployed in a variety of real-world applications including surveillance, intelligent environments and scientific remote monitoring. A key problem in deploying a network of cameras is calibration, i.e., determining the location and orientation of each sensor so that observations in an image can be mapped to locations in the real world. This paper proposes a fully distributed approach for camera network calibration. The cameras collaborate to track an object that moves through the environment and reason probabilistically about which camera poses are consistent with the observed images. This reasoning employs sophisticated techniques for handling the difficult nonlinearities imposed by projective transformations, as well as the dense correlations that arise between distant cameras. Our method requires minimal overlap of the cameras' fields of view and makes very few assumptions about the motion of the object. In contrast to existing approaches, which are centralized, our distributed algorithm scales easily to very large camera networks. We evaluate the system on a real camera network with 25 nodes as well as simulated camera networks of up to 50 cameras and demonstrate that our approach performs well even when communication is lossy.

REFERENCES

• 1: X. Boyen and D. Koller. Tractable inference for complex stochastic processes. In Proc. UAI, 1998.
• 2: Robert G. Cowell , Steffen L. Lauritzen , A. Philip David , David J. Spiegelhalter , V. Nair , J. Lawless , M. Jordan , David J. Spiegelhater, Probabilistic Networks and Expert Systems, Springer-Verlag New York, Inc., Secaucus, NJ, 1999
• 3: S. Funiak, C. Guestrin, M. Paskin, and R. Sukthankar. Robust probabilistic filtering in distributed systems. Technical Report CMU-CALD-05-111, Carnegie Mellon Univ., 2005.
• 4: Alexander T. Ihler , John W. Fisher, III , Randolph L. Moses , Alan S. Willsky, Nonparametric belief propagation for self-calibration in sensor networks, Proceedings of the third international symposium on Information processing in sensor networks, April 26-27, 2004, Berkeley, California, USA [doi>10.1145/984622.984656]
• 5: S. Khan and M. Shah. Consistent labeling of tracked objects in multiple cameras with overlapping fields of view. IEEE PAMI, 25(10), 2003.
• 6: U. Lerner. Hybrid Bayesian Networks for Reasoning about Complex Systems. PhD thesis, Stanford, 2002.
• 7: W. Mantzel, H. Choi, and R. Baraniuk. Distributed Camera Network Localization. In Asilomar Conference on Signals, Systems, and Computers, 2004.
• 8: D. Nistér. Automatic dense reconstruction from uncalibrated video. PhD thesis, Royal Inst. of Tech., 2001.
• 9: Mark Paskin , Carlos Guestrin , Jim McFadden, A robust architecture for distributed inference in sensor networks, Proceedings of the 4th international symposium on Information processing in sensor networks, April 24-27, 2005, Los Angeles, California
• 10: M. A. Paskin. Thin junction tree filters for simultaneous localization and mapping. In Proc. IJCAI, 2003.
• 11: Mark A. Paskin , Carlos E. Guestrin, Robust probabilistic inference in distributed systems, Proceedings of the 20th conference on Uncertainty in artificial intelligence, p.436-445, July 07-11, 2004, Banff, Canada
• 12: Marc Pollefeys , Luc Van Gool , Maarten Vergauwen , Frank Verbiest , Kurt Cornelis , Jan Tops , Reinhard Koch, Visual Modeling with a Hand-Held Camera, International Journal of Computer Vision, v.59 n.3, p.207-232, September-October 2004 [doi>10.1023/B:VISI.0000025798.50602.3a]
• 13: A. Rahimi, B. Dunagan, and T. Darrell. Simultaneous calibration and tracking with a network of non-overlapping sensors. In CVPR, 2004.
• 14: Stefano Soatto , Pietro Perona, Reducing "Structure From Motion": A General Framework for Dynamic Vision Part 1: Modeling, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.20 n.9, p.933-942, September 1998 [doi>10.1109/34.713360]
• 15: C. Stauffer and K. Tieu. Automated multi-camera planar tracking correspondence modeling. In CVPR, 2003.
• 16: S. Thrun. Affine structure from sound. In NIPS, 2005.
• 17: E. A. Wan and R. van der Merwe. The unscented Kalman filter for nonlinear estimation. In Proc. Adaptive Sys. for Signal Proc., Comm. and Control, 2000.
• 18: Kamin Whitehouse , Chris Karlof , Alec Woo , Fred Jiang , David Culler, The effects of ranging noise on multihop localization: an empirical study, Proceedings of the 4th international symposium on Information processing in sensor networks, April 24-27, 2005, Los Angeles, California

INDEX TERMS

Primary Classification:
  G. Mathematics of Computing
  G.3 PROBABILITY AND STATISTICS

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture
          Subjects: Camera calibration

General Terms:
Algorithms, Experimentation

Keywords:
graphical models, sensor networks