Take a look at the new version of this page: [ beta version ]. Tell us what you think.

ABSTRACT

Conventional video cameras have limited fields of view which make them restrictive for certain applications in computational vision. A catadioptric sensor uses a combination of lenses and mirrors placed in a carefully arranged configuration to capture a much wider field of view. One important design goal for catadioptric sensors is choosing the shapes of the mirrors in a way that ensures that the complete catadioptric system has a single effective viewpoint. The reason a single viewpoint is so desirable is that it is a requirement for the generation of pure perspective images from the sensed images. In this paper, we derive the complete class of single-lens single-mirror catadioptric sensors that have a single viewpoint. We describe all of the solutions in detail, including the degenerate ones, with reference to many of the catadioptric systems that have been proposed in the literature. In addition, we derive a simple expression for the spatial resolution of a catadioptric sensor in terms of the resolution of the cameras used to construct it. Moreover, we include detailed analysis of the defocus blur caused by the use of a curved mirror in a catadioptric sensor.

REFERENCES

• 1: Adelson, E.H. and Bergen, J.R. 1991. The plenoptic function and elements of early vision. In <i>Computational Models of Visual Processing </i>, chap. 1, Landy and Movshon (Eds.), MIT Press.
• 2: Simon Baker , Shree K. Nayar, A Theory of Catadioptric Image Formation, Proceedings of the Sixth International Conference on Computer Vision, p.35, January 04-07, 1998
• 3: Bogner, S. 1995. Introduction to panoramic imaging. In <i>Proceedings of the IEEE SMC Conference</i>, pp. 3100-3106.
• 4: Born, M. and Wolf, E. 1965. <i>Principles of Optics</i>. Permagon Press.
• 5: Chahl, J.S. and Srinivassan, M.V. 1997. Reflective surfaces for panoramic imaging. <i>Applied Optics</i>, 36(31):8275-8285.
• 6: Charles, J.R., Reeves, R., and Schur, C. 1987. How to build and use an all-sky camera. <i>Astronomy Magazine</i>, April.
• 7: Drucker, D. and Locke, P. 1996. A natural classification of curves and surfaces with reflection properties. <i>Mathematics Magazine</i>, 69(4):249-256.
• 8: Steven J. Gortler , Radek Grzeszczuk , Richard Szeliski , Michael F. Cohen, The lumigraph, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.43-54, August 1996 [doi>10.1145/237170.237200]
• 9: Goshtasby, A. and Gruver, W.A. 1993. Design of a single-lens stereo camera system. <i>Pattern Recognition</i>, 26(6):923-937.
• 10: Hecht, E. and Zajac, A. <i>Optics</i>. Addison-Wesley.
• 11: Hong, J. 1991. Image based homing. In <i>Proceedings of the IEEE International Conference on Robotics and Automation</i>.
• 12: Inaba, M., Hara, T., and Inoue, H. 1993. A stereo viewer based on a single camera with view-control mechanism. In <i>Proceedings of the International Conference on Robots and Systems</i>.
• 13: Murphy, J.R. 1995. Application of panoramic imaging to a teleoperated lunar rover. In <i>Proceedings of the IEEE SMC Conference</i>, pp. 3117-3121.
• 14: Nalwa, V.S. 1996. A true omnidirectional viewer. Technical Report, Bell Laboratories, Holmdel, NJ 07733, USA.
• 15: Nayar, S.K. 1988. Sphereo: Recovering depth using a single camera and two specular spheres. In <i>Proceedings of SPIE: Optics, Illumination, and Image Sensing for Machine Vision II</i>.
• 16: Shree K. Nayar, Catadioptric Omnidirectional Camera, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.482, June 17-19, 1997
• 17: Nayar, S.K. 1997b. Omnidirectional video camera. In <i>Proceedings of the 1997 DARPA Image Understanding Workshop</i>.
• 18: Nayar, S.K. and Baker, S. 1997. Catadioptric image formation. In <i>Proceedings of the 1997 DARPA Image Understanding Workshop</i>, New Orleans, Louisiana, pp. 1431-1437.
• 19: Sameer A. Nene , Shree K. Nayar, Stereo with Mirrors, Proceedings of the Sixth International Conference on Computer Vision, p.1087, January 04-07, 1998
• 20: Peri, V. and Nayar, S.K. 1997. Generation of perspective and panoramic video from omnidirectional video. In <i>Proceedings of the 1997 DARPA Image Understanding Workshop</i>, New Orleans.
• 21: Rees, D.W. 1970. Panoramic television viewing system. United States Patent No. 3,505,465.
• 22: Yagi, Y. and Kawato, S. 1990. Panoramic scene analysis with conic projection. In <i>Proceedings of the International Conference on Robots and Systems</i>.
• 23: Yagi, Y., Kawato, S., and Tsuji, S. 1994. Real-time omnidirectional image sensor (COPIS) for vision-guided navigation. <i>IEEE Transactions on Robotics and Automation</i>, 10(1):11-22.
• 24: Yagi, Y. and Yachida, M. 1991. Real-time generation of environmental map and obstacle avoidance using omnidirectional image sensor with conic mirror. In <i>Proceedings of the 1991 Conference on Computer Vision and Pattern Recognition</i>, pp. 160- 165.
• 25: Yamazawa, K., Yagi, Y., and Yachida, M. 1993. Omnidirectional imaging with hyperboloidal projection. In <i>Proceedings of the International Conference on Robots and Systems</i>.
• 26: Yamazawa, K., Yagi, Y., and Yachida, M. 1995. Obstacle avoidance with omnidirectional image sensor HyperOmni Vision. In <i>Proceedings of the IEEE International Conference on Robotics and Automation</i>, pp. 1062-1067.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.9 Robotics
          Subjects: Sensors

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Computer vision

General Terms:
Design, Measurement, Performance, Theory

Keywords:
defocus blur, image formation, omnidirectional imaging, panoramic imaging, sensor design, sensor resolution