Interactive reconstruction of virtual environments from photographs, with application to scene-of-crime analysis

ABSTRACT

There are many real-world applications of Virtual Reality that require the construction of complex and accurate three-dimensional models, suitably structured for interactive manipulation. In this paper, we present semi-automatic methods that allow such environments to be quickly and easily built from photographs taken with uncalibrated cameras, and illustrate the techniques by application to the real-world problem of scene-of-crime reconstruction.

REFERENCES

• 1: http://www.forensic-training.police.uk/.
• 2: Paul A. Beardsley , Philip H. S. Torr , Andrew Zisserman, 3D Model Acquisition from Extended Image Sequences, Proceedings of the 4th European Conference on Computer Vision-Volume II, p.683-695, April 15-18, 1996
• 3: P. A. Beardsley , A. Zisserman , D. W. Murray, Sequential Updating of Projective and Affine Structure from Motion, International Journal of Computer Vision, v.23 n.3, p.235-259, June/July 1997 [doi>10.1023/A:1007923216416]
• 4: S. Becker and V. M. B. Jr. Semi-automatic 3-d model extraction from uncalibrated 2-d camera views. SPIE Symposium on Electronic Imaging: Science & Technology, San Jose, February 1995.
• 5: B. Caprile , V. Torre, Using vanishing points for camera calibration, International Journal of Computer Vision, v.4 n.2, p.127-140, Mar. 1990 [doi>10.1007/BF00127813]
• 6: R. Cipolla and E. Boyer. 3d model acquisition from uncalibrated images. Proc. IAPR Workshop on Machine Vision Applications, Chiba, Japan, pages 559-568, November 19981
• 7: R. Cipolla, T. Drummond, and D. Robertson. Camera calibration from vanishing points in images of architectural scenes. Proc. British Machine Vision Conference, Nottingham, 2:382-391, September 1999.
• 8: R. Cipolla, D. Robertson, and E. Boyer. Photobuilder - 3d models of architectural scenes from uncalibrated images. Proc. IEEE International Conference on Multimedia Computing and Systems, I:25-31, June 1999.
• 9: Paul E. Debevec , Camillo J. Taylor , Jitendra Malik, Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.11-20, August 1996 [doi>10.1145/237170.237191]
• 10: Olivier Faugeras, Three-dimensional computer vision: a geometric viewpoint, MIT Press, Cambridge, MA, 1993
• 11: Andrew W. Fitzgibbon , Andrew Zisserman, Automatic Camera Recovery for Closed or Open Image Sequences, Proceedings of the 5th European Conference on Computer Vision-Volume I, p.311-326, June 02-06, 1998
• 12: Henry Fuchs , Zvi M. Kedem , Bruce Naylor, Predetermining visibility priority in 3-D scenes (Preliminary Report), Proceedings of the 6th annual conference on Computer graphics and interactive techniques, p.175-181, August 08-10, 1979, Chicago, Illinois, United States
• 13: Richard I. Hartley, Euclidean Reconstruction from Uncalibrated Views, Proceedings of the Second Joint European - US Workshop on Applications of Invariance in Computer Vision, p.237-256, October 09-14, 1993
• 14: Berthold K. P. Horn, Relative orientation, International Journal of Computer Vision, v.4 n.1, p.59-78, Jan. 1990 [doi>10.1007/BF00137443]
• 15: T. Howard, S. Gibson, and A. Murta. Virtual environments for scene of crime reconstruction and analysis. In Proc. SPIE/IS&T, San Jose, CA, volume 3960, January 2000.
• 16: D. Liebowitz, A. Criminisi, and A. Zisserman. Creating architectural models from images. Computer Graphics Forum (Proc. Eurographics '99), 18(3), September 1999.
• 17: A. Murta, S. Gibson, T. Howard, R. Hubbold, and A. West. Modelling and rendering for scene of crime reconstruction: A case study. In Proc. Eurographics UK, Leeds', pages 169-173, March 1998.
• 18: Eyal Ofek , Erez Shilat , Ari Rappoport , Michael Werman, Multiresolution Textures from Image Sequences, IEEE Computer Graphics and Applications, v.17 n.2, p.18-29, March 1997 [doi>10.1109/38.574667]
• 19: Camillo J. Taylor , David J. Kriegman, Structure and Motion from Line Segments in Multiple Images, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.17 n.11, p.1021-1032, November 1995 [doi>10.1109/34.473228]
• 20: Yizhou Yu , Paul Debevec , Jitendra Malik , Tim Hawkins, Inverse global illumination: recovering reflectance models of real scenes from photographs, Proceedings of the 26th annual conference on Computer graphics and interactive techniques, p.215-224, July 1999 [doi>10.1145/311535.311559]
• 21: C. L. Zitnick and T. Kanade. A volumetric iterative approach to stereo matching and occlusion detection. Technical Report CMU-RI-TR-98-30, The Robotics Institute, Carnegie Mellon University, December 1998.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Modeling and recovery of physical attributes

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling
          Subjects: Modeling packages
      I.3.7 Three-Dimensional Graphics and Realism
          Subjects: Color, shading, shadowing, and texture; Virtual reality
      I.3.8 Applications
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Stereo

General Terms:
Algorithms, Measurement

Keywords:
Computer Vision, Model Building, Photogrammetry, Scene of Crime Reconstruction, Texture, Virtual Reality