Digital inspection: an interactive stage for viewing surface details

ABSTRACT

In a wide range of applications, we often wish to quickly inspect and visualize historically significant and highly detailed objects. For such scientific illustration applications, often the focus is on high-frequency surface details and on conveying important shape and feature information. In our work, we provide a complete system to visualize objects on the spot. Our approach uses photometric and geometric processing, combined with a set of visualization methods tuned to the interactive inspection and analysis of objects. Highly accurate models are acquired in about 30 seconds using an uncalibrated setup, obtaining both detailed surface geometry and detailed surface normal information. Subsequently, captured objects are visually tracked enabling hand-held manipulation and visualization. In this paper, we demonstrate our system using several real-world objects.

REFERENCES

• 1: David Akers , Frank Losasso , Jeff Klingner , Maneesh Agrawala , John Rick , Pat Hanrahan, Conveying Shape and Features with Image-Based Relighting, Proceedings of the 14th IEEE Visualization 2003 (VIS'03), p.46, October 22-24, 2003 [doi>10.1109/VISUAL.2003.1250392]
• 2: Pascal Barla , Joëlle Thollot , Lee Markosian, X-toon: an extended toon shader, Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, June 05-07, 2006, Annecy, France [doi>10.1145/1124728.1124749]
• 3: Alberto Bartesaghi , Guillermo Sapiro , Tom Malzbender , Dan Gelb, Three-dimensional shape rendering from multiple images, Graphical Models, v.67 n.4, p.332-346, July 2005 [doi>10.1016/j.gmod.2005.02.002]
• 4: Ronen Basri , David Jacobs , Ira Kemelmacher, Photometric Stereo with General, Unknown Lighting, International Journal of Computer Vision, v.72 n.3, p.239-257, May 2007 [doi>10.1007/s11263-006-8815-7]
• 5: Peter N. Belhumeur , David J. Kriegman , Alan L. Yuille, The Bas-Relief Ambiguity, International Journal of Computer Vision, v.35 n.1, p.33-44, Nov. 1999 [doi>10.1023/A:1008154927611]
• 6: Paul Debevec, Virtual Cinematography: Relighting through Computation, Computer, v.39 n.8, p.57-65, August 2006 [doi>10.1109/MC.2006.285]
• 7: Raanan Fattal , Maneesh Agrawala , Szymon Rusinkiewicz, Multiscale shape and detail enhancement from multi-light image collections, ACM Transactions on Graphics (TOG), v.26 n.3, July 2007
• 8: Christian Frueh , Avideh Zakhor, Capturing 2½D Depth and Texture of Time-Varying Scenes Using Structured Infrared Light, Proceedings of the Fifth International Conference on 3-D Digital Imaging and Modeling, p.318-325, June 13-16, 2005 [doi>10.1109/3DIM.2005.26]
• 9: Ryo Furukawa , Hiroshi Kawasaki, Uncalibrated Multiple Image Stereo System with Arbitrarily Movable Camera and Projector for Wide Range Scanning, Proceedings of the Fifth International Conference on 3-D Digital Imaging and Modeling, p.302-309, June 13-16, 2005 [doi>10.1109/3DIM.2005.80]
• 10: Jongwoo Lim , Jeffrey Ho , Ming-Hsuan Yang , David Kriegman, Passive Photometric Stereo from Motion, Proceedings of the Tenth IEEE International Conference on Computer Vision, p.1635-1642, October 17-20, 2005 [doi>10.1109/ICCV.2005.185]
• 11: Chang Ha Lee , Xuejun Hao , Amitabh Varshney, Light Collages: Lighting Design for Effective Visualization, Proceedings of the conference on Visualization '04, p.281-288, October 10-15, 2004 [doi>10.1109/VIS.2004.62]
• 12: Koninckx T. P., Griesser A., Van Gool L., "Real-time Range Scanning of Deformable Surfaces by Adaptively Coded Structured Light", Proc. of 3DIM, 293--300, 2003.
• 13: Malzbender T., Wilburn B., Gelb D., Ambrisco B., "Surface Enhancement Using Real-time Photometric Stereo and Reflectance Transformation", European Symposium on Rendering, 245--250, 2006.
• 14: Vincent Masselus , Philip Dutré , Frederik Anrys, The free-form light stage, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 15: Diego Nehab , Szymon Rusinkiewicz , James Davis , Ravi Ramamoorthi, Efficiently combining positions and normals for precise 3D geometry, ACM SIGGRAPH 2005 Papers, July 31-August 04, 2005, Los Angeles, California
• 16: Manuel M. Oliveira , Gary Bishop , David McAllister, Relief texture mapping, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.359-368, July 2000 [doi>10.1145/344779.344947]
• 17: Ramesh Raskar , Kar-Han Tan , Rogerio Feris , Jingyi Yu , Matthew Turk, Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging, ACM SIGGRAPH 2004 Papers, August 08-12, 2004, Los Angeles, California
• 18: Rushmeier H., Bernardini F., "Computing Consistent Normals and Colors from Photometric Data", 3DIM, 99--108, 1999.
• 19: Szymon Rusinkiewicz , Olaf Hall-Holt , Marc Levoy, Real-time 3D model acquisition, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 20: Szymon Rusinkiewicz , Michael Burns , Doug DeCarlo, Exaggerated shading for depicting shape and detail, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 21: Scharstein S., Szeliski R., "High-Accuracy Stereo Depth Maps Using Structured Light", IEEE CVPR, 195--202, 2003.
• 22: Waschbüsch M., Würmlin S., Cotting D., Sadlo F., Gross M., "Scalable 3D Video of Dynamic Scenes", The Visual Computer, 21(8-10), 629--638, 2005.
• 23: Willems G., Verbiest F., Moreau W., Hameeuw H., van Lerbeghe K., van Gool L., "Easy and Cost-Effective Cuneiform Digitizing", Int. Symposium on Virtual Reality, Archaeology, and Cultural Heritage, 2005.
• 24: Winnemoller H., Mohan A., Tumblin J., Gooch B., "Light Waving: Estimating Light Positions from Photographs Alone", Comp. Graphics Forum (Eurographics), 24(3), 433--438, 2005.
• 25: R. J. Woodham , Y. Iwahori , Rob A. Barman, Photometric Stereo: Lambertian Reflectance and Light Sources with Unknown Direction and Strength, University of British Columbia, Vancouver, BC, Canada, 1991
• 26: Zhang L., Curless B., Seitz S. M., "Rapid Shape Acquisition using Color Structured Light and Multi-pass Dynamic Programming", Proc. of 3DPVT, 24--36, 2002.
• 27: Li Zhang , Brian Curless , Aaron Hertzmann , Steven M. Seitz, Shape and Motion under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-view Stereo, Proceedings of the Ninth IEEE International Conference on Computer Vision, p.618, October 13-16, 2003

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.3 Picture/Image Generation
      I.3.7 Three-Dimensional Graphics and Realism
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture

Keywords:
relighting, scientific illustrations, structured light, surface heights, surface normals, visualization