3D modeling of complex and detailed cultural heritage using multi-resolution data

ABSTRACT

The article reports the interdisciplinary project of the virtualization of the Great Inscription of Gortyna, Crete, for 3D documentation, structural studies, and physical replica purposes. The digitization of the longest epigraphic text of the Greek civilization (6 m long and 1.75 m high, with approximately 2--3 mm-depth engraved letters) and its surrounding heritage area (around 30 × 30 m), required long planning and the construction of a dedicated acquisition system to speed up the surveying time, limited to few hours per day. Primarily, range sensors were employed in a multi-resolution way, digitizing detailed parts in high resolution and less smoothed areas with lower geometric resolution. Some selected areas were also modeled with our multiphoto geometrically constrained image matching approach to demonstrate that the same accuracy and details can be achieved using either scanners or photogrammetry. The derived 3D model of the heritage is now the basis for further archaeological studies on the incision techniques and a deeper structural analysis on the monument. The challenges of the work stay in the acquisition, processing, and integration of the multi-resolution data as well as their interactive visualization.

REFERENCES

• 1: Bendels, G. H., Degener, P., Wahl, R., Körtgen, M., and Andklein, R. 2004. Image-based registration of 3D-range data using feature surface elements. In Proceedings of the 5th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST'04). 115--124.
• 2: Bendels, G. H., Schnabel, R., and Klein, R. 2005. Detail-preserving surface inpainting. In Proceedings of the 6th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST'06). 41--48.
• 3: Beraldin, J.-A., Picard, M., El-Hakim, S. F., Godin, G., Valzano, V., Bandiera, A., and Latouche, D. 2002. Virtualizing a Byzantine crypt by combining high-resolution textures with laser scanner 3D data. In Proceedings of the International Conference on Virtual Systems and Multi-Media (VSMM'02). 3--14.
• 4: Beraldin, J.-A., Blais, F., Cournoyer, L., Picard, M., Gamache, D., Valzano, V., Bandiera, A., and Gorgoglione, M. 2006. Multi-resolution digital 3D imaging system applied to the recording of grotto sites: The case of the Grotta dei Cervi. In Proceedings of the 7th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST).
• 5: Beraldin, J.-A., Rioux, M., Cournoyer, L., Blais, F., Picard, M., and Pekelsky, J. 2007. Traceable 3D imaging metrology. In Proceedings of the SPIE: Videometrics IX 6491, B.1--B.11.
• 6: Bernardini, F. and Rushmeier, H. 2002. The 3D model acquisition pipeline. Comput. Graph. For. 21, 2, 149--172.
• 7: Blais, F. 2004. A review of 20 years of range sensors development. J. Electron. Imag. 13, 1, 231--240.
• 8: Louis Borgeat , Guy Godin , Philippe Massicotte , Guillaume Poirier , François Blais , J. -Angelo Beraldin, Visualizing and Analyzing the Mona Lisa, IEEE Computer Graphics and Applications, v.27 n.6, p.60-68, November 2007 [doi>10.1109/MCG.2007.162]
• 9: Mario Botsch , Mark Pauly , Leif Kobbelt , Pierre Alliez , Bruno Lévy , Stephan Bischoff , Christian Rössl, Geometric modeling based on polygonal meshes

  Video files associated with this course are available from the citation page

  , ACM SIGGRAPH 2007 courses, August 05-09, 2007, San Diego, California [doi>10.1145/1281500.1281640]
• 10: Myron Z. Brown , Darius Burschka , Gregory D. Hager, Advances in Computational Stereo, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.25 n.8, p.993-1008, August 2003 [doi>10.1109/TPAMI.2003.1217603]
• 11: M. Callieri , P. Cignoni , M. Corsini , R. Scopigno, Technical Section: Masked photo blending: Mapping dense photographic data set on high-resolution sampled 3D models, Computers and Graphics, v.32 n.4, p.464-473, August, 2008 [doi>10.1016/j.cag.2008.05.004]
• 12: Cignoni, P., Rocchini, C., Scopigno, R. 1998. Metro: Measuring error on simplified surfaces. Comput. Graph. For. 17, 2,167--174.
• 13: Cignoni, P., Ganovelli, F., Gobbetti, E., Marton, F., Ponchio, F., and Scopigno, R. 2005. Batched multi-triangulation. In Proceedings of the IEEE Visualization Conference. 207--214.
• 14: Paolo Cignoni , Roberto Scopigno, Sampled 3D models for CH applications: A viable and enabling new medium or just a technological exercise?, Journal on Computing and Cultural Heritage (JOCCH), v.1 n.1, p.1-23, June 2008 [doi>10.1145/1367080.1367082]
• 15: Davis, J., Marshner, S., Garr, M., and Levoy, M. 2002. Filling holes in complex surfaces using volumetric diffusion. In Proceedings of the 1st International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT'02). IEEE Computer Society, 428--438.
• 16: Debevec, P., Tchou, C., Gardner, A., Hawkins, T., Poullis, C., Stumpfel, J., Jones, A., Yun, N., Einarsson, P., Lundgren, T., Fajardo, M., and Martinez, P. 2004. Digitizing the Parthenon: Estimating surface reflectance properties of a complex scene under captured natural illumination. In Proceedings of the Visim, Modeling and Visulization Conference (VMV04).
• 17: Tamal K. Dey , Joachim Giesen , Samrat Goswami , James Hudson , Rephael Wenger , Wulue Zhao, Undersampling and oversampling in sample based shape modeling, Proceedings of the conference on Visualization '01, October 21-26, 2001, San Diego, California
• 18: Andreas Dietrich , Enrico Gobbetti , Sung-Eui Yoon, Massive-Model Rendering Techniques: A Tutorial, IEEE Computer Graphics and Applications, v.27 n.6, p.20-34, November 2007 [doi>10.1109/MCG.2007.154]
• 19: El-Hakim, S. F., Brenner, C., and Roth, G. 1998. A multi-sensor approach to creating accurate virtual environments. ISPRS J. Photogram. Remote Sensing 53, 6, 379--391.
• 20: Sabry F. El-Hakim , J. -Angelo Beraldin , Michel Picard , Guy Godin, Detailed 3D Reconstruction of Large-Scale Heritage Sites with Integrated Techniques, IEEE Computer Graphics and Applications, v.24 n.3, p.21-29, May 2004 [doi>10.1109/MCG.2004.1318815]
• 21: El-Hakim, S., Gonzo, L., Voltolini, F., Girardi, S., Rizzi, A., Remondino, F., and Whiting, E. 2007. Detailed 3D modeling of castles. Int. J. Archit. Comput. 5, 2, 199--220.
• 22: El-Hakim, S., Remondino, F., and Voltolini, F. 2008. Integrating techniques for detailed and photorealistic 3D modelling of castles. GIM Int. 22, 3, 21--25
• 23: Eppstein, D. 2001. Global optimization of mesh quality. In Proceedings of the the 10th International Meshing Roundtable. (Tutorial)
• 24: Fasano, A., Pingi, P., Cignoni, P., Montani, C., and Scopigno, R. 2005. Automatic coarse registration of range maps. IEEE Trans. Visual. Comput. Graph.
• 25: Furukawa, Y. and Ponce, J. 2007. Accurate, dense and robust multi-view stereopsis. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR07).
• 26: Goesele, M., Snavely, N., Curless, B., Hoppe, H., and Seitz, S. M. 2007. Multi-view stereo for community photo collections. In Proceedings of the International Conference on Computer Vision (ICCV'07).
• 27: Gruen, A., Remondino, F., and Zhang, L. 2005. The Bamiyan project: Multi-resolution image-based modeling. In Recording, Modeling and Visualization of Cultural Heritage, E.Baltsavias et al., Eds. 45--54.
• 28: Gruen, A. and Akca, D. 2005. Least squares 3D surface and curve matching. ISPRS J. Photogram. Remote Sensing 59, 3, 151--174.
• 29: Guarnieri, A., Remondino, F., and Vettore, A. 2006. Digital photogrammetry and TLS data fusion applied to cultural heritage 3D modeling. Int. Archives Photogram. Remote Sensing Spatial Inf. Sci. 36, 5, on CD-Rom.
• 30: Guidi, G., Tucci, G., Beraldin, J-A., Ciofi, S., Damato, V., Ostuni, D., Costantino, F., and El Hakim, S. F. 2002. Multiscale archaeological survey-based on the integration of 3D scanning and photogrammetry. In Proceedings of the CIPA WG 6 International Workshop on Scanning for Cultural Heritage Recording. 58--64.
• 31: Guidi, G., Remondino, F., Russo, M., Menna, F., Rizzi, A. 2008. 3D modeling of large and complex site using multi-sensor integration and multi-resolution data. In Proceedings of the 9th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST'08). 85--92.
• 32: Hall, D. L. and Llimas, J. 1997. An introduction to multi-sensor data fusion. Proc. IEEE 85, 1, 6--23.
• 33: Hanusch, T. 2008. A new texture mapping algorithm for photorealistic reconstruction of 3D objects. Int. Archives Photogram. Remote Sensing Spatial Inf. Sci. 37, 5.
• 34: Kobbelt, L. and Botsch, M. 2004. A survey of point-based techniques in computer graphics. Comput. Graph. 28, 6, 801--814.
• 35: A. E. Johnson , M. Hebert, Surface registration by matching oriented points, Proceedings of the International Conference on Recent Advances in 3-D Digital Imaging and Modeling, p.121, May 12-15, 1997
• 36: Hendrik P. A. Lensch , Wolfgang Heidrich , Hans-Peter Seidel, Automated Texture Registration and Stitching for Real World Models, Proceedings of the 8th Pacific Conference on Computer Graphics and Applications, p.317, October 03-05, 2000
• 37: Hendrik P. A. Lensch , Jan Kautz , Michael Goesele , Wolfgang Heidrich , Hans-Peter Seidel, Image-based reconstruction of spatial appearance and geometric detail, ACM Transactions on Graphics (TOG), v.22 n.2, p.234-257, April 2003 [doi>10.1145/636886.636891]
• 38: Marc Levoy , Kari Pulli , Brian Curless , Szymon Rusinkiewicz , David Koller , Lucas Pereira , Matt Ginzton , Sean Anderson , James Davis , Jeremy Ginsberg , Jonathan Shade , Duane Fulk, The digital Michelangelo project: 3D scanning of large statues, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.131-144, July 2000 [doi>10.1145/344779.344849]
• 39: Peter Liepa, Filling holes in meshes, Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, June 23-25, 2003, Aachen, Germany
• 40: David Luebke , Benjamin Watson , Jonathan D. Cohen , Martin Reddy , Amitabh Varshney, Level of Detail for 3D Graphics, Elsevier Science Inc., New York, NY, 2002
• 41: Nister, D. 2001. Automatic dense reconstruction from uncalibrated video sequences. Ph.D. thesis, Computational Vision and Active Perception Lab, NADA-KHT, Stockholm.
• 42: Renato Pajarola , Christopher DeCoro, Efficient Implementation of Real-Time View-Dependent Multiresolution Meshing, IEEE Transactions on Visualization and Computer Graphics, v.10 n.3, p.353-368, May 2004 [doi>10.1109/TVCG.2004.1272735]
• 43: Joshua Podolak , Szymon Rusinkiewicz, Atomic volumes for mesh completion, Proceedings of the third Eurographics symposium on Geometry processing, July 04-06, 2005, Vienna, Austria
• 44: Marc Pollefeys , Luc Van Gool , Maarten Vergauwen , Frank Verbiest , Kurt Cornelis , Jan Tops , Reinhard Koch, Visual Modeling with a Hand-Held Camera, International Journal of Computer Vision, v.59 n.3, p.207-232, September-October 2004 [doi>10.1023/B:VISI.0000025798.50602.3a]
• 45: Kari Pulli , Michael Cohen , Tom Duchamp , Hugues Hoppe , Linda G. Shapiro , Werner Stuetzle, View-base Rendering: Visualizing Real Objects from Scanned Range and Color Data, Proceedings of the Eurographics Workshop on Rendering Techniques '97, p.23-34, June 16-18, 1997
• 46: Erik Reinhard , Greg Ward , Sumanta Pattanaik , Paul Debevec, High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics), Morgan Kaufmann Publishers Inc., San Francisco, CA, 2005
• 47: Remondino, F. and El-Hakim, S. 2006. Image-based 3D modelling: A review. The Photogram. Rec. 21, 115, 269--291.
• 48: Remondino, F., El-Hakim, S., Gruen, A., and Zhang, L. 2008. Development and performance analysis of image matching for detailed surface reconstruction of heritage objects. IEEE Signal Process. Mag. 25, 4, 56--65.
• 49: Roy, M., Foufou, S., and Truchetet, F. 2004. Mesh comparison using attribute deviation metric. Int. J. Image Graph. 4, 1, 127--140.
• 50: Joaquim Salvi , Carles Matabosch , David Fofi , Josep Forest, A review of recent range image registration methods with accuracy evaluation, Image and Vision Computing, v.25 n.5, p.578-596, May, 2007 [doi>10.1016/j.imavis.2006.05.012]
• 51: Scopigno, R. and Cignoni, P. 2005. Processing huge scanned data sets: Issues and solutions. In Proceedings of the Recording, Modeling and Visualization of Cultural Heritage Conference, E. Baltsavias et al., Eds. Taylor&Francis/Balkema.
• 52: Samuel Silva , Joaquim Madeira , Beatriz Sousa Santos, POLYMECO " A Polygonal Mesh Comparison Tool, Proceedings of the Ninth International Conference on Information Visualisation, p.842-847, July 06-08, 2005 [doi>10.1109/IV.2005.98]
• 53: Strecha, C., von Hansen, W., van Gool, L., Fua, P., and Thoennessen, U. 2008. On benchmarking camera calibration and multi-view stereo for high-resolution imagery. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'08).
• 54: Stumpfel. J., Tchou, C., Yun, N., Martinez, P., Hawkins, T., Jones, A., Emerson, B., and Debevec, P. 2003. Digital reunification of the Parthenon and its sculptures. In Proceedings of the Conference on Virtual Reality, Archaeology and Cultural Heritage (VAST). 41--50.
• 55: Kazunori Umeda , Megumi Shinozaki , Guy Godin , Marc Rioux, Correction of Color Information of a 3D Model Using a Range Intensity Image, Proceedings of the Fifth International Conference on 3-D Digital Imaging and Modeling, p.229-236, June 13-16, 2005 [doi>10.1109/3DIM.2005.29]
• 56: Joris Vanden Wyngaerd , Luc Van Gool, Automatic crude patch registration: toward automatic 3D model building, Computer Vision and Image Understanding, v.87 n.1-3, p.8-26, July 2002 [doi>10.1006/cviu.2002.0979]
• 57: Maarten Vergauwen , Luc Van Gool, Web-based 3D Reconstruction Service, Machine Vision and Applications, v.17 n.6, p.411-426, October 2006 [doi>10.1007/s00138-006-0027-1]
• 58: Weyrich, T., Pauly, M., Keiser, R., Heinzle, S., Scandella, S., and Gross, M. 2004. Postprocessing of scanned 3D surface data. In Proceedings of the Eurographics Symposium on Point-Based Graph., 85--94.
• 59: Willets, R. F. 1967. The Law Code of Gortyn. de Guyter, Berlin.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.7 Three-Dimensional Graphics and Realism

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.8 Applications

General Terms:
Documentation

Keywords:
3D modeling, laser scanning, photogrammetry