Revisiting district six: a case study of digital heritage reconstruction from archival photographs

ABSTRACT

This paper investigates the digital reconstruction of destroyed buildings from small sets of old, uncalibrated photographs. The application domain is the heritage preservation of District Six -- a mixed race area in Cape Town that was leveled during the South African Apartheid regime and whose residents were forcibly removed.

Our framework uses a combination of semi-automatic camera calibration, model-based architecture-specific photogrammetry, and texture synthesis to reconstruct the geometry and texture of a building so that it can be incorporated into a heritage-based virtual environment, such as a museum display. These techniques are well established in isolation; the purpose here is to discover if they can be adapted to damaged and uncalibrated photographs, where the time periods and chromatic schemes differ or where, in the worst case, only a single photograph is available.

To test the effectiveness of the reconstruction framework we consider three representative cases of District Six architecture. All three cases were reconstructed successfully with some provisos concerning uneven ground, intricate building features, and unfavourable camera angles.

REFERENCES

• 1: Beraldin, J.-A., El-Hakim, S., Godin, G., Valzano, V., Bandiera, A., and Latouche, D. 2002. Virtualizing a byzantine crypt by combining high-resolution textures with laser scanner 3d data. In VSMM 2002, 3--14.
• 2: Beraldin, J.-A., Picard, M., El-Hakim, S., Godin, G., Borgeat, L., Blais, F., Paquet, E., Rioux, M., Valzano, V., and Bandiera, A. 2005. Virtual reconstruction of heritage sites: Opportunities and challenges created by 3d technologies. In The International Workshop on Recording, Modeling and Visualization of Cultural Heritage.
• 3: Erhard Berndt , José Carlos Teixeira, Cultural Heritage in the Mature Era of Computer Graphics, IEEE Computer Graphics and Applications, v.20 n.1, p.36-37, January 2000 [doi>10.1109/38.814549]
• 4: Buehrer, T., Li, Z., Gruen, A., Fraser, C., and Ruther, H., 1999. Photogrammetric reconstruction and 3d visualisation of bet giorgis, a rock-hewn church in ethiopia.
• 5: Paul E. Debevec , Camillo J. Taylor , Jitendra Malik, Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.11-20, August 1996 [doi>10.1145/237170.237191]
• 6: Paul Ernest Debevec , Jitendra Malik, Modeling and rendering architecture from photographs, University of California, Berkeley, 1996
• 7: Alexei A. Efros , Thomas K. Leung, Texture Synthesis by Non-Parametric Sampling, Proceedings of the International Conference on Computer Vision-Volume 2, p.1033, September 20-25, 1999
• 8: Sabry F. El-Hakim , J. -Angelo Beraldin , Michel Picard , Guy Godin, Detailed 3D Reconstruction of Large-Scale Heritage Sites with Integrated Techniques, IEEE Computer Graphics and Applications, v.24 n.3, p.21-29, May 2004 [doi>10.1109/MCG.2004.1318815]
• 9: Gruen, A., Remondino, F., and Zhang, L. 2002. Image-based reconstruction of the great buddha of bamiyan, afghanistan. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XXXIV, 5/W12.
• 10: Janne Heikkila , Olli Silven, A Four-step Camera Calibration Procedure with Implicit Image Correction, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.1106, June 17-19, 1997
• 11: Lehner, M., 1992. The gize plateau mapping project.
• 12: Marc Levoy , Kari Pulli , Brian Curless , Szymon Rusinkiewicz , David Koller , Lucas Pereira , Matt Ginzton , Sean Anderson , James Davis , Jeremy Ginsberg , Jonathan Shade , Duane Fulk, The digital Michelangelo project: 3D scanning of large statues, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.131-144, July 2000 [doi>10.1145/344779.344849]
• 13: Pascal Müller , Peter Wonka , Simon Haegler , Andreas Ulmer , Luc Van Gool, Procedural modeling of buildings, ACM SIGGRAPH 2006 Papers, July 30-August 03, 2006, Boston, Massachusetts
• 14: Andrew Nealen , Marc Alexa, Hybrid texture synthesis, Proceedings of the 14th Eurographics workshop on Rendering, June 25-27, 2003, Leuven, Belgium
• 15: Nocedal, J., and Wright, S. J. 1999. Numerical Optimization. Springer-Verlag.
• 16: Streilein, A., and Nierderost, M., 1998. Reconstruction of the disentis monastery from high resolution still video imagery with object oriented measurement routines.
• 17: Camillo J. Taylor , David J. Kriegman, Structure and Motion from Line Segments in Multiple Images, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.17 n.11, p.1021-1032, November 1995 [doi>10.1109/34.473228]
• 18: van den Heuvel, F. 1999. Estimation of interior orientation parameters from constraints on line measurements in a single image. International Archives of Photogrammetry and Remote Sensing 32, 5/W11, 81--88.
• 19: Li-Yi Wei , Marc Levoy, Fast texture synthesis using tree-structured vector quantization, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.479-488, July 2000 [doi>10.1145/344779.345009]
• 20: Tomihisa Welsh , Michael Ashikhmin , Klaus Mueller, Transferring color to greyscale images, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002
• 21: Wilczkowiak, M., Boyer, E., and Sturm, P. 2001. Camera calibration and 3d reconstruction from single images using parallelepipeds. In Proceedings of the 8th International Conference on Computer Vision, Vancouver, Canada, IEEE Computer Society Press, vol. 1, 142--148.
• 22: Steve Zelinka , Michael Garland, Towards real-time texture synthesis with the jump map, Proceedings of the 13th Eurographics workshop on Rendering, June 26-28, 2002, Pisa, Italy
• 23: Zhengyou Zhang, A Flexible New Technique for Camera Calibration, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.22 n.11, p.1330-1334, November 2000 [doi>10.1109/34.888718]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.8 Applications

Additional Classification:
  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.1 Digitization and Image Capture

Keywords:
heritage preservation, photogrammetric reconstruction, texture synthesis