Image-based tree modeling

ABSTRACT

In this paper, we propose an approach for generating 3D models of natural-looking trees from images that has the additional benefit of requiring little user intervention. While our approach is primarily image-based, we do not model each leaf directly from images due to the large leaf count, small image footprint, and widespread occlusions. Instead, we populate the tree with leaf replicas from segmented source images to reconstruct the overall tree shape. In addition, we use the shape patterns of visible branches to predict those of obscured branches. We demonstrate our approach on a variety of trees.

REFERENCES

• 1: Toby P. Breckon , Robert B. Fisher, Non-Parametric 3D Surface Completion, Proceedings of the Fifth International Conference on 3-D Digital Imaging and Modeling, p.573-580, June 13-16, 2005 [doi>10.1109/3DIM.2005.61]
• 2: Brostow, G. J., Essa, I., Steedly, D., and Kwatra, V. 2004. Novel skeletal representation for articulated creatures. In Proc. European Conf. on Computer Vision, 66--78.
• 3: Dorin Comaniciu , Peter Meer, Mean Shift: A Robust Approach Toward Feature Space Analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.24 n.5, p.603-619, May 2002 [doi>10.1109/34.1000236]
• 4: Phillippe de Reffye , Claude Edelin , Jean Françon , Marc Jaeger , Claude Puech, Plant models faithful to botanical structure and development, ACM SIGGRAPH Computer Graphics, v.22 n.4, p.151-158, Aug. 1988
• 5: Alexei A. Efros , Thomas K. Leung, Texture Synthesis by Non-Parametric Sampling, Proceedings of the International Conference on Computer Vision-Volume 2, p.1033, September 20-25, 1999
• 6: Feng Han , Song-Chun Zhu, Bayesian Reconstruction of 3D Shapes and Scenes From A Single Image, Proceedings of the First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, p.12, October 17-17, 2003
• 7: Takashi Ijiri , Shigeru Owada , Makoto Okabe , Takeo Igarashi, Floral diagrams and inflorescences: interactive flower modeling using botanical structural constraints, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005
• 8: Maxime Lhuillier , Long Quan, A Quasi-Dense Approach to Surface Reconstruction from Uncalibrated Images, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.27 n.3, p.418-433, March 2005 [doi>10.1109/TPAMI.2005.44]
• 9: Radomír Měch , Przemyslaw Prusinkiewicz, Visual models of plants interacting with their environment, Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, p.397-410, August 1996 [doi>10.1145/237170.237279]
• 10: Noser, H., Rudolph, S., and Stucki, P. 2001. Physics-enhanced L-systems. In Proc. Int'l Conf. in Central Europe on Computer Graphics, Visualization and Computer Vision, vol. 2, 214--221.
• 11: Przemyslaw Prusinkiewicz , Mark James , Radomír Měch, Synthetic topiary, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.351-358, July 1994 [doi>10.1145/192161.192254]
• 12: Okabe, M., Owada, S., and Igarashi, T. 2005. Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing. Eurographics, 487--496.
• 13: Przemyslaw Prusinkiewicz , Lars Mündermann , Radoslaw Karwowski , Brendan Lane, The use of positional information in the modeling of plants, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.289-300, August 2001 [doi>10.1145/383259.383291]
• 14: Long Quan , Ping Tan , Gang Zeng , Lu Yuan , Jingdong Wang , Sing Bing Kang, Image-based plant modeling, ACM Transactions on Graphics (TOG), v.25 n.3, July 2006
• 15: Alex Reche-Martinez , Ignacio Martin , George Drettakis, Volumetric reconstruction and interactive rendering of trees from photographs, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004
• 16: Tatsumi Sakaguchi, Botanical tree structure modeling based on real image set, ACM SIGGRAPH 98 Conference abstracts and applications, p.272, July 19-24, 1998, Orlando, Florida, United States [doi>10.1145/280953.282241]
• 17: Ilya Shlyakhter , Max Rozenoer , Julie Dorsey , Seth Teller, Reconstructing 3D Tree Models from Instrumented Photographs, IEEE Computer Graphics and Applications, v.21 n.3, p.53-61, May 2001
• 18: Van Haevre, W., and Bekaert, P. 2003. A simple but effective algorithm to model the competition of virtual plants for light and space. In Proc. Int'l Conf. in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG).
• 19: Jason Weber , Joseph Penn, Creation and rendering of realistic trees, Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, p.119-128, September 1995 [doi>10.1145/218380.218427]
• 20: Hui Xu , Nathan Gossett , Baoquan Chen, Knowledge-based modeling of laser-scanned trees, ACM SIGGRAPH 2005 Sketches, July 31-August 04, 2005, Los Angeles, California [doi>10.1145/1187112.1187261]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.5 Computational Geometry and Object Modeling

Additional Classification:
  F. Theory of Computation
  F.2 ANALYSIS OF ALGORITHMS AND PROBLEM COMPLEXITY
      F.2.2 Nonnumerical Algorithms and Problems
          Subjects: Computations on discrete structures; Geometrical problems and computations

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.7 Feature Measurement
          Subjects: Size and shape

General Terms:
Algorithms, Design, Measurement