“Image-based tree modeling” by Tan, Zeng, Wang, Kang and Quan

In this paper, we propose an approach for generating 3D models of natural-looking trees from images that has the additional benefit of requiring little user intervention. While our approach is primarily image-based, we do not model each leaf directly from images due to the large leaf count, small image footprint, and widespread occlusions. Instead, we populate the tree with leaf replicas from segmented source images to reconstruct the overall tree shape. In addition, we use the shape patterns of visible branches to predict those of obscured branches. We demonstrate our approach on a variety of trees.

1. Breckon, T. P., and Fisher, R. B. 2005. Non-parametric 3D surface completion. In Proc. Int’l Conf. on 3-D Digital Imaging and Modeling, 573–580. Google ScholarDigital Library
2. Brostow, G. J., Essa, I., Steedly, D., and Kwatra, V. 2004. Novel skeletal representation for articulated creatures. In Proc. European Conf. on Computer Vision, 66–78.Google Scholar
3. Comaniciu, D., and Meer, P. 2002. Mean shift: A robust approach toward feature space analysis. IEEE Trans. on Pattern Analysis and Machine Intelligence 24, 5, 603–619. Google ScholarDigital Library
4. De Reffye, P., Edelin, C., Francon, J., Jaeger, M., and Puech, C. 1988. Plant models faithful to botanical structure and development. In ACM SIGGRAPH, 151–158. Google ScholarDigital Library
5. Efros, A. A., and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In Proc. of IEEE Int’l Conf. on Computer Vision, 1033–1038. Google ScholarDigital Library
6. Han, F., and Zhu, S.-C. 2003. Bayesian reconstruction of 3D shapes and scenes from a single image. In Proc. IEEE Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 12–20. Google ScholarDigital Library
7. Ijiri, T., Owada, O., Okabe, M., and Igarashi, T. 2005. Floral diagrams and inflorescences: Interactive flower modeling using botanical structural constraints. ACM Trans. on Graphics (SIGGRAPH) 24, 3 (July), 720–726. Google ScholarDigital Library
8. Lhuillier, M., and Quan, L. 2005. A quasi-dense approach to surface reconstruction from uncalibrated images. IEEE Trans. on Pattern Analysis and Machine Intelligence 27, 3, 418–433. Google ScholarDigital Library
9. Mech, R., and Prusinkiewicz, P. 1996. Visual models of plants interacting with their environment. In ACM SIGGRAPH, 397–410. Google ScholarDigital Library
10. Noser, H., Rudolph, S., and Stucki, P. 2001. Physics-enhanced L-systems. In Proc. Int’l Conf. in Central Europe on Computer Graphics, Visualization and Computer Vision, vol. 2, 214–221.Google Scholar
11. Prusinkiewicz, P., James, M., and Mech, R. 1994. Synthetic topiary. In ACM SIGGRAPH, 351–358. Google ScholarDigital Library
12. Okabe, M., Owada, S., and Igarashi, T. 2005. Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing. Eurographics, 487–496.Google Scholar
13. Prusinkiewicz, P., Muendermann, L., Karwowski, R., and Lane, B. 2001. The use of positional information in the modeling of plants. In ACM SIGGRAPH, 289–300. Google ScholarDigital Library
14. Quan, L., Tan, P., Zeng, G., Yuan, L., Wang, J., and Kang, S. B. 2006. Image-based plant modeling. ACM Trans. on Graphics (SIGGRAPH) 25, 3 (August), 772–778. Google ScholarDigital Library
15. Reche-Martinez, A., Martin, I., and Drettakis, G. 2004. Volumetric reconstruction and interactive rendering of trees from photographs. ACM Trans. on Graphics (SIGGRAPH) 23, 3 (August), 720–727. Google ScholarDigital Library
16. Sakaguchi, T. 1998. Botanical tree structure modeling based on real image set. In ACM SIGGRAPH 1998 (Tech. Sketch), 272. Google ScholarDigital Library
17. Shlyakhter, I., Rozenoer, M., Dorsey, J., and Teller, S. 2001. Reconstructing 3D tree models from instrumented photographs. IEEE Computer Graphics and Applications 21, 3 (May/June), 53–61. Google ScholarDigital Library
18. Van Haevre, W., and Bekaert, P. 2003. A simple but effective algorithm to model the competition of virtual plants for light and space. In Proc. Int’l Conf. in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG).Google Scholar
19. Weber, J., and Penn, J. 1995. Creation and rendering of realistic trees. In ACM SIGGRAPH, 119–127. Google ScholarDigital Library
20. Xu, H., Gossett, N., and Chen, B. 2005. Knowledge-Based Modeling of Laser-Scanned Trees. In SIGGRAPH’05 Sketches. Google ScholarDigital Library