“Image-based plant modeling” by Quan, Tan, Zeng, Yuan, Wang, et al. …

In this paper, we propose a semi-automatic technique for modeling plants directly from images. Our image-based approach has the distinct advantage that the resulting model inherits the realistic shape and complexity of a real plant. We designed our modeling system to be interactive, automating the process of shape recovery while relying on the user to provide simple hints on segmentation. Segmentation is performed in both image and 3D spaces, allowing the user to easily visualize its effect immediately. Using the segmented image and 3D data, the geometry of each leaf is then automatically recovered from the multiple views by fitting a deformable leaf model. Our system also allows the user to easily reconstruct branches in a similar manner. We show realistic reconstructions of a variety of plants, and demonstrate examples of plant editing.

1. Besl, P., and McKay, N. 1992. A method for registration of 3D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 2, 239–256. Google ScholarDigital Library
2. Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 11, 1222–1239. Google ScholarDigital Library
3. De Reffye, P., Edelin, C., Francon, J., Jaeger, M., and Puech, C. 1988. Plant models faithful to botanical structure and development. SIGGRAPH, 151–158. Google ScholarDigital Library
4. Faugeras, O., Luong, Q., and Papadopoulo, T. 2001. The Geometry of Multiple Images. The MIT Press, Cambridge, MA, USA. Google ScholarDigital Library
5. Han, F., and Zhu, S.-C. 2003. Bayesian reconstruction of 3d shapes and scenes from a single image. In Proc. IEEE Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 12–20. Google ScholarDigital Library
6. Hartley, R., and Zisserman, A. 2000. Multiple View Geometry in Computer Vision. Cambridge University Press, June. Google ScholarDigital Library
7. Ijiri, T., Owada, O., Okabe, M., and Igarashi, T. 2005. Floral diagrams and inflorescences: Interactive flower modeling using botanical structural constraints. ACM Transactions on Graphics (SIGGRAPH) 24, 3 (July), 720–726. Google ScholarDigital Library
8. Lhuillier, M., and Quan, L. 2005. A quasi-dense approach to surface reconstruction from uncalibrated images. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 3, 418–433. Google ScholarDigital Library
9. Li, Y., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Lazy snapping. SIGGRAPH 2004, Los Angeles, USA 23, 3, 303–308. Google ScholarDigital Library
10. Mech, R., and Prusinkiewicz, P. 1996. Visual models of plants interacting with their environment. SIGGRAPH, 397–410. Google ScholarDigital Library
11. Noser, H., and Thalmann, D. 1994. Simulating life of virtual plants, fishes and butterflies. In Artificial Life and Virtual Reality, N. Magnenat-Thalmann and D. Thalmann, Eds. John Wiley and Sons, Ltd.Google Scholar
12. Noser, H., Rudolph, S., and Stucki, P. 2001. Physics-enhanced L-systems. In Procs. 9th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, vol. 2, 214–221.Google Scholar
13. Prusinkiewicz, P., James, M., and Mech, R. 1994. Synthetic topiary. SIGGRAPH, 351–358. Google ScholarDigital Library
14. Prusinkiewicz, P., Muendermann, L., Karwowski, R., and Lane, B. 2001. The use of positional information in the modeling of plants. SIGGRAPH, 289–300. Google ScholarDigital Library
15. Reche-Martinez, A., Martin, I., and Drettakis, G. 2004. Volumetric reconstruction and interactive rendering of trees from photographs. ACM Transactions on Graphics (SIGGRAPH) 23, 3 (August), 720–727. Google ScholarDigital Library
16. Sakaguchi, T., and Ohya, J. 1999. Modeling and animation of botanical trees for interactive virtual environments. In Procs. ACM Symposium on Virtual Reality Software and Technology, 139–146. Google ScholarDigital Library
17. Sakaguchi, T. 1998. Botanical tree structure modeling based on real image set. In SIGGRAPH 1998 (Tech. Sketch), 272. Google ScholarDigital Library
18. Shi, J., and Malik, J. 2000. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 8, 888–905. Google ScholarDigital Library
19. Shlyakhter, I., Rozenoer, M., Dorsey, J., and Teller, S. 2001. Reconstructing 3d tree models from instrumented photographs. IEEE Computer Graphics and Applications 21, 3 (May/June), 53–61. Google ScholarDigital Library
20. Van Haevre, W., and Bekaert, P. 2003. A simple but effective algorithm to model the competition of virtual plants for light and space. In Procs. International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG’03).Google Scholar
21. Wang, L., Wang, W., Dorsey, J., Yang, X., Guo, B., and Shum, H.-Y. 2005. Real-time rendering of plant leaves. SIGGRAPH 2005, Los Angeles, USA 24, 3, 712–719. Google ScholarDigital Library
22. Weber, J., and Penn, J. 1995. Creation and rendering of realistic trees. In SIGGRAPH, 119–127. Google ScholarDigital Library