“By-example synthesis of structurally sound patterns” by Dumas, Lu, Lefebvre, Wu and Dick

  • ©Jérémie Dumas, An Lu, Sylvain Lefebvre, Jun Wu, and Christian Dick




    By-example synthesis of structurally sound patterns



    Several techniques exist to automatically synthesize a 2D image resembling an input exemplar texture. Most of the approaches optimize a new image so that the color neighborhoods in the output closely match those in the input, across all scales. In this paper we revisit by-example texture synthesis in the context of additive manufacturing. Our goal is to generate not only colors, but also structure along output surfaces: given an exemplar indicating ‘solid’ and ’empty’ pixels, we generate a similar pattern along the output surface. The core challenge is to guarantee that the pattern is not only fully connected, but also structurally sound.To achieve this goal we propose a novel formulation for on-surface by-example texture synthesis that directly works in a voxel shell around the surface. It enables efficient local updates to the pattern, letting our structural optimizer perform changes that improve the overall rigidity of the pattern. We use this technique in an iterative scheme that jointly optimizes for appearance and structural soundness. We consider fabricability constraints and a user-provided description of a force profile that the object has to resist.Our results fully exploit the capabilities of additive manufacturing by letting users design intricate structures along surfaces. The structures are complex, yet they resemble input exemplars, resulting in a modeling tool accessible to casual users.


    1. Ashikhmin, M. 2001. Synthesizing natural textures. In Proceedings of the 2001 Symposium on Interactive 3D Graphics, ACM, New York, NY, USA, I3D ’01, 217–226. Google ScholarDigital Library
    2. Bhat, P., Ingram, S., and Turk, G. 2004. Geometric texture synthesis by example. In Proceedings of the 2004 Eurographics/ACM SIGGRAPH Symposium on Geometry Processing,ACM, New York, NY, USA, SGP ’04, 41–44. Google ScholarDigital Library
    3. Bowers, J., Wang, R., Wei, L.-Y., and Maletz, D. 2010. Parallel poisson disk sampling with spectrum analysis on surfaces. ACM Trans. Graph. 29, 6 (Dec.), 166:1–166:10. Google ScholarDigital Library
    4. Chen, Y., Davis, T. A., Hager, W. W., and Rajamanickam, S. 2008. Algorithm 887: Cholmod, supernodal sparse cholesky factorization and update/downdate. ACM Trans. Math. Softw. 35, 3 (Oct.), 22:1–22:14. Google ScholarDigital Library
    5. Christiansen, A. N., BÆrentzen, J. A., Nobel-Jørgensen, M., Aage, N., and Sigmund, O. 2015. Combined shape and topology optimization of 3d structures. Computers & Graphics 46, 0, 25–35. Shape Modeling International 2014. Google ScholarDigital Library
    6. Christiansen, A. N., Schmidt, R., and BÆrentzen, J. A. 2015. Automatic balancing of 3d models. Computer-Aided Design 58, 0, 236–241. Solid and Physical Modeling 2014.Google ScholarDigital Library
    7. Cook, R. D., Malkus, D. S., Plesha, M. E., and Witt, R. J. 2007. Concepts and Applications of Finite Element Analysis. John Wiley & Sons. Google ScholarDigital Library
    8. Dong, Y., Lefebvre, S., Tong, X., and Drettakis, G. 2008. Lazy solid texture synthesis. Computer Graphics Forum 27, 4, 1165–1174. Google ScholarDigital Library
    9. Dumas, J., Hergel, J., and Lefebvre, S. 2014. Bridging the gap: Automated steady scaffoldings for 3d printing. ACM Trans. Graph. 33, 4 (July), 98:1–98:10. Google ScholarDigital Library
    10. Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’01, 341–346. Google ScholarDigital Library
    11. Gal, R., Wexler, Y., Ofek, E., Hoppe, H., and Cohen-Or, D. 2010. Seamless montage for texturing models. Computer Graphics Forum 29, 2, 479–486.Google ScholarCross Ref
    12. Guennebaud, G., Jacob, B., et al., 2010. Eigen v3. http://eigen.tuxfamily.org.Google Scholar
    13. Harker, J., 2011. Crania Anatomica Filigre: Me to You. https://www.kickstarter.com/projects/joshharker/crania-anatomica-filigre-me-to-you.Google Scholar
    14. Haumont, D., Debeir, O., and Sillion, F. 2003. Volumetric cell-and-portal generation. CFG 22, 3, 303–312.Google ScholarCross Ref
    15. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’01, 327–340. Google ScholarDigital Library
    16. Hu, R., Li, H., Zhang, H., and Cohen-Or, D. 2014. Approximate pyramidal shape decomposition. ACM Trans. Graph. 33, 6 (Nov.), 213:1–213:12. Google ScholarDigital Library
    17. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Trans. Graph. 22, 3 (July), 277–286. Google ScholarDigital Library
    18. Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. ACM Trans. Graph. 24, 3 (July), 795–802. Google ScholarDigital Library
    19. Lagae, A., Dumont, O., and Dutre, P. 2005. Geometry synthesis by example. In Proceedings of the International Conference on Shape Modeling and Applications 2005, IEEE Computer Society, Washington, DC, USA, SMI ’05, 176–185. Google ScholarDigital Library
    20. Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. ACM Trans. Graph. 24, 3 (July), 777–786. Google ScholarDigital Library
    21. Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. ACM Trans. Graph. 25, 3 (July), 541–548. Google ScholarDigital Library
    22. Lempitsky, V., and Ivanov, D. 2007. Seamless mosaicing of image-based texture maps. In Computer Vision and Pattern Recognition, 2007. CVPR ’07. IEEE Conference on, 1–6.Google Scholar
    23. Liu, L., Chambers, E. W., Letscher, D., and Ju, T. 2010. A simple and robust thinning algorithm on cell complexes. Computer Graphics Forum 29, 7, 2253–2260.Google ScholarCross Ref
    24. Lu, L., Sharf, A., Zhao, H., Wei, Y., Fan, Q., Chen, X., Savoye, Y., Tu, C., Cohen-Or, D., and Chen, B. 2014. Build-to-last: Strength to weight 3d printed objects. ACM Trans. Graph. 33, 4 (July), 97:1–97:10. Google ScholarDigital Library
    25. Luo, L., Baran, I., Rusinkiewicz, S., and Matusik, W. 2012. Chopper: Partitioning models into 3d-printable parts. ACM Trans. Graph. 31, 6 (Nov.), 129:1–129:9. Google ScholarDigital Library
    26. Ma, C., Huang, H., Sheffer, A., Kalogerakis, E., and Wang, R. 2014. Analogy-driven 3d style transfer. Computer Graphics Forum 33, 2, 175–184. Google ScholarDigital Library
    27. Praun, E., Finkelstein, A., and Hoppe, H. 2000. Lapped textures. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH ’00, 465–470. Google ScholarDigital Library
    28. Prévost, R., Whiting, E., Lefebvre, S., and Sorkine-Hornung, O. 2013. Make it stand: Balancing shapes for 3d fabrication. ACM Trans. Graph. 32, 4 (July), 81:1–81:10. Google ScholarDigital Library
    29. Rosenkrantz, J., and Louis-Rosenberg, J., 2007. http://n-e-r-v-o-u-s.com/about_us.php.Google Scholar
    30. Schmidt, R., and Singh, K. 2010. Meshmixer: An interface for rapid mesh composition. In ACM SIGGRAPH 2010 Talks, ACM, New York, NY, USA, SIGGRAPH ’10, 6:1–6:1. Google ScholarDigital Library
    31. Segerman, H., 2009. Surface autoglyphs. http://www.segerman.org/autologlyphs.html.Google Scholar
    32. Sigmund, O., and Maute, K. 2013. Topology optimization approaches. Struct. and Mult. Optimization 48, 6, 1031–1055.Google ScholarCross Ref
    33. Sigmund, O. 2001. A 99 line topology optimization code written in matlab. Struct. and Mult. Optimization 21, 2, 120–127. Google ScholarDigital Library
    34. Soler, C., Cani, M.-P., and Angelidis, A. 2002. Hierarchical pattern mapping. ACM Trans. Graph. 21, 3 (July), 673–680. Google ScholarDigital Library
    35. Stava, O., Vanek, J., Benes, B., Carr, N., and Měch, R. 2012. Stress relief: Improving structural strength of 3d printable objects. ACM Trans. Graph. 31, 4 (July), 48:1–48:11. Google ScholarDigital Library
    36. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Trans. Graph. 21, 3 (July), 665–672. Google ScholarDigital Library
    37. Turk, G. 2001. Texture synthesis on surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’01, 347–354. Google ScholarDigital Library
    38. Umetani, N., and Schmidt, R. 2013. Cross-sectional structural analysis for 3d printing optimization. In SIGGRAPH Asia 2013 Technical Briefs, ACM, New York, NY, USA, SA ’13, 5:1–5:4. Google ScholarDigital Library
    39. Vanek, J., Galicia, J. A. G., and Benes, B. 2014. Clever support: Efficient support structure generation for digital fabrication. Computer Graphics Forum 33, 5, 117–125. Google ScholarDigital Library
    40. Wang, W., Wang, T. Y., Yang, Z., Liu, L., Tong, X., Tong, W., Deng, J., Chen, F., and Liu, X. 2013. Cost-effective printing of 3d objects with skin-frame structures. ACM Trans. Graph. 32, 6 (Nov.), 177:1–177:10. Google ScholarDigital Library
    41. Wei, L.-Y., and Levoy, M. 2001. Texture synthesis over arbitrary manifold surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’01, 355–360. Google ScholarDigital Library
    42. Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics 2009, State of the Art Report.Google Scholar
    43. Ying, L., Hertzmann, A., Biermann, H., and Zorin, D. 2001. Texture and shape synthesis on surfaces. In Rendering Techniques 2001, S. Gortler and K. Myszkowski, Eds., Eurographics. Springer Vienna, 301–312. Google ScholarDigital Library
    44. Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively-variant textures on arbitrary surfaces. ACM Trans. Graph. 22, 3 (July), 295–302. Google ScholarDigital Library
    45. Zhou, K., Huang, X., Wang, X., Tong, Y., Desbrun, M., Guo, B., and Shum, H.-Y. 2006. Mesh quilting for geometric texture synthesis. ACM Trans. Graph. 25, 3 (July), 690–697. Google ScholarDigital Library
    46. Zhou, Q., Panetta, J., and Zorin, D. 2013. Worst-case structural analysis. ACM Trans. Graph. 32, 4 (July), 137:1–137:12. Google ScholarDigital Library
    47. Zhou, S., Jiang, C., and Lefebvre, S. 2014. Topology-constrained synthesis of vector patterns. ACM Trans. Graph. 33, 6 (Nov.), 215:1–215:11. Google ScholarDigital Library

ACM Digital Library Publication: