“By-example synthesis of structurally sound patterns” by Dumas, Lu, Lefebvre, Wu and Dick

Several techniques exist to automatically synthesize a 2D image resembling an input exemplar texture. Most of the approaches optimize a new image so that the color neighborhoods in the output closely match those in the input, across all scales. In this paper we revisit by-example texture synthesis in the context of additive manufacturing. Our goal is to generate not only colors, but also structure along output surfaces: given an exemplar indicating ‘solid’ and ’empty’ pixels, we generate a similar pattern along the output surface. The core challenge is to guarantee that the pattern is not only fully connected, but also structurally sound.To achieve this goal we propose a novel formulation for on-surface by-example texture synthesis that directly works in a voxel shell around the surface. It enables efficient local updates to the pattern, letting our structural optimizer perform changes that improve the overall rigidity of the pattern. We use this technique in an iterative scheme that jointly optimizes for appearance and structural soundness. We consider fabricability constraints and a user-provided description of a force profile that the object has to resist.Our results fully exploit the capabilities of additive manufacturing by letting users design intricate structures along surfaces. The structures are complex, yet they resemble input exemplars, resulting in a modeling tool accessible to casual users.

1. Ashikhmin, M. 2001. Synthesizing natural textures. In Proceedings of the 2001 Symposium on Interactive 3D Graphics, ACM, New York, NY, USA, I3D ’01, 217–226. Google ScholarDigital Library
2. Bhat, P., Ingram, S., and Turk, G. 2004. Geometric texture synthesis by example. In Proceedings of the 2004 Eurographics/ACM SIGGRAPH Symposium on Geometry Processing,ACM, New York, NY, USA, SGP ’04, 41–44. Google ScholarDigital Library
3. Bowers, J., Wang, R., Wei, L.-Y., and Maletz, D. 2010. Parallel poisson disk sampling with spectrum analysis on surfaces. ACM Trans. Graph. 29, 6 (Dec.), 166:1–166:10. Google ScholarDigital Library
4. Chen, Y., Davis, T. A., Hager, W. W., and Rajamanickam, S. 2008. Algorithm 887: Cholmod, supernodal sparse cholesky factorization and update/downdate. ACM Trans. Math. Softw. 35, 3 (Oct.), 22:1–22:14. Google ScholarDigital Library
5. Christiansen, A. N., BÆrentzen, J. A., Nobel-Jørgensen, M., Aage, N., and Sigmund, O. 2015. Combined shape and topology optimization of 3d structures. Computers & Graphics 46, 0, 25–35. Shape Modeling International 2014. Google ScholarDigital Library
6. Christiansen, A. N., Schmidt, R., and BÆrentzen, J. A. 2015. Automatic balancing of 3d models. Computer-Aided Design 58, 0, 236–241. Solid and Physical Modeling 2014.Google ScholarDigital Library
7. Cook, R. D., Malkus, D. S., Plesha, M. E., and Witt, R. J. 2007. Concepts and Applications of Finite Element Analysis. John Wiley & Sons. Google ScholarDigital Library
8. Dong, Y., Lefebvre, S., Tong, X., and Drettakis, G. 2008. Lazy solid texture synthesis. Computer Graphics Forum 27, 4, 1165–1174. Google ScholarDigital Library
9. Dumas, J., Hergel, J., and Lefebvre, S. 2014. Bridging the gap: Automated steady scaffoldings for 3d printing. ACM Trans. Graph. 33, 4 (July), 98:1–98:10. Google ScholarDigital Library
10. Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’01, 341–346. Google ScholarDigital Library
11. Gal, R., Wexler, Y., Ofek, E., Hoppe, H., and Cohen-Or, D. 2010. Seamless montage for texturing models. Computer Graphics Forum 29, 2, 479–486.Google ScholarCross Ref
12. Guennebaud, G., Jacob, B., et al., 2010. Eigen v3. http://eigen.tuxfamily.org.Google Scholar
13. Harker, J., 2011. Crania Anatomica Filigre: Me to You. https://www.kickstarter.com/projects/joshharker/crania-anatomica-filigre-me-to-you.Google Scholar
14. Haumont, D., Debeir, O., and Sillion, F. 2003. Volumetric cell-and-portal generation. CFG 22, 3, 303–312.Google ScholarCross Ref
15. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’01, 327–340. Google ScholarDigital Library
16. Hu, R., Li, H., Zhang, H., and Cohen-Or, D. 2014. Approximate pyramidal shape decomposition. ACM Trans. Graph. 33, 6 (Nov.), 213:1–213:12. Google ScholarDigital Library
17. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Trans. Graph. 22, 3 (July), 277–286. Google ScholarDigital Library
18. Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. ACM Trans. Graph. 24, 3 (July), 795–802. Google ScholarDigital Library
19. Lagae, A., Dumont, O., and Dutre, P. 2005. Geometry synthesis by example. In Proceedings of the International Conference on Shape Modeling and Applications 2005, IEEE Computer Society, Washington, DC, USA, SMI ’05, 176–185. Google ScholarDigital Library
20. Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. ACM Trans. Graph. 24, 3 (July), 777–786. Google ScholarDigital Library
21. Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. ACM Trans. Graph. 25, 3 (July), 541–548. Google ScholarDigital Library
22. Lempitsky, V., and Ivanov, D. 2007. Seamless mosaicing of image-based texture maps. In Computer Vision and Pattern Recognition, 2007. CVPR ’07. IEEE Conference on, 1–6.Google Scholar
23. Liu, L., Chambers, E. W., Letscher, D., and Ju, T. 2010. A simple and robust thinning algorithm on cell complexes. Computer Graphics Forum 29, 7, 2253–2260.Google ScholarCross Ref
24. Lu, L., Sharf, A., Zhao, H., Wei, Y., Fan, Q., Chen, X., Savoye, Y., Tu, C., Cohen-Or, D., and Chen, B. 2014. Build-to-last: Strength to weight 3d printed objects. ACM Trans. Graph. 33, 4 (July), 97:1–97:10. Google ScholarDigital Library
25. Luo, L., Baran, I., Rusinkiewicz, S., and Matusik, W. 2012. Chopper: Partitioning models into 3d-printable parts. ACM Trans. Graph. 31, 6 (Nov.), 129:1–129:9. Google ScholarDigital Library
26. Ma, C., Huang, H., Sheffer, A., Kalogerakis, E., and Wang, R. 2014. Analogy-driven 3d style transfer. Computer Graphics Forum 33, 2, 175–184. Google ScholarDigital Library
27. Praun, E., Finkelstein, A., and Hoppe, H. 2000. Lapped textures. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH ’00, 465–470. Google ScholarDigital Library
28. Prévost, R., Whiting, E., Lefebvre, S., and Sorkine-Hornung, O. 2013. Make it stand: Balancing shapes for 3d fabrication. ACM Trans. Graph. 32, 4 (July), 81:1–81:10. Google ScholarDigital Library
29. Rosenkrantz, J., and Louis-Rosenberg, J., 2007. http://n-e-r-v-o-u-s.com/about_us.php.Google Scholar
30. Schmidt, R., and Singh, K. 2010. Meshmixer: An interface for rapid mesh composition. In ACM SIGGRAPH 2010 Talks, ACM, New York, NY, USA, SIGGRAPH ’10, 6:1–6:1. Google ScholarDigital Library
31. Segerman, H., 2009. Surface autoglyphs. http://www.segerman.org/autologlyphs.html.Google Scholar
32. Sigmund, O., and Maute, K. 2013. Topology optimization approaches. Struct. and Mult. Optimization 48, 6, 1031–1055.Google ScholarCross Ref
33. Sigmund, O. 2001. A 99 line topology optimization code written in matlab. Struct. and Mult. Optimization 21, 2, 120–127. Google ScholarDigital Library
34. Soler, C., Cani, M.-P., and Angelidis, A. 2002. Hierarchical pattern mapping. ACM Trans. Graph. 21, 3 (July), 673–680. Google ScholarDigital Library
35. Stava, O., Vanek, J., Benes, B., Carr, N., and Měch, R. 2012. Stress relief: Improving structural strength of 3d printable objects. ACM Trans. Graph. 31, 4 (July), 48:1–48:11. Google ScholarDigital Library
36. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Trans. Graph. 21, 3 (July), 665–672. Google ScholarDigital Library
37. Turk, G. 2001. Texture synthesis on surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’01, 347–354. Google ScholarDigital Library
38. Umetani, N., and Schmidt, R. 2013. Cross-sectional structural analysis for 3d printing optimization. In SIGGRAPH Asia 2013 Technical Briefs, ACM, New York, NY, USA, SA ’13, 5:1–5:4. Google ScholarDigital Library
39. Vanek, J., Galicia, J. A. G., and Benes, B. 2014. Clever support: Efficient support structure generation for digital fabrication. Computer Graphics Forum 33, 5, 117–125. Google ScholarDigital Library
40. Wang, W., Wang, T. Y., Yang, Z., Liu, L., Tong, X., Tong, W., Deng, J., Chen, F., and Liu, X. 2013. Cost-effective printing of 3d objects with skin-frame structures. ACM Trans. Graph. 32, 6 (Nov.), 177:1–177:10. Google ScholarDigital Library
41. Wei, L.-Y., and Levoy, M. 2001. Texture synthesis over arbitrary manifold surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’01, 355–360. Google ScholarDigital Library
42. Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics 2009, State of the Art Report.Google Scholar
43. Ying, L., Hertzmann, A., Biermann, H., and Zorin, D. 2001. Texture and shape synthesis on surfaces. In Rendering Techniques 2001, S. Gortler and K. Myszkowski, Eds., Eurographics. Springer Vienna, 301–312. Google ScholarDigital Library
44. Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively-variant textures on arbitrary surfaces. ACM Trans. Graph. 22, 3 (July), 295–302. Google ScholarDigital Library
45. Zhou, K., Huang, X., Wang, X., Tong, Y., Desbrun, M., Guo, B., and Shum, H.-Y. 2006. Mesh quilting for geometric texture synthesis. ACM Trans. Graph. 25, 3 (July), 690–697. Google ScholarDigital Library
46. Zhou, Q., Panetta, J., and Zorin, D. 2013. Worst-case structural analysis. ACM Trans. Graph. 32, 4 (July), 137:1–137:12. Google ScholarDigital Library
47. Zhou, S., Jiang, C., and Lefebvre, S. 2014. Topology-constrained synthesis of vector patterns. ACM Trans. Graph. 33, 6 (Nov.), 215:1–215:11. Google ScholarDigital Library