“Clustered vector textures” by Tu, Wei and Zwicker

Repetitive vector patterns are common in a variety of applications but can be challenging and tedious to create. Existing automatic synthesis methods target relatively simple, unstructured patterns such as discrete elements and continuous Bézier curves. This paper proposes an algorithm for generating vector patterns with diverse shapes and structured local interactions via a sample-based representation. Our main idea is adding explicit clustering as part of neighborhood similarity and iterative sample optimization for more robust sample synthesis and pattern reconstruction. The results indicate that our method can outperform existing methods on synthesizing a variety of structured vector textures. Our project page is available at https://phtu-cs.github.io/cvt-sig22/.

1. Pascal Barla, Simon Breslav, Joëlle Thollot, François Sillion, and Lee Markosian. 2006. Stroke pattern analysis and synthesis. In Computer Graphics Forum, Vol. 25. Wiley Online Library, 663–671.Google Scholar
2. Connelly Barnes, Eli Shechtman, Adam Finkelstein, and Dan B Goldman. 2009. Patch-Match: A Randomized Correspondence Algorithm for Structural Image Editing. ACM Trans. Graph. 28, 3, Article 24 (July 2009), 11 pages. Google ScholarDigital Library
3. Connelly Barnes and Fang-Lue Zhang. 2017. A survey of the state-of-the-art in patch-based synthesis. Computational Visual Media 3, 1 (2017), 3–20.Google ScholarCross Ref
4. Serge Belongie, Jitendra Malik, and Jan Puzicha. 2001. Shape context: A new descriptor for shape matching and object recognition. In Advances in neural information processing systems. 831–837.Google Scholar
5. Robert L Cook. 1986. Stochastic sampling in computer graphics. ACM Transactions on Graphics (TOG) 5, 1 (1986), 51–72.Google ScholarDigital Library
6. Jean-Dominique Favreau, Florent Lafarge, and Adrien Bousseau. 2017. Photo2clipart: Image Abstraction and Vectorization Using Layered Linear Gradients. ACM Trans. Graph. 36, 6, Article 180 (Nov. 2017), 11 pages. Google ScholarDigital Library
7. Noa Fish, Lilach Perry, Amit Bermano, and Daniel Cohen-Or. 2020. SketchPatch: Sketch Stylization via Seamless Patch-level Synthesis. ACM Trans. Graph. 39, 6, Article 227 (12 2020). Google ScholarDigital Library
8. Jakub Fišer, Ondřej Jamriška, Michal Lukáč, Eli Shechtman, Paul Asente, Jingwan Lu, and Daniel Sýkora. 2016. StyLit: Illumination-Guided Example-Based Stylization of 3D Renderings. ACM Trans. Graph. 35, 4, Article 92 (July 2016), 11 pages. Google ScholarDigital Library
9. Guojun Gan, Chaoqun Ma, and Jianhong Wu. 2020. Data clustering: theory, algorithms, and applications. SIAM.Google Scholar
10. Yaroslav Ganin, Sergey Bartunov, Yujia Li, Ethan Keller, and Stefano Saliceti. 2021. Computer-Aided Design as Language. arXiv:cs.CV/2105.02769Google Scholar
11. Lena Gieseke, Paul Asente, Radomir Mech, Bedrich Benes, and Martin Fuchs. 2021. A Survey of Control Mechanisms for Creative Pattern Generation. Computer Graphics Forum (2021). Google ScholarCross Ref
12. Pascal Guehl, Rémi Allegre, J-M Dischler, Bedrich Benes, and Eric Galin. 2020. Semi-Procedural Textures Using Point Process Texture Basis Functions. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 159–171.Google Scholar
13. Paul Guerrero, Gilbert Bernstein, Wilmot Li, and Niloy J. Mitra. 2016. PATEX: Exploring Pattern Variations. ACM Trans. Graph. 35, 4, Article 48 (July 2016), 13 pages. Google ScholarDigital Library
14. Jianwei Guo, Haiyong Jiang, Bedrich Benes, Oliver Deussen, Xiaopeng Zhang, Dani Lischinski, and Hui Huang. 2020. Inverse Procedural Modeling of Branching Structures by Inferring L-Systems. ACM Trans. Graph. 39, 5, Article 155 (June 2020), 13 pages. Google ScholarDigital Library
15. Alejo Hausner. 2001. Simulating Decorative Mosaics. In SIGGRAPH ’01. 573–580. Google ScholarDigital Library
16. Aaron Hertzmann, Charles E. Jacobs, Nuria Oliver, Brian Curless, and David H. Salesin. 2001. Image Analogies. In SIGGRAPH ’01. Association for Computing Machinery, New York, NY, USA, 327–340. Google ScholarDigital Library
17. Chen-Yuan Hsu, Li-Yi Wei, Lihua You, and Jian Jun Zhang. 2018. Brushing Element Fields. In SIGGRAPH Asia 2018 Technical Briefs (SA ’18). Article 6, 4 pages. Google ScholarDigital Library
18. Chen-Yuan Hsu, Li-Yi Wei, Lihua You, and Jian Jun Zhang. 2020. Autocomplete Element Fields. In CHI ’20. 1–13. Google ScholarDigital Library
19. Siu Chi Hsu and Irene H. H. Lee. 1994. Drawing and Animation Using Skeletal Strokes. In SIGGRAPH ’94. 109–118. Google ScholarDigital Library
20. Hao-Da Huang, Xin Tong, and Wen-Cheng Wang. 2007. Accelerated parallel texture optimization. Journal of Computer Science and Technology 22, 5 (2007), 761–769.Google ScholarDigital Library
21. T. Hurtut, P.-E. Landes, J. Thollot, Y. Gousseau, R. Drouillhet, and J.-F. Coeurjolly. 2009. Appearance-guided Synthesis of Element Arrangements by Example. In NPAR ’09. 51–60. Google ScholarDigital Library
22. Takashi Ijiri, Radomír Mech, Takeo Igarashi, and Gavin Miller. 2008. An Example-based Procedural System for Element Arrangement. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 429–436.Google Scholar
23. Jennifer Jacobs, Joel Brandt, Radomír Mech, and Mitchel Resnick. 2018. Extending Manual Drawing Practices with Artist-Centric Programming Tools. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 590, 13 pages. Google ScholarDigital Library
24. Alexandre Kaspar, Boris Neubert, Dani Lischinski, Mark Pauly, and Johannes Kopf. 2015. Self Tuning Texture Optimization. Comput. Graph. Forum 34, 2 (May 2015), 349–359. Google ScholarDigital Library
25. Rubaiat Habib Kazi, Takeo Igarashi, Shengdong Zhao, and Richard Davis. 2012. Vignette: Interactive Texture Design and Manipulation with Freeform Gestures for Pen-and-ink Illustration. In CHI ’12. 1727–1736. Google ScholarDigital Library
26. Harold W Kuhn. 1955. The Hungarian method for the assignment problem. Naval research logistics quarterly 2, 1–2 (1955), 83–97.Google Scholar
27. Kin Chung Kwan, Lok Tsun Sinn, Chu Han, Tien-Tsin Wong, and Chi-Wing Fu. 2016. Pyramid of Arclength Descriptor for Generating Collage of Shapes. ACM Trans. Graph. 35, 6, Article 229 (Nov. 2016), 12 pages. Google ScholarDigital Library
28. Vivek Kwatra, Irfan Essa, Aaron Bobick, and Nipun Kwatra. 2005. Texture Optimization for Example-based Synthesis. ACM Trans. Graph. 24, 3 (July 2005), 795–802. Google ScholarDigital Library
29. Pierre-Edouard Landes, Bruno Galerne, and Thomas Hurtut. 2013. A Shape-Aware Model for Discrete Texture Synthesis. Computer Graphics Forum 32, 4 (2013), 67–76.Google ScholarDigital Library
30. Sylvain Lefebvre and Hugues Hoppe. 2006. Appearance-space Texture Synthesis. In ACM SIGGRAPH 2006 Papers (SIGGRAPH ’06). ACM, New York, NY, USA, 541–548. Google ScholarDigital Library
31. Muxingzi Li, Florent Lafarge, and Renaud Marlet. 2020. Approximating shapes in images with low-complexity polygons. In The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).Google ScholarCross Ref
32. Guilin Liu, Rohan Taori, Ting-Chun Wang, Zhiding Yu, Shiqiu Liu, Fitsum A. Reda, Karan Sapra, Andrew Tao, and Bryan Catanzaro. 2020. Transposer: Universal Texture Synthesis Using Feature Maps as Transposed Convolution Filter. arXiv:cs.CV/2007.07243Google Scholar
33. Lifeng Liu and Stan Sclaroff. 2001. Region segmentation via deformable model-guided split and merge. In Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, Vol. 1. IEEE, 98–104.Google ScholarCross Ref
34. Yitzchak David Lockerman, Basile Sauvage, Rémi Allègre, Jean-Michel Dischler, Julie Dorsey, and Holly Rushmeier. 2016. Multi-scale Label-map Extraction for Texture Synthesis. ACM Trans. Graph. 35, 4, Article 140 (July 2016), 12 pages. Google ScholarDigital Library
35. Hugo Loi, Thomas Hurtut, Romain Vergne, and Joelle Thollot. 2017. Programmable 2D Arrangements for Element Texture Design. ACM Trans. Graph. 36, 4, Article 105a (May 2017). Google ScholarDigital Library
36. Jingwan Lu, Connelly Barnes, Stephen DiVerdi, and Adam Finkelstein. 2013. RealBrush: Painting with Examples of Physical Media. ACM Trans. Graph. 32, 4, Article 117 (July 2013), 12 pages. Google ScholarDigital Library
37. Jingwan Lu, Connelly Barnes, Connie Wan, Paul Asente, Radomir Mech, and Adam Finkelstein. 2014. DecoBrush: Drawing Structured Decorative Patterns by Example. ACM Trans. Graph. 33, 4, Article 90 (July 2014), 9 pages. Google ScholarDigital Library
38. Jingwan Lu, Fisher Yu, Adam Finkelstein, and Stephen DiVerdi. 2012. HelpingHand: Example-based Stroke Stylization. ACM Trans. Graph. 31, 4, Article 46 (July 2012), 10 pages. Google ScholarDigital Library
39. Chongyang Ma, Li-Yi Wei, Sylvain Lefebvre, and Xin Tong. 2013. Dynamic Element Textures. ACM Trans. Graph. 32, 4, Article 90 (July 2013), 10 pages. Google ScholarDigital Library
40. Chongyang Ma, Li-Yi Wei, and Xin Tong. 2011. Discrete Element Textures. ACM Trans. Graph. 30, 4, Article 62 (July 2011), 10 pages. Google ScholarDigital Library
41. Morteza Mardani, Guilin Liu, Aysegul Dundar, Shiqiu Liu, Andrew Tao, and Bryan Catanzaro. 2020. Neural FFTs for Universal Texture Image Synthesis. In NeurIPS ’20.Google Scholar
42. Giacomo Nazzaro, Enrico Puppo, and Fabio Pellacini. 2020. DecoSurf: Recursive Geodesic Patterns on Triangle Meshes. arXiv:cs.GR/2007.10918Google Scholar
43. Giacomo Nazzaro, Enrico Puppo, and Fabio Pellacini. 2021. GeoTangle: Interactive Design of Geodesic Tangle Patterns on Surfaces. ACM Trans. Graph. 41, 2, Article 12 (nov 2021), 17 pages. Google ScholarDigital Library
44. Hans Pedersen and Karan Singh. 2006. Organic Labyrinths and Mazes. In NPAR ’06. 79–86. Google ScholarDigital Library
45. Brian Price and William Barrett. 2006. Object-based vectorization for interactive image editing. The Visual Computer 22, 9 (2006), 661–670.Google ScholarDigital Library
46. Pradyumna Reddy, Michael Gharbi, Michal Lukac, and Niloy J Mitra. 2021. Im2vec: Synthesizing vector graphics without vector supervision. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7342–7351.Google Scholar
47. Amir Rosenberger, Daniel Cohen-Or, and Dani Lischinski. 2009. Layered Shape Synthesis: Automatic Generation of Control Maps for Non-Stationary Textures. ACM Trans. Graph. 28, 5 (Dec. 2009), 1–9. Google ScholarDigital Library
48. Riccardo Roveri, A Cengiz Öztireli, Sebastian Martin, Barbara Solenthaler, and Markus Gross. 2015. Example based repetitive structure synthesis. Computer Graphics Forum 34, 5 (2015), 39–52.Google ScholarDigital Library
49. Christian Santoni and Fabio Pellacini. 2016. gTangle: A Grammar for the Procedural Generation of Tangle Patterns. ACM Trans. Graph. 35, 6, Article 182 (Nov. 2016), 11 pages. Google ScholarDigital Library
50. Reza Adhitya Saputra, Craig S. Kaplan, and Paul Asente. 2020. AnimationPak: Packing Elements with Scripted Animations. In Graphics Interface ’20. https://openreview.net/forum?id=sr89orrDo-o.Google Scholar
51. WWCRE Schapire and Yoram Singer. 1998. Learning to order things. Advances in Neural Information Processing Systems 10 (1998), 451.Google Scholar
52. Jianbo Shi and Jitendra Malik. 2000. Normalized cuts and image segmentation. IEEE Transactions on pattern analysis and machine intelligence 22, 8 (2000), 888–905.Google ScholarDigital Library
53. Denis Simakov, Yaron Caspi, Eli Shechtman, and Michal Irani. 2008. Summarizing visual data using bidirectional similarity. In CVPR 2008. 1–8. Google ScholarCross Ref
54. Ondrej Št’ava, Bedrich Beneš, Radomir Měch, Daniel G Aliaga, and Peter Krištof. 2010. Inverse procedural modeling by automatic generation of L-systems. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 665–674.Google Scholar
55. Kenshi Takayama, Olga Sorkine, Andrew Nealen, and Takeo Igarashi. 2010. Volumetric Modeling with Diffusion Surfaces. In SIGGRAPH ASIA ’10. Article Article 180, 8 pages. Google ScholarDigital Library
56. Peihan Tu, Li-Yi Wei, Koji Yatani, Takeo Igarashi, and Matthias Zwicker. 2020. Continuous Curve Textures. ACM Trans. Graph. 39, 6, Article 168 (12 2020). Google ScholarDigital Library
57. Ulrike Von Luxburg. 2007. A tutorial on spectral clustering. Statistics and computing 17, 4 (2007), 395–416.Google Scholar
58. W3. 2020. SVG Rendering Model. https://www.w3.org/TR/SVG/render.html.Google Scholar
59. Lvdi Wang, Yizhou Yu, Kun Zhou, and Baining Guo. 2011. Multiscale vector volumes. ACM Transactions on Graphics (TOG) 30, 6 (2011), 1–8.Google ScholarDigital Library
60. Li-Yi Wei. 2010. Multi-class Blue Noise Sampling. ACM Trans. Graph. 29, 4, Article 79 (July 2010), 8 pages. Google ScholarDigital Library
61. Li-Yi Wei, Arjun V Anand, Shally Kumar, and Tarun Beri. 2020. Simple Methods to Represent Shapes with Sample Spheres. In SA ’20 Technical Communications. Article 3, 4 pages. Google ScholarDigital Library
62. Li-Yi Wei, Jianwei Han, Kun Zhou, Hujun Bao, Baining Guo, and Heung-Yeung Shum. 2008. Inverse Texture Synthesis. ACM Trans. Graph. 27, 3, Article 52 (Aug. 2008), 9 pages. Google ScholarDigital Library
63. Li-Yi Wei, Sylvain Lefebvre, Vivek Kwatra, and Greg Turk. 2009. State of the Art in Example-based Texture Synthesis. In Eurographics 2009, State of the Art Report, EG-STAR. Eurographics Association. http://www-sop.inria.fr/reves/Basilic/2009/WLKT09Google Scholar
64. Michael T Wong, Douglas E Zongker, and David H Salesin. 1998. Computer-generated floral ornament. In SIGGRAPH ’98. 423–434.Google ScholarDigital Library
65. Yi-Ting Yeh and Radomír Měch. 2009. Detecting symmetries and curvilinear arrangements in vector art. In Computer Graphics Forum, Vol. 28. Wiley Online Library, 707–716.Google Scholar
66. Kun Zhou, Xin Huang, Xi Wang, Yiying Tong, Mathieu Desbrun, Baining Guo, and Heung-Yeung Shum. 2006. Mesh Quilting for Geometric Texture Synthesis. ACM Trans. Graph. 25, 3 (July 2006), 690–697. Google ScholarDigital Library
67. Shizhe Zhou, Changyun Jiang, and Sylvain Lefebvre. 2014. Topology-constrained Synthesis of Vector Patterns. ACM Trans. Graph. 33, 6, Article 215 (Nov. 2014), 11 pages. Google ScholarDigital Library
68. Yang Zhou, Zhen Zhu, Xiang Bai, Dani Lischinski, Daniel Cohen-Or, and Hui Huang. 2018. Non-Stationary Texture Synthesis by Adversarial Expansion. ACM Trans. Graph. 37, 4, Article 49 (July 2018), 13 pages. Google ScholarDigital Library
69. Changqing Zou, Junjie Cao, Warunika Ranaweera, Ibraheem Alhashim, Ping Tan, Alla Sheffer, and Hao Zhang. 2016. Legible Compact Calligrams. ACM Trans. Graph. 35, 4, Article 122 (July 2016), 12 pages. Google ScholarDigital Library