“Continuous curve textures” by Tu, Wei, Yatani, Igarashi and Zwicker
Conference:
Type(s):
Title:
- Continuous curve textures
Session/Category Title: All About Sketches
Presenter(s)/Author(s):
Abstract:
Repetitive patterns are ubiquitous in natural and human-made objects, and can be created with a variety of tools and methods. Manual authoring provides unmatched degree of freedom and control, but can require significant artistic expertise and manual labor. Computational methods can automate parts of the manual creation process, but are mainly tailored for discrete pixels or elements instead of more general continuous structures. We propose an example-based method to synthesize continuous curve patterns from exemplars. Our main idea is to extend prior sample-based discrete element synthesis methods to consider not only sample positions (geometry) but also their connections (topology). Since continuous structures can exhibit higher complexity than discrete elements, we also propose robust, hierarchical synthesis to enhance output quality. Our algorithm can generate a variety of continuous curve patterns fully automatically. For further quality improvement and customization, we also present an autocomplete user interface to facilitate interactive creation and iterative editing. We evaluate our methods and interface via different patterns, ablation studies, and comparisons with alternative methods.
References:
1. Pascal Barla, Simon Breslav, Joëlle Thollot, François Sillion, and Lee Markosian. 2006. Stroke pattern analysis and synthesis. In Computer Graphics Forum, Vol. 25. Wiley Online Library, 663–671.Google Scholar
2. Connelly Barnes, Eli Shechtman, Adam Finkelstein, and Dan B Goldman. 2009. PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing. ACM Trans. Graph. 28, 3, Article 24 (July 2009), 11 pages. Google ScholarDigital Library
3. Pravin Bhat, Stephen Ingram, and Greg Turk. 2004. Geometric texture synthesis by example. In SGP ’04. 41–44.Google ScholarDigital Library
4. Xiaojun Bian, Li-Yi Wei, and Sylvain Lefebvre. 2018. Tile-based Pattern Design with Topology Control. Proc. ACM Comput. Graph. Interact. Tech. 1, 1, Article 23 (July 2018), 15 pages. Google ScholarDigital Library
5. Hsiang-Ting Chen, Li-Yi Wei, and Chun-Fa Chang. 2011. Nonlinear Revision Control for Images. ACM Trans. Graph. 30, 4, Article 105 (July 2011), 10 pages. Google ScholarDigital Library
6. Weikai Chen, Yuexin Ma, Sylvain Lefebvre, Shiqing Xin, Jonàs Martínez, and wenping wang. 2017. Fabricable Tile Decors. ACM Trans. Graph. 36, 6, Article 175 (Nov. 2017), 15 pages. Google ScholarDigital Library
7. Weikai Chen, Xiaolong Zhang, Shiqing Xin, Yang Xia, Sylvain Lefebvre, and Wenping Wang. 2016. Synthesis of Filigrees for Digital Fabrication. ACM Trans. Graph. 35, 4, Article 98 (July 2016), 13 pages. Google ScholarDigital Library
8. Xiaobai Chen, Tom Funkhouser, Dan B Goldman, and Eli Shechtman. 2012. Non-parametric texture transfer using meshmatch. Adobe Technical Report 2 (2012).Google Scholar
9. Emmanuel Cornet and Jean-Baptiste Rouquier. 2004. GIMP Texturize plugin. https://lmanul.github.io/gimp-texturize/.Google Scholar
10. Jérémie Dumas, Jonàs Martínez, Sylvain Lefebvre, and Li-Yi Wei. 2018. Printable Aggregate Elements. arXiv preprint arXiv:1811.02626 (2018).Google Scholar
11. Alexei A. Efros and William T. Freeman. 2001. Image Quilting for Texture Synthesis and Transfer. In SIGGRAPH ’01. 341–346. Google ScholarDigital Library
12. Leon A. Gatys, Alexander S. Ecker, and Matthias Bethge. 2016. Image Style Transfer Using Convolutional Neural Networks. In CVPR ’16. 2414–2423.Google Scholar
13. Aaron Hertzmann, Nuria Oliver, Brian Curless, and Steven M. Seitz. 2002. Curve Analogies. In EGRW ’02. 233–246.Google Scholar
14. Chen-Yuan Hsu, Li-Yi Wei, Lihua You, and Jian Jun Zhang. 2018. Brushing Element Fields. In SIGGRAPH Asia 2018 Technical Briefs (SA ’18). Article 6, 4 pages. Google ScholarDigital Library
15. Chen-Yuan Hsu, Li-Yi Wei, Lihua You, and Jian Jun Zhang. 2020. Autocomplete Element Fields. In CHI ’20. 1–13. Google ScholarDigital Library
16. Hao-Da Huang, Xin Tong, and Wen-Cheng Wang. 2007. Accelerated parallel texture optimization. Journal of Computer Science and Technology 22, 5 (2007), 761–769.Google ScholarDigital Library
17. T. Hurtut, P.-E. Landes, J. Thollot, Y. Gousseau, R. Drouillhet, and J.-F. Coeurjolly. 2009. Appearance-guided Synthesis of Element Arrangements by Example. In NPAR ’09. 51–60. Google ScholarDigital Library
18. Takashi Ijiri, Radomír Mech, Takeo Igarashi, and Gavin Miller. 2008. An Example-based Procedural System for Element Arrangement. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 429–436.Google Scholar
19. Alexandre Kaspar, Boris Neubert, Dani Lischinski, Mark Pauly, and Johannes Kopf. 2015. Self Tuning Texture Optimization. Comput. Graph. Forum 34, 2 (May 2015), 349–359. Google ScholarDigital Library
20. Rubaiat Habib Kazi, Takeo Igarashi, Shengdong Zhao, and Richard Davis. 2012. Vignette: Interactive Texture Design and Manipulation with Freeform Gestures for Pen-and-ink Illustration. In CHI ’12. 1727–1736. Google ScholarDigital Library
21. Yuki Koyama, Daisuke Sakamoto, and Takeo Igarashi. 2016. SelPh: Progressive Learning and Support of Manual Photo Color Enhancement. In CHI ’16. 2520–2532. Google ScholarDigital Library
22. Harold W Kuhn. 1955. The Hungarian method for the assignment problem. Naval research logistics quarterly 2, 1–2 (1955), 83–97.Google Scholar
23. Vivek Kwatra, Irfan Essa, Aaron Bobick, and Nipun Kwatra. 2005. Texture Optimization for Example-based Synthesis. ACM Trans. Graph. 24, 3 (July 2005), 795–802. Google ScholarDigital Library
24. Vivek Kwatra, Arno Schödl, Irfan Essa, Greg Turk, and Aaron Bobick. 2003. Graphcut Textures: Image and Video Synthesis Using Graph Cuts. In SIGGRAPH ’03. 277–286. Google ScholarDigital Library
25. Pierre-Edouard Landes, Bruno Galerne, and Thomas Hurtut. 2013. A Shape-Aware Model for Discrete Texture Synthesis. Computer Graphics Forum 32, 4 (2013), 67–76.Google ScholarDigital Library
26. Yifei Li, David E. Breen, James McCann, and Jessica Hodgins. 2019. Algorithmic Quilting Pattern Generation for Pieced Quilts. In Proceedings of the 45th Graphics Interface Conference on Proceedings of Graphics Interface 2019 (GI’19). Article 13, 9 pages. Google ScholarDigital Library
27. Lin Liang, Ce Liu, Ying-Qing Xu, Baining Guo, and Heung-Yeung Shum. 2001. Real-time Texture Synthesis by Patch-based Sampling. ACM Trans. Graph. 20, 3 (July 2001), 127–150. Google ScholarDigital Library
28. Hugo Loi, Thomas Hurtut, Romain Vergne, and Joelle Thollot. 2017. Programmable 2D Arrangements for Element Texture Design. ACM Trans. Graph. 36, 4, Article 105a (May 2017). Google ScholarDigital Library
29. Jingwan Lu, Connelly Barnes, Connie Wan, Paul Asente, Radomir Mech, and Adam Finkelstein. 2014. DecoBrush: Drawing Structured Decorative Patterns by Example. ACM Trans. Graph. 33, 4, Article 90 (July 2014), 9 pages. Google ScholarDigital Library
30. Jingwan Lu, Fisher Yu, Adam Finkelstein, and Stephen DiVerdi. 2012. HelpingHand: Example-based Stroke Stylization. ACM Trans. Graph. 31, 4, Article 46 (July 2012), 10 pages. Google ScholarDigital Library
31. Chongyang Ma, Li-Yi Wei, Sylvain Lefebvre, and Xin Tong. 2013. Dynamic Element Textures. ACM Trans. Graph. 32, 4, Article 90 (July 2013), 10 pages. Google ScholarDigital Library
32. Chongyang Ma, Li-Yi Wei, and Xin Tong. 2011. Discrete Element Textures. ACM Trans. Graph. 30, 4, Article 62 (July 2011), 10 pages. Google ScholarDigital Library
33. Jonàs Martínez, Jérémie Dumas, Sylvain Lefebvre, and Li-Yi Wei. 2015. Structure and Appearance Optimization for Controllable Shape Design. ACM Trans. Graph. 34, 6, Article 229 (Oct. 2015), 11 pages. Google ScholarDigital Library
34. Paul Merrell and Dinesh Manocha. 2010. Example-based curve synthesis. Computers & Graphics 34, 4 (2010), 304–311.Google ScholarDigital Library
35. Mathieu Nancel and Andy Cockburn. 2014. Causality: A Conceptual Model of Interaction History. In CHI ’14. 1777–1786. Google ScholarDigital Library
36. Hans Pedersen and Karan Singh. 2006. Organic Labyrinths and Mazes. In NPAR ’06. 79–86. Google ScholarDigital Library
37. Mengqi Peng, Li-Yi Wei, Rubaiat Habib Kazi, and Vladimir G. Kim. 2020. Autocomplete Animated Sculpting. In UIST ’20. Google ScholarDigital Library
38. Mengqi Peng, Jun Xing, and Li-Yi Wei. 2018. Autocomplete 3D Sculpting. ACM Trans. Graph. 37, 4, Article 132 (July 2018), 15 pages. Google ScholarDigital Library
39. Kaspar Riesen and Horst Bunke. 2009. Approximate graph edit distance computation by means of bipartite graph matching. Image and Vision computing 27, 7 (2009), 950–959.Google Scholar
40. Riccardo Roveri, A Cengiz Öztireli, Sebastian Martin, Barbara Solenthaler, and Markus Gross. 2015. Example based repetitive structure synthesis. Computer Graphics Forum 34, 5 (2015), 39–52.Google ScholarDigital Library
41. Christian Santoni and Fabio Pellacini. 2016. gTangle: A Grammar for the Procedural Generation of Tangle Patterns. ACM Trans. Graph. 35, 6, Article 182 (Nov. 2016), 11 pages. Google ScholarDigital Library
42. Christian Schumacher, Bernhard Thomaszewski, and Markus Gross. 2016. Stenciling: Designing Structurally-Sound Surfaces with Decorative Patterns. Computer Graphics Forum 35, 5 (2016), 101–110.Google ScholarDigital Library
43. Ryo Suzuki, Tom Yeh, Koji Yatani, and Mark D Gross. 2017. Autocomplete Textures for 3D Printing. arXiv preprint arXiv:1703.05700 (2017).Google Scholar
44. Kenshi Takayama, Olga Sorkine, Andrew Nealen, and Takeo Igarashi. 2010. Volumetric Modeling with Diffusion Surfaces. In SIGGRAPH ASIA ’10. Article Article 180, 8 pages. Google ScholarDigital Library
45. Peihan Tu. 2020. Continuous Curve Textures Source Code. https://github.com/tph9608/continuous-curve-texture/.Google Scholar
46. Peihan Tu, Dani Lischinski, and Hui Huang. 2019. Point Pattern Synthesis via Irregular Convolution. Computer Graphics Forum 38, 5 (2019), 109–122. Google ScholarCross Ref
47. Lvdi Wang, Yizhou Yu, Kun Zhou, and Baining Guo. 2011. Multiscale vector volumes. ACM Transactions on Graphics (TOG) 30, 6 (2011), 1–8.Google ScholarDigital Library
48. Lvdi Wang, Kun Zhou, Yizhou Yu, and Baining Guo. 2010. Vector solid textures. ACM Transactions on Graphics (TOG) 29, 4 (2010), 1–8.Google ScholarDigital Library
49. Li-Yi Wei. 2016. Texture Synthesis. https://github.com/1iyiwei/textureGoogle Scholar
50. Li-Yi Wei, Sylvain Lefebvre, Vivek Kwatra, and Greg Turk. 2009. State of the Art in Example-based Texture Synthesis. In Eurographics 2009, State of the Art Report, EG-STAR. Eurographics Association. http://www-sop.inria.fr/reves/Basilic/2009/WLKT09Google Scholar
51. Li-Yi Wei and Marc Levoy. 2000. Fast Texture Synthesis Using Tree-structured Vector Quantization. In SIGGRAPH ’00. 479–488. Google ScholarDigital Library
52. Li-Yi Wei and Marc Levoy. 2001. Texture Synthesis over Arbitrary Manifold Surfaces. In SIGGRAPH ’01. 355–360. Google ScholarDigital Library
53. Jun Xing, Hsiang-Ting Chen, and Li-Yi Wei. 2014. Autocomplete Painting Repetitions. ACM Trans. Graph. 33, 6, Article 172 (Nov. 2014), 11 pages. Google ScholarDigital Library
54. Jun Xing, Li-Yi Wei, Takaaki Shiratori, and Koji Yatani. 2015. Autocomplete Hand-drawn Animations. ACM Trans. Graph. 34, 6, Article 169 (Oct. 2015), 11 pages. Google ScholarDigital Library
55. Jonas Zehnder, Stelian Coros, and Bernhard Thomaszewski. 2016. Designing Structurally-sound Ornamental Curve Networks. ACM Trans. Graph. 35, 4, Article 99 (July 2016), 10 pages. Google ScholarDigital Library
56. Howard Zhou, Jie Sun, Greg Turk, and James M. Rehg. 2007. Terrain Synthesis from Digital Elevation Models. IEEE Transactions on Visualization and Computer Graphics 13, 4 (July 2007), 834–848. Google ScholarDigital Library
57. Kun Zhou, Xin Huang, Xi Wang, Yiying Tong, Mathieu Desbrun, Baining Guo, and Heung-Yeung Shum. 2006. Mesh Quilting for Geometric Texture Synthesis. ACM Trans. Graph. 25, 3 (July 2006), 690–697. Google ScholarDigital Library
58. Shizhe Zhou, Changyun Jiang, and Sylvain Lefebvre. 2014. Topology-constrained Synthesis of Vector Patterns. ACM Trans. Graph. 33, 6, Article 215 (Nov. 2014), 11 pages. Google ScholarDigital Library
59. C. Lawrence Zitnick. 2013. Handwriting Beautification Using Token Means. ACM Trans. Graph. 32, 4, Article 53 (July 2013), 8 pages. Google ScholarDigital Library
