“BendSketch: modeling freeform surfaces through 2D sketching” by Li
Conference:
Type(s):
Title:
- BendSketch: modeling freeform surfaces through 2D sketching
Session/Category Title: Sketching & Curves
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Sketch-based modeling provides a powerful paradigm for geometric modeling. Recent research had shown, sketch based modeling methods are most effective when targeting a specific family of surfaces. A large and growing arsenal of sketching tools is available for different types of geometries and different target user populations. Our work augments this arsenal with a new and powerful tool for modeling complex freeform shapes by sketching sparse 2D strokes; our method complements existing approaches in enabling the generation of surfaces with complex curvature patterns that are challenging to produce with existing methods.To model a desired surface patch with our technique, the user sketches the patch boundary as well as a small number of strokes representing the major bending directions of the shape. Our method uses this input to generate a curvature field that conforms to the user strokes and then uses this field to derive a freeform surface with the desired curvature pattern. To infer the surface from the strokes we first disambiguate the convex versus concave bending directions indicated by the strokes and estimate the surface bending magnitude along the strokes. We subsequently construct a curvature field based on these estimates, using a non-orthogonal 4-direction field coupled with a scalar magnitude field, and finally construct a surface whose curvature pattern reflects this field through an iterative sequence of simple linear optimizations.Our framework is well suited for single-view modeling, but also supports multi-view interaction, necessary to model complex shapes portions of which can be occluded in many views. It effectively combines multi-view inputs to obtain a coherent 3D shape. It runs at interactive speed allowing for immediate user feedback. We demonstrate the effectiveness of the proposed method through a large collection of complex examples created by both artists and amateurs. Our framework provides a useful complement to the existing sketch-based modeling methods.
References:
1. 2016. CGAL, Computational Geometry Algorithms Library. http://www.cgal.org. (2016).Google Scholar
2. 2016. ZBrush. http://pixologic.com/. (2016).Google Scholar
3. Nina Amenta and Marshall Bern. 1998. Surface Reconstruction by Voronoi Filtering. In SoCG. 39–48. Google ScholarDigital Library
4. Alexis Andre and Suguru Saito. 2011. Single-view Sketch Based Modeling. In SBIM. 133–140. Google ScholarDigital Library
5. Alexis Andre, Suguru Saito, and Masayuki Nakajima. 2007. CrossSketch: Freeform Surface Modeling with Details. In SBIM. 45–52.Google Scholar
6. Seok-Hyung Bae, Ravin Balakrishnan, and Karan Singh. 2008. ILoveSketch: As-natural-as-possible Sketching System for Creating 3D Curve Models. In UIST. 151–160.Google Scholar
7. Jonathan T Barron and Jitendra Malik. 2015. Shape, Illumination, and Reflectance from Shading. IEEE Trans. Pattern Anal. Mach. Intell. 37 (2015), 1670–1687. Google ScholarCross Ref
8. Peter N. Belhumeur, David J. Kriegman, and Alan L. Yuille. 1999. The Bas-Relief Ambiguity. Int. J. Comput. Vis. 35, 1 (1999), 33–44. Google ScholarDigital Library
9. Adrien Bernhardt, Adeline Pihuit, Marie-Paule Cani, and Loïc Barthe. 2008. Matisse : Painting 2D regions for Modeling Free-Form Shapes. In SBIM. 57–64.Google Scholar
10. Mikhail Bessmeltsev, Will Chang, Nicholas Vining, Alla Sheffer, and Karan Singh. 2015. Modeling Character Canvases from Cartoon Drawings. ACM Trans. Graph. 34, 5 (2015). Google ScholarDigital Library
11. Mikhail Bessmeltsev, Caoyu Wang, Alla Sheffer, and Karan Singh. 2012. Design-driven Quadrangulation of Closed 3D Curves. ACM Trans. Graph. (SIGGRAPH ASIA) 31, 6 (2012), 178:1–178:11.Google Scholar
12. M. Botsch, L. Kobbelt, M. Pauly, P. Alliez, and B. Levy. 2010. Polygon Mesh Processing. Taylor & Francis. Google ScholarCross Ref
13. Minh Tuan Bui, Junho Kim, and Yunjin Lee. 2015. 3D-look Shading from Contours and Hatching Strokes. Comput. Graph. 51 (2015), 167–176. Google ScholarDigital Library
14. Tao Chen, Zhe Zhu, Ariel Shamir, Shi-Min Hu, and Daniel Cohen-Or. 2013. 3-Sweep: Extracting Editable Objects from a Single Photo. ACM Trans. Graph. (SIGGRAPH ASIA) 32, 6 (2013), 195:1–195:10.Google Scholar
15. Pedro Company, Ana Piquer, Manuel Contero, and Ferran Naya. 2005. A Survey on Geometrical Reconstruction As a Core Technology to Sketch-based Modeling. Comput. Graph. 29, 6 (2005), 892–904.Google ScholarDigital Library
16. Frederic Cordier, Hyewon Seo, Jinho Park, and Jun Yong Noh. 2011. Sketching of Mirror-Symmetric Shapes. IEEE. T Vis. Comput. Gr. 17, 11 (2011).Google Scholar
17. Chris De Paoli and Karan Singh. 2015. SecondSkin: Sketch-based Construction of Layered 3D Models. ACM Trans. Graph. (SIGGRAPH) 34, 4, Article 126 (2015), 10 pages.Google ScholarDigital Library
18. Olga Diamanti, Amir Vaxman, Daniele Panozzo, and Olga Sorkine-Hornung. 2014. Designing N-PolyVector Fields with Complex Polynomials. Comput. Graph. Forum (SGP) 33, 5 (2014), 1–11. Google ScholarDigital Library
19. Chao Ding and Ligang Liu. 2016. A survey of sketch based modeling systems. Frontiers of Computer Science 10, 6 (2016), 985–999. Google ScholarDigital Library
20. Even Entem, Loïc Barthe, Marie-Paule Cani, Frederic Cordier, and Michiel Van De Panne. 2014. Modeling 3D animals from a side-view sketch. Comput. Graph. 38 (2014).Google Scholar
21. Hongbo Fu, Yichen Wei, Chiew-Lan Tai, and Long Quan. 2007. Sketching Hairstyles. In SBIM. 31–36. Google ScholarDigital Library
22. Yotam Gingold, Takeo Igarashi, and Denis Zorin. 2009. Structured Annotations for 2D-to-3D Modeling. ACM Trans. Graph. (SIGGRAPH ASIA) 28, 5 (2009), 148:1–148:9.Google Scholar
23. Yotam Gingold and Denis Zorin. 2008. Shading-based Surface Editing. ACM Trans. Graph. (SIGGRAPH) 27, 3 (2008), 95:1–95:9.Google ScholarDigital Library
24. Aaron Hertzmann and Denis Zorin. 2000. Illustrating Smooth Surfaces. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques. 517–526. Google ScholarDigital Library
25. Haibin Huang, Evangelos Kalogerakis, Ersin Yumer, and Radomir Mech. 2016. Shape Synthesis from Sketches via Procedural Models and Convolutional Networks. IEEE. T. Vis. Comput. Gr. 22, 10 (2016), 1.Google ScholarDigital Library
26. Emmanuel Iarussi, David Bommes, and Adrien Bousseau. 2015. BendFields: Regularized Curvature Fields from Rough Concept Sketches. ACM Trans. Graph. (SIGGRAPH) 34, 3 (2015), 24:1–24:16.Google ScholarDigital Library
27. Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 1999. Teddy: A Sketching Interface for 3D Freeform Design. In SIGGRAPH.Google ScholarDigital Library
28. Joaquim Jorge and Faramarz Samavati (Eds.). 2011. Sketch-based Interfaces and Modeling (1 ed.). Springer-Verlag London. Google ScholarCross Ref
29. Pushkar Joshi and Nathan A. Carr. 2008. Repoussé: Automatic Inflation of 2D Artwork. In SBIM (SBM’08). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 49–55.Google Scholar
30. P. Joshi and C. H. Séquin. 2007. Energy Minimizers for Curvature-Based Surface Functionals. CAD Conference (2007), 607–617.Google Scholar
31. Amaury Jung, Stefanie Hahmann, Damien Rohmer, Antoine Begault, Laurence Boissieux, and Marie-Paule Cani. 2015. Sketching Folds: Developable Surfaces from Non-Planar Silhouettes. ACM Trans. Graph. 34, 5, Article 155 (2015), 12 pages.Google ScholarDigital Library
32. Olga A. Karpenko and John F. Hughes. 2006. SmoothSketch: 3D Free-form Shapes from Complex Sketches. ACM Trans. Graph. (SIGGRAPH) 25, 3 (2006), 589–598. Google ScholarDigital Library
33. Jan J. Koenderink and Andrea J. van Doorn. 2002. Image Processing Done Right. In ECCV. 158–172. Google ScholarCross Ref
34. Vladimir Kolmogorov. 2006. Convergent Tree-Reweighted Message Passing for Energy Minimization. IEEE Trans. Pattern Anal. Mach. Intell. 28, 10 (2006), 1568–1583. Google ScholarDigital Library
35. Z. Li, J. Liu, and X. Tang. 2007. A Closed-form Solution to 3D Reconstruction of Piecewise Planar Objects from Single Images. In CVPR. 1–6.Google Scholar
36. Yang Liu, Hao Pan, John Snyder, Wenping Wang, and Baining Guo. 2013. Computing Self-supporting Surfaces by Regular Triangulation. ACM Trans. Graph. 32, 4 (2013), 92:1–92:10.Google ScholarDigital Library
37. Yongwei Miao, Feixia Hu, Xudong Zhang, Jiazhou Chen, and Renato Pajarola. 2015. SymmSketch: Creating symmetric 3D free-form shapes from 2D sketches. Computational Visual Media 1, 1 (2015), 3–16. Google ScholarCross Ref
38. Andrew Nealen, Takeo Igarashi, Olga Sorkine, and Marc Alexa. 2007. FiberMesh: Designing Freeform Surfaces with 3D Curves. ACM Trans. Graph. (SIGGRAPH) 26, 3 (2007). Google ScholarDigital Library
39. Andrew Nealen, Olga Sorkine, Marc Alexa, and Daniel Cohen-Or. 2005. A Sketch-based Interface for Detail-preserving Mesh Editing. ACM Trans. Graph. (SIGGRAPH) 24, 3 (2005), 1142–1147. Google ScholarDigital Library
40. Gen Nishida, Ignacio Garcia-Dorado, Daniel G. Aliaga, Bedrich Benes, and Adrien Bousseau. 2016. Interactive Sketching of Urban Procedural Models. ACM Trans. Graph. (SIGGRAPH) 35, 4 (2016), 130:1–130:11.Google ScholarDigital Library
41. L. Olsen, F. Samavati, and J. Jorge. 2011. NaturaSketch: Modeling from Images and Natural Sketches. IEEE Comput. Graph. Appl. Mag. 31, 6 (2011), 24–34. Google ScholarDigital Library
42. Luke Olsen, Faramarz F. Samavati, Mario Costa Sousa, and Joaquim A. Jorge. 2009. Sketch-based modeling: A survey. Comput. Graph. 33, 1 (2009), 85 — 103. Google ScholarDigital Library
43. Hao Pan, Yang Liu, Alla Sheffer, Nicholas Vining, Chang-Jian Li, and Wenping Wang. 2015. Flow Aligned Surfacing of Curve Networks. ACM Trans. Graph. (SIGGRAPH) 34, 4 (2015), 127:1–127:10.Google ScholarDigital Library
44. Helmut Pottmann and Yang Liu. 2007. Discrete Surfaces in Isotropic Geometry. In Mathematics of Surfaces XII. 341–363. Google ScholarCross Ref
45. Cody Robson, Ron Maharik, Alla Sheffer, and Nathan Carr. 2011. Context-aware Garment Modeling from Sketches. Comput. Graph. 35, 3 (2011), 604–613. Google ScholarDigital Library
46. Ryan Schmidt, Azam Khan, Karan Singh, and Gord Kurtenbach. 2009. Analytic Drawing of 3D Scaffolds. ACM Trans. Graph. (SIGGRAPH ASIA) 28, 5 (2009), 149:1–149:10.Google Scholar
47. Ryan Schmidt, Brian Wyvill, Mario Costa Sousa, and Joaquim A. Jorge. 2005. ShapeShop: Sketch-Based Solid Modeling with BlobTrees. In SBIM.Google Scholar
48. Cloud Shao, Adrien Bousseau, Alla Sheffer, and Karan Singh. 2012. CrossShade: Shading Concept Sketches Using Cross-section Curves. ACM Trans. Graph. (SIGGRAPH) 31, 4 (2012), 45:1–45:11.Google ScholarDigital Library
49. Alex Shtof, Alexander Agathos, Yotam Gingold, Ariel Shamir, and Daniel Cohen-Or. 2013. Geosemantic Snapping for Sketch-Based Modeling. comput. Graph. Forum (EG) 32, 2 (2013), 245–253.Google ScholarCross Ref
50. Olga Sorkine, Daniel Cohen-Or, Yaron Lipman, Marc Alexa, Christian Rössl, and Hans-Peter Seidel. 2004. Laplacian Surface Editing. In Symp. Geom. Proc. 179–188. Google ScholarDigital Library
51. Daniel Sýkora, Ladislav Kavan, Martin Čadík, Ondřej Jamriška, Alec Jacobson, Brian Whited, Maryann Simmons, and Olga Sorkine-Hornung. 2014. Ink-and-Ray: Bas-Relief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters. ACM Trans. Graph. 33, 2 (2014), 16. Google ScholarDigital Library
52. Chiew-Lan Tai, Hongxin Zhang, and Jacky Chun-Kin Fong. 2004. Prototype Modeling from Sketched Silhouettes based on Convolution Surfaces. Comput. Graph. Forum 23, 1 (2004), 71–83. Google ScholarCross Ref
53. Emmanuel Turquin, Marie-Paule Cani, and John F.Hughes. 2004. Sketching Garments for Virtual Characters. In SBIM. 175–182.Google Scholar
54. Etienne Vouga, Mathias Höbinger, Johannes Wallner, and Helmut Pottmann. 2012. Design of Self-supporting Surfaces. ACM Trans. Graph. (SIGGRAPH) 31, 4 (2012), 87:1–87:11.Google ScholarDigital Library
55. Yingze Wang, Y. Chen, J. Liu, and X. Tang. 2009. 3D reconstruction of curved objects from single 2D line drawings. In CVPR. 1834–1841.Google Scholar
56. Xiaohua Xie, Kai Xu, Niloy J. Mitra, Daniel Cohen-Or, Wenyong Gong, Qi Su, and Baoquan Chen. 2013. Sketch-to-Design: Context-Based Part Assembly. Comput. Graph. Forum 32, 8 (2013), 233–245. Google ScholarCross Ref
57. Baoxuan Xu, William Chang, Alla Sheffer, Adrien Bousseau, James McCrae, and Karan Singh. 2014. True2Form: 3D Curve Networks from 2D Sketches via Selective Regularization. ACM Trans. Graph. (SIGGRAPH) 33, 4 (2014), 131:1–131:13.Google ScholarDigital Library
58. Kun Xu, Kang Chen, Hongbo Fu, Wei-Lun Sun, and Shi-Min Hu. 2013. Sketch2Scene: Sketch-based Co-retrieval and Co-placement of 3D Models. ACM Trans. Graph. (SIGGRAPH) 32, 4 (2013), 123:1–123:15.Google ScholarDigital Library
59. Q. Xu, Y. Gingold, and K. Singh. 2015. Inverse Toon Shading: Interactive Normal Field Modeling with Isophotes. In SBIM. 15–25.Google Scholar
60. C. K. Yeh, S. Y. Huang, P. K. Jayaraman, C. W. Fu, and T. Y. Lee. 2016. Interactive High-Relief Reconstruction for Organic and Double-sided Objects from a Photo. IEEE. T. Vis. Comput. Gr. 99 (2016), 1–1.Google Scholar
61. Li Zhang, G. Dugas-Phocion, J. S. Samson, and S. M. Seitzt. 2001. Single view modeling of free-form scenes. In CVPR, Vol. 1. I-990–I-997. Google ScholarCross Ref
62. L. Zhu, T. Igarashi, and J. Mitani. 2013. Soft Folding. Comput. Graph. Forum (PG) 32, 7 (2013), 167–176. Google ScholarCross Ref
63. Yixin Zhuang, Ming Zou, Nathan Carr, and Tao Ju. 2013. A General and Efficient Method for Finding Cycles in 3D Curve Networks. ACM Trans. Graph. (SIGGRAPH ASIA) 32, 6 (2013), 180:1–180:10.Google Scholar
