“SecondSkin: sketch-based construction of layered 3D models” by Paoli and Singh

SecondSkin is a sketch-based modeling system focused on the creation of structures comprised of layered, shape interdependent 3D volumes. Our approach is built on three novel insights gleaned from an analysis of representative artist sketches. First, we observe that a closed loop of strokes typically define surface patches that bound volumes in conjunction with underlying surfaces. Second, a significant majority of these strokes map to a small set of curve-types, that describe the 3D geometric relationship between the stroke and underlying layer geometry. Third, we find that a few simple geometric features allow us to consistently classify 2D strokes to our proposed set of 3D curve-types. Our algorithm thus processes strokes as they are drawn, identifies their curve-type, and interprets them as 3D curves on and around underlying 3D geometry, using other connected 3D curves for context. Curve loops are automatically surfaced and turned into volumes bound to the underlying layer, creating additional curves and surfaces as necessary. Stroke classification by 15 viewers on a suite of ground truth sketches validates our curve-types and classification algorithm. We evaluate SecondSkin via a compelling gallery of layered 3D models that would be tedious to produce using current sketch modelers.

1. Andre, A., and Saito, S. 2011. Single-view sketch based modeling. In Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling, ACM, New York, NY, USA, SBIM ’11, 133–140. Google ScholarDigital Library
2. Bae, S.-H., Balakrishnan, R., and Singh, K. 2008. ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models. In Proceedings of the 21st annual ACM symposium on User interface software and technology, ACM, New York, NY, USA, UIST ’08, 151–160. Google ScholarDigital Library
3. Bessmeltsev, M., Wang, C., Sheffer, A., and Singh, K. 2012. Design-driven quadrangulation of closed 3d curves. ACM Trans. Graph. 31, 6 (Nov.), 178:1–178:11. Google ScholarDigital Library
4. Bloomenthal, J., and Wyvill, B., Eds. 1997. Introduction to Implicit Surfaces. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. Google ScholarDigital Library
5. Chadwick, J. E., Haumann, D. R., and Parent, R. E. 1989. Layered construction for deformable animated characters. In SIGGRAPH ’89: Proceedings of the 16th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, 243–252. Google ScholarDigital Library
6. Chen, T., Zhu, Z., Shamir, A., Hu, S.-M., and Cohen-Or, D. 2013. 3sweepp: Extracting editable objects from a single photo. ACM Trans. Graph. 32, 6 (Nov.), 195:1–195:10. Google ScholarDigital Library
7. Cutler, B., Dorsey, J., McMillan, L., Müller, M., and Jagnow, R. 2002. A procedural approach to authoring solid models. In Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH ’02, 302–311. Google ScholarDigital Library
8. Davies, P., and Scott, K. 2012. Awakening: The Art of Halo 4. Titan Books Limited.Google Scholar
9. Fan, Z., Chi, M., Kaufman, A., and Oliveira, M. M. 2004. A Sketch-Based Interface for Collaborative Design. In Sketch Based Interfaces and Modeling, The Eurographics Association, J. A. P. Jorge, E. Galin, and J. F. Hughes, Eds. Google ScholarDigital Library
10. Fan, L., Wang, R., Xu, L., Deng, J., and Liu, L. 2013. Modeling by drawing with shadow guidance. Computer Graphics Forum (Proc. Pacific Graphics) 23, 7, 157–166.Google ScholarCross Ref
11. Igarashi, T., and Mitani, J. 2010. Apparent layer operations for the manipulation of deformable objects. In ACM SIGGRAPH 2010 Papers, ACM, New York, NY, USA, SIGGRAPH ’10, 110:1–110:7. Google ScholarDigital Library
12. Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: a sketching interface for 3d freeform design. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH ’99, 409–416. Google ScholarDigital Library
13. kara, L. B., and Shimada, K. 2007. Sketch-based 3d-shape creation for industrial styling design. IEEE Comput. Graph. Appl. 27, 1 (Jan.), 60–71. Google ScholarDigital Library
14. Nakayama, K., and Shimojo, S. 1992. Experiencing and Perceiving Visual Surfaces. Science 257, 1357–1363.Google ScholarCross Ref
15. Nealen, A., Igarashi, T., Sorkine, O., and Alexa, M. 2007. FiberMesh: designing freeform surfaces with 3d curves. In ACM SIGGRAPH 2007 papers, ACM, New York, NY, USA, SIGGRAPH ’07. Google ScholarDigital Library
16. Ohtake, Y., Belyaev, A., and Seidel, H.-P. 2004. Ridge-valley lines on meshes via implicit surface fitting. In ACM SIGGRAPH 2004 Papers, ACM, New York, NY, USA, SIGGRAPH ’04, 609–612. Google ScholarDigital Library
17. Olsen, L., Samavati, F. F., Sousa, M. C., and Jorge, J. A. 2009. Sketch-based modeling: A survey. Computers and Graphics 33, 1, 85–103. Google ScholarDigital Library
18. Olsen, L., Samavati, F., and Jorge, J. 2011. NaturaSketch: Modeling from images and natural sketches. IEEE Computer Graphics and Applications 31, 6, 24–34. Google ScholarDigital Library
19. Pratscher, M., Coleman, P., Laszlo, J., and Singh, K. 2005. Outside-in anatomy based character rigging. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, SCA ’05, 329–338. Google ScholarDigital Library
20. Rivers, A., Durand, F., and Igarashi, T. 2010. 3d modeling with silhouettes. In ACM SIGGRAPH 2010 papers, ACM, New York, NY, USA, SIGGRAPH ’10, 109:1–109:8. Google ScholarDigital Library
21. Robson, C., Maharik, R., Sheffer, A., and Carr, N. 2011. Context-aware garment modeling from sketches. Computers and Graphics (Proc. SMI 2011), 604–613. Google ScholarDigital Library
22. Schmid, J., Senn, M. S., Gross, M., and Sumner, R. W. 2011. Overcoat: An implicit canvas for 3d painting. In ACM SIGGRAPH 2011 Papers, ACM, New York, NY, USA, SIGGRAPH ’11, 28:1–28:10. Google ScholarDigital Library
23. Schmidt, R., and Singh, K. 2008. Sketch-based procedural surface modeling and compositing using surface trees. Comput. Graph. Forum 27, 2, 321–330.Google ScholarCross Ref
24. Schmidt, R., and Singh, K. 2010. Meshmixer: An interface for rapid mesh composition. In ACM SIGGRAPH 2010 Talks, ACM, New York, NY, USA, SIGGRAPH ’10, 6:1–6:1. Google ScholarDigital Library
25. Schmidt, R., Khan, A., Singh, K., and Kurtenbach, G. 2009. Analytic drawing of 3d scaffolds. ACM Trans. Graph. 28. Google ScholarDigital Library
26. Shapiro, V., Farin, G., Hoschek, J., and S. Kim, M., 2001. Solid modeling.Google Scholar
27. Sutherland, I. E. 1964. Sketch pad a man-machine graphical communication system. In Proceedings of the SHARE Design Automation Workshop, ACM, New York, NY, USA, DAC ’64, 6.329–6.346. Google ScholarDigital Library
28. Sýkora, D., Kavan, L., Čadí K, M., Jamriška, O., Jacobson, A., Whited, B., Simmons, M., and Sorkine-Hornung, O. 2014. Ink-and-ray: Bas-relief meshes for adding global illumination effects to hand-drawn characters. ACM Transaction on Graphics 33. Google ScholarDigital Library
29. Takayama, K., Panozzo, D., Sorkine-Hornung, A., and Sorkine-Hornung, O. 2013. Sketch-based generation and editing of quad meshes. ACM Trans. Graph. 32, 4 (July), 97:1–97:8. Google ScholarDigital Library
30. Turquin, E., Wither, J., Boissieux, L., Cani, M.-P., and Hughes, J. F. 2007. A sketch-based interface for clothing virtual characters. IEEE Comput. Graph. Appl. 27, 1 (Jan.), 72–81. Google ScholarDigital Library
31. Vaillant, R., Barthe, L., Guennebaud, G., Cani, M.-P., Rohmer, D., Wyvill, B., Gourmel, O., and Paulin, M. 2013. Implicit skinning: Real-time skin deformation with contact modeling. ACM Trans. Graph. 32, 4 (July), 125:1–125:12. Google ScholarDigital Library
32. Volino, P., and Magnenat-Thalmann, N. 2000. Virtual Clothing: Theory and Practice. No. v. 1 in Virtual Clothing: Theory and Practice. Springer.Google Scholar
33. Xu, B., Chang, W., Sheffer, A., Bousseau, A., McCrae, J., and Singh, K. 2014. True2form: 3d curve networks from 2d sketches via selective regularization. Transactions on Graphics (Proc. SIGGRAPH 2014) 33, 4. Google ScholarDigital Library
34. Yasseen, Z., Nasri, A., Boukaram, W., Volino, P., Magnenat-Thalmann, N., et al. 2013. Sketch-based garment design with quad meshes. Computer-Aided Design. Google ScholarDigital Library
35. Zimmermann, J., Nealen, A., and Alexa, M. 2007. Silsketch: Automated sketch-based editing of surface meshes. In Proceedings of the 4th Eurographics Workshop on Sketch-based Interfaces and Modeling, ACM, New York, NY, USA, SBIM ’07, 23–30. Google ScholarDigital Library