“SmoothSketch: 3D free-form shapes from complex sketches” by Karpenko and Hughes

We introduce SmoothSketch—a system for inferring plausible 3D free-form shapes from visible-contour sketches. In our system, a user’s sketch need not be a simple closed curve as in Igarashi’s Teddy [1999], but may have cusps and T-junctions, i.e., endpoints of hidden parts of the contour. We follow a process suggested by Williams [1994] for inferring a smooth solid shape from its visible contours: completion of hidden contours, topological shape reconstruction, and smoothly embedding the shape via relaxation. Our main contribution is a practical method to go from a contour drawing to a fairly smooth surface with that drawing as its visible contour. In doing so, we make several technical contributions: • extending Williams’ and Mumford’s work [Mumford 1994] on figural completion of hidden contours containing T-junctions to contours containing cusps as well, • characterizing a class of visible-contour drawings for which inflation can be proved possible, • finding a topological embedding of the combinatorial surface that Williams creates from the figural completion, and • creating a fairly smooth solid shape by smoothing the topological embedding using a mass-spring system.We handle many kinds of drawings (including objects with holes), and the generated shapes are plausible interpretations of the sketches. The method can be incorporated into any sketch-based free-form modeling interface like Teddy.

1. Alexe, A., Barthe, L., Cani, M.-P., and Gaildrat, V. 2005. Shape modeling by sketching using convolution surfaces. In Pacific Graphics, Short paper.]]Google Scholar
2. Bourguignon, D., Cani, M.-P., and Drettakis, G. 2001. Drawing for illustration and annotation in 3D. Computer Graphics Forum 20, 3, 114–122.]]Google ScholarCross Ref
3. Gibson, S., and Mirtich, B. 1997. A survey of deformable modeling in computer graphics. Tech. Rep. TR-97-19, Mitsubishi Electric Research Lab., Cambridge, MA.]]Google Scholar
4. Grenander, U. 1981. Lectures in Pattern Theory, vol. 1–3. Springer-Verlag.]]Google Scholar
5. Griffiths, H. B. 1981. Surfaces. Cambridge University Press.]]Google Scholar
6. Guillemin, V., and Pollack, A. 1974. Differential Topology. Prentice Hall.]]Google Scholar
7. Hoffman, D. D. 2000. Visual Intelligence: How We Create What We See. W. W. Norton.]]Google Scholar
8. Huffman, D. A. 1971. Impossible objects as nonsense sentences. In Machine Intelligence 6, B. Meltzer and D. Michie, Eds. American Elsevier Publishing Co., New York.]]Google Scholar
9. Igarashi, T., and Hughes, J. F. 2003. Smooth meshes for sketch-based freeform modeling. In Symposium on Interactive 3D Graphics, 139–142.]] Google ScholarDigital Library
10. Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of SIGGRAPH 99, 409–416.]] Google ScholarDigital Library
11. Johnston, S. F. 2002. Lumo: illumination for cel animation. In Proceedings of the Symposium on Non-photorealistic animation and rendering, 45–52.]] Google ScholarDigital Library
12. Kanizsa, G. 1979. Organization in vision. Praeger, New York.]]Google Scholar
13. Karpenko, O., and Hughes, J. 2005. Inferring 3d free-form shapes from contour drawings. In Siggraph 2005 Sketches Program.]] Google ScholarDigital Library
14. Karpenko, O., Hughes, J., and Raskar, R. 2002. Free-form sketching with variational implicit surfaces. In Eurographics Computer Graphics Forum, vol. 21/3, 585–594.]]Google Scholar
15. Kho, Y., and Garland, M. 2005. Sketching mesh deformations. In Symposium on Interactive 3D Graphics and Games 2005, 147–154.]] Google ScholarDigital Library
16. Kobbelt, L. P., Bareuther, T., and Seidel, H.-P. 2000. Multiresolution shape deformations for meshes with dynamic vertex connectivity. Computer Graphics Forum 19, 3.]]Google ScholarCross Ref
17. Koenderink, J. J. 1990. Solid Shape. MIT Press.]] Google ScholarDigital Library
18. Lipson, H., and Shpitalni, M. 1997. Conceptual design and analysis by sketching. In AIEDAM-97, vol. 14, 391–401.]] Google ScholarDigital Library
19. Mumford, D. 1994. Elastica and computer vision. In Algebraic Geometry and Its Applications, C. L. Bajaj, Ed. Springer-Verlag New York Inc.]]Google Scholar
20. Nealen, A., Sorkine, O., Alexa, M., and Cohen-Or, D. 2005. A sketch-based interface for detail-preserving mesh editing. ACM SIGGRAPH Transactions on Graphics, 1142–1147.]] Google ScholarDigital Library
21. Nitzberg, M., Mumford, D., and Shiota, T. 1993. Filtering, Segmentation, and Depth. Springer-Verlag.]] Google ScholarDigital Library
22. Pentland, A., and Kuo, J. 1989. The artist at the interface. Tech. Rep. 114, MIT Media Lab.]]Google Scholar
23. Pereira, J. P., Branco, V. A., Jorge, J. A., Silva, N. F., Cardoso, T. D., and Ferreira, F. N. 2004. Cascading recognizers for ambiguous calligraphic interaction. In Eurographics Workshop on Sketch-Based Interfaces and Modeling.]]Google Scholar
24. Schmidt, R., Wyvill, B., Sousa, M. C., and Jorge, J. A. 2005. Shapeshop: Sketch-based solid modeling with blobtrees. In Eurographics Workshop on Sketch-Based Interfaces and Modeling, 53–62.]] Google ScholarDigital Library
25. Shesh, A., and Chen, B. 2004. Smartpaper: An interactive and user-friendly sketching system. In Eurographics Computer Graphics Forum, vol. 23/3, 301–310.]]Google Scholar
26. Shewchuk, J. R. 1996. Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In Applied Computational Geometry: Towards Geometric Engineering, M. C. Lin and D. Manocha, Eds., vol. 1148. May.]] Google ScholarDigital Library
27. Sketchup. SketchUp software: 3D sketching software for the conceptual phases of design. http://www.sketchup.com.]]Google Scholar
28. Taubin, G. 1995. A signal processing approach to fair surface design. Computer Graphics 29, Annual Conference Series, 351–358.]] Google ScholarDigital Library
29. Taubin, G. 2001. Linear anisotropic mesh filtering. Tech. Rep. RC-22213, IBM Research.]]Google Scholar
30. Tolba, O., Dorsey, J., and Mcmillan, L. 2001. A projective drawing system. In 2001 ACM Symposium on Interactive 3D Graphics, 25–34.]] Google ScholarDigital Library
31. Ulupinar, F., and Nevatia, R. 1993. Perception of 3D surfaces from 2D contours. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15/1, 3–18.]] Google ScholarDigital Library
32. Ulupinar, F., and Nevatia, R. 1995. Shape from contour: Straight homogeneous generalized cylinders and constant section generalized cylinders. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17/2, 120–135.]] Google ScholarDigital Library
33. Williams, L. R., and Jacobs, D. W. 1997. Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience. In Neural Computation, vol. 9/4, 837–858.]] Google ScholarDigital Library
34. Williams, L. R. 1994. Perceptual Completion of Occluded Surfaces. PhD thesis, University of Massachusetts.]] Google ScholarDigital Library
35. Williams, L. R. 1997. Topological reconstruction of a smooth manifold-solid from its occluding contour. Intl. Journal of Computer Vision 23, 1, 93–108.]] Google ScholarDigital Library
36. Witkin, A. P. 1980. Shape from contour. PhD thesis, MIT.]]Google Scholar
37. Zeleznik, R. C., Herndon, K., and Hughes, J. 1996. Sketch: An Interface for Sketching 3D Scenes. In Proceedings of SIGGRAPH 96, 163–170.]] Google ScholarDigital Library