“ShapePalettes: interactive normal transfer via sketching” by Wu, Tang, Brown and Shum

We present a simple interactive approach to specify 3D shape in a single view using “shape palettes”. The interaction is as follows: draw a simple 2D primitive in the 2D view and then specify its 3D orientation by drawing a corresponding primitive on a shape palette. The shape palette is presented as an image of some familiar shape whose local 3D orientation is readily understood and can be easily marked over. The 3D orientation from the shape palette is transferred to the 2D primitive based on the markup. As we will demonstrate, only sparse markup is needed to generate expressive and detailed 3D surfaces. This markup approach can be used to model freehand 3D surfaces drawn in a single view, or combined with image-snapping tools to quickly extract surfaces from images and photographs.

1. Bookstein, F. 1989. Principal warps: Thin-plate splines and the decomposition of deformations. PAMI 11, 6 (June), 567–585. Google ScholarDigital Library
2. Criminisi, A., Reid, I., and Zisserman, A. 2000. Single view metrology. IJCV 40, 2 (November), 123–148. Google ScholarDigital Library
3. DeCarlo, D., Finkelstein, A., Rusinkiewicz, S., and Santella, A. 2003. Suggestive contours for conveying shape. ACM Trans. Graph. 22, 3, 848–855. Google ScholarDigital Library
4. Frankot, R., and Chellappa, R. 1988. A method for enforcing integrability in shape from shading algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 10, 4, 439–451. Google ScholarDigital Library
5. Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., and Dobkin, D. 2004. Modeling by example. ACM Trans. Graph. 23, 3, 652–663. Google ScholarDigital Library
6. Goldman, D., Curless, B., Hertzmann, A., and Seitz, S. 2005. Shape and spatially-varying brdfs from photometric stereo. In ICCV05, 1: 341–348. Google ScholarDigital Library
7. Hertzmann, A., and Seitz, S. 2005. Example-based photometric stereo: Shape reconstruction with general, varying brdfs. PAMI 27, 8 (August), 1254–1264. Google ScholarDigital Library
8. Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24, 3, 577–584. Google ScholarDigital Library
9. Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: a sketching interface for 3d freeform design. In SIGGRAPH ’99, 409–416. Google ScholarDigital Library
10. Johnston, S. F. 2002. Lumo: illumination for cel animation. In NPAR ’02: Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, ACM Press, New York, NY, USA. Google ScholarDigital Library
11. Karpenko, O. A., and Hughes, J. F. 2006. Smoothsketch: 3d free-form shapes from complex sketches. ACM Trans. Graph. 25, 3. Google ScholarDigital Library
12. Koenderink, J. 1998. Pictorial relief. Royal 356, 1740, 1071–1086.Google Scholar
13. Kovesi, P. 2005. Shapelets correlated with surface normals produce surfaces. In ICCV05, 994–1001. Google ScholarDigital Library
14. Mortensen, E., and Barrett, W. 1995. Intelligent scissors for image composition. Proceedings of ACM SIGGRAPH95, 191–198. Google ScholarDigital Library
15. Nalwa, V. 1993. A Guided Tour of Computer Vision. Addison-Wesley. Google ScholarDigital Library
16. Nealen, A., Sorkine, O., Alexa, M., and Cohen-Or, D. 2005. A sketch-based interface for detail-preserving mesh editing. ACM Trans. Graph. 24, 3, 1142–1147. Google ScholarDigital Library
17. Ohtake, Y., Belyaev, A., and Seidel, H.-P. 2004. Ridge-valley lines on meshes via implicit surface fitting. ACM Trans. Graph. 23, 3, 609–612. Google ScholarDigital Library
18. Okabe, M., Zeng, G., Matsushita, Y., Igarashi, T., Quan, L., and Shum, H.-Y. 2006. Single-view relighting with normal map painting. In Proceedings of Pacific Graphics, 27–34.Google Scholar
19. Sloan, P. J., Martin, W., Gooch, A., and Gooch, B. 2001. The lit sphere: A model for capturing NPR shading from art. In Proceedings of Graphics Interface 2001, B. Watson and J. W. Buchanan, Eds., 143–150. Google ScholarDigital Library
20. Van Overveld, C. W. A. M. 1996. Painting gradients: Free-form surface design using shading patterns. In Graphics Interface ’96, Canadian Human-Computer Communications Society, W. A. Davis and R. Bartels, Eds., 151–158. Google ScholarDigital Library
21. Wu, T.-P., Tang, K.-L., Tang, C.-K., and Wong, T.-T. 2006. Dense photometric stereo: A markov random field approach. PAMI 28, 11 (November), 1830–1846. Google ScholarDigital Library
22. Zeleznik, R. C., Herndon, K. P., and Hughes, J. F. 1996. Sketch: an interface for sketching 3d scenes. In SIGGRAPH ’96, 163–170. Google ScholarDigital Library
23. Zhang, L., Dugas-Phocion, G., Samson, J., and Seitz, S. 2001. Single view modeling of free-form scenes. In CVPR01, 1:990–997.Google Scholar