“Ink-and-Ray: Bas-Relief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters” by Sýkora, Kavan, Čadík, Jamriška, Jacobson, et al. …
Conference:
Type(s):
Title:
- Ink-and-Ray: Bas-Relief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters
Session/Category Title: Non-Photorealistic Rendering
Presenter(s)/Author(s):
- Daniel Sýkora
- Ladislav Kavan
- Martin Čadík
- Ondřej Jamriška
- Alec Jacobson
- Brian Whited
- Maryann Simmons
- Olga Sorkine-Hornung
Moderator(s):
Abstract:
We present a new approach for generating global illumination renderings of hand-drawn characters using only a small set of simple annotations. Our system exploits the concept of bas-relief sculptures, making it possible to generate 3D proxies suitable for rendering without requiring side-views or extensive user input. We formulate an optimization process that automatically constructs approximate geometry sufficient to evoke the impression of a consistent 3D shape. The resulting renders provide the richer stylization capabilities of 3D global illumination while still retaining the 2D hand-drawn look-and-feel. We demonstrate our approach on a varied set of hand-drawn images and animations, showing that even in comparison to ground-truth renderings of full 3D objects, our bas-relief approximation is able to produce convincing global illumination effects, including self-shadowing, glossy reflections, and diffuse color bleeding.
References:
- E. D. Andersen and K. D. Andersen. 2000. The Mosek interior point optimizer for linear programming: An implementation of the homogeneous algorithm. In High Performance Optimization, Kluwer Academic Publishers, 197–232.
- J. Andrews, P. Joshi, and N. A. Carr. 2011. A linear variational system for modelling from curves. Comput. Graph. Forum 30, 6, 1850–1861.
- P. N. Belhumeur, D. J. Kriegman, and A. L. Yuille. 1999. The bas-relief ambiguity. Int. J. Comput. Vis. 35, 1, 33–44
- B.-Y. Chen, Y. Ono, and T. Nishita. 2005. Character animation creation using hand-drawn sketches. Vis. Comput. 21, 8–10, 551–558.
- F. Cole, P. Isola, W. T. Freeman, F. Durand, and E. H. Adelson. 2012. Shapecollage: Occlusion-aware, example-based shape interpretation. In Proceedings of the European Conference on Computer Vision. 665–678.
- H. A. David. 1988. The Method of Paired Comparisons 2nd Ed. Oxford University Press.
- D. Geiger, H.-K. Pao, and N. Rubin. 1998. Salient and multiple illusory surfaces. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 118–124.
- Y. Gingold, T. Igarashi, and D. Zorin. 2009. Structured annotations for 2D-to-3D modeling. ACM Trans. Graph. 28, 5.
- Y. Hochberg and A. C. Tamhane. 1987. Multiple Comparison Procedures 1st Ed. Wiley.
- T. Igarashi, S. Matsuoka, and H. Tanaka. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. 409–416.
- O. Jamriška, D. Sýkora, and A. Hornung. 2012. Cache-efficient graph cuts on structured grids. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (SIGGRAPH’12). 3673–3680.
- S. Jeschke, D. Cline, and P. Wonka. 2009. A GPU laplacian solver for diffusion curves and poisson image editing. ACM Trans. Graphics 28, 5, 116.
- S. F. Johnston. 2002. Lumo: Illumination for cel animation. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 45–52.
- P. Joshi and N. A. Carr. 2008. Repousse: Automatic inflation of 2D artwork. In Proceedings of the Eurographics Workshop on Sketch-Based Interfaces and Modeling. 49–55.
- J. T. Kajiya. 1986. The rendering equation. SIGGRAPH Comput. Graph. 20, 4, 143–150.
- O. A. Karpenko and J. F. Hughes. 2006. SmoothSketch: 3D free-form shapes from complex sketches. ACM Trans. Graph. 25, 3, 589–598.
- E. A. Khan, E. Reinhard, R. Fleming, and H. Buelthoff. 2006. Image-based material editing. ACM Trans. Graph. 25, 3, 654–663.
- J. Lopez-Moreno, J. Jimenez, S. Hadap, E. Reinhard, K. Anjyo, and D. Gutierrez. 2010. Stylized depiction of images based on depth perception. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 109–118.
- J. Malik. 1986. Interpreting line drawings of curved objects. Ph.D. dissertation, Stanford University.
- D. C. Mongomery and G. C. Runger. 1999. Applied, Statistics, and, Probability, for, Engineers 2nd Ed. John Wiley and Sons.
- A. Nealen, T. Igarashi, O. Sorkine, and M. Alexa. 2007. FiberMesh: Designing freeform surfaces with 3D curves. ACM Trans. Graph. 26, 3.
- G. Noris, D. Sýkora, A. Shamir, S. Coros, B. Whited, M. Simmons, A. Hornung, M. Gross, and R. Sumner. 2012. Smart scribbles for sketch segmentation. Comput. Graph. Forum 31, 8, 2516–2527.
- M. Okabe, G. Zeng, Y. Matsushita, T. Igarashi, L. Quan, and H.-Y. Shum. 2006. Single-view relighting with normal map painting. In Proceedings of the Pacific Conference on Computer Graphics and Applications. 27–34.
- L. Olsen, F. Samavati, and J. A. Jorge. 2011. NaturaSketch: Modeling from images and natural sketches. IEEE Comput. Graph. Appl. 31, 6, 24–34.
- Y. Ono, B.-Y. Chen, and T. Nishita. 2004. 3D character model creation from cel animation. In Proceedings of the International Conference on Cyberworlds. 210–215.
- A. Orzan, A. Bousseau, H. Winnemöller, P. Barla, J. Thollot, and D. Salesin. 2008. Diffusion curves: A vector representation for smooth-shaded images. ACM Trans. Graph. 27, 3.
- Y. Ostrovsky, P. Cavanagh, and P. Sinha. 2005. Perceiving illumination inconsistencies. Percept. 34, 11, 1301–1314.
- S. G. Parker, J. Bigler, A. Dietrich, H. Friedrich, J. Hoberock, D. Luebke, D. McAllister, M. McGuire, K. Morley, A. Robison, and M. Stich. 2010. OptiX: A general purpose ray tracing engine. ACM Trans. Graph. 29, 4.
- L. Petrović, B. Fujito, L. Williams, and A. Finkelstein. 2000. Shadows for cel animation. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’00). 511–516.
- H. Read. 1961. The Art of Sculpture 2nd Ed. Bollingen Foundation, New York.
- M. W. Ren, J. Y. Yang, and H. Sun. 2002. Tracing boundary contours in a binary image. Image Vis. Comput. 20, 2, 125–131.
- A. Rivers, T. Igarashi, and F. Durand. 2010. 2.5D cartoon models. ACM Trans. Graph. 29, 4,
- C. Shao, A. Bousseau, A. Sheffer, and K. Singh. 2012. CrossShade: Shading concept sketches using cross-section curves. ACM Trans. Graph. 31, 4.
- J. R. Shewchuk. 1996. Triangle: Engineering a 2D quality mesh generator and delaunay triangulator. In Proceedings of the ACM Workshop on Applied Computational Geometry. 203–222.
- J. R. Shewchuk. 2002. Delaunay refinement algorithms for triangular mesh generation. Comput. Geometry: Theory Appl. 22, 1–3, 21–74.
- D. Sýkora, M. Ben-Chen, M. Čadík, B. Whited, and M. Simmons. 2011. TexToons: Practical texture mapping for hand-drawn cartoon animations. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 75–83.
- D. Sýkora, J. Buriánek, and J. Žára. 2005. Colorization of black-and-white cartoons. Image Vis. Comput. 23, 9, 767–782.
- D. Sýkora, J. Dingliana, and S. Collins. 2009a. As-rigid-as-possible image registration for hand-drawn cartoon animations. In Proceedings of the International Symposium on Non-photorealistic Animation and Rendering. 25–33.
- D. Sýkora, J. Dingliana, and S. Collins. 2009b. LazyBrush: Flexible painting tool for hand-drawn cartoons. Comput. Graph. Forum 28, 2, 599–608.
- D. Sýkora, D. Sedláček, S. Jinchao, J. Dingliana, and S. Collins. 2010. Adding depth to cartoons using sparse depth (in)equalities. Comput. Graph. Forum 29, 2, 615–623.
- B. G. Tabachnick and L. S. Fidell. 2007. Using Multivariate Statistics 5th Ed. Pearson Education.
- C. Toler-Franklin, A. Finkelstein, and S. Rusinkiewicz. 2007. Illustration of complex real-world objects using images with normals. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 111–119.
- R. Vergne, P. Barla, R. W. Fleming, and X. Granier. 2012. Surface flows for image-based shading design. ACM Trans. Graph. 31, 4.
- Y. Wang, Y. Chen, J. Z. Liu, and X. Tang. 2009. 3D reconstruction of curved objects from single 2D line drawings. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1834–1841.
- T. Weyrich, J. Deng, C. Barnes, S. Rusinkiewicz, and A. Finkelstein. 2007. Digital bas-relief from 3D scenes. ACM Trans. Graph. 26, 3.
- H. Winnemöller, A. Orzan, L. Boissieux, and J. Thollot. 2009. Texture design and draping in 2D images. Comput. Graph. Forum 28, 4, 1091–1099.