“Ink-and-Ray: Bas-Relief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters” by Sýkora, Kavan, Čadík, Jamriška, Jacobson, et al. …

  • ©Daniel Sýkora, Ladislav Kavan, Martin Čadík, Ondřej Jamriška, Alec Jacobson, Brian Whited, Maryann Simmons, and Olga Sorkine-Hornung

Conference:


Type:


Title:

    Ink-and-Ray: Bas-Relief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters

Session/Category Title: Non-Photorealistic Rendering


Presenter(s)/Author(s):


Moderator(s):



Abstract:


    We present a new approach for generating global illumination renderings of hand-drawn characters using only a small set of simple annotations. Our system exploits the concept of bas-relief sculptures, making it possible to generate 3D proxies suitable for rendering without requiring side-views or extensive user input. We formulate an optimization process that automatically constructs approximate geometry sufficient to evoke the impression of a consistent 3D shape. The resulting renders provide the richer stylization capabilities of 3D global illumination while still retaining the 2D hand-drawn look-and-feel. We demonstrate our approach on a varied set of hand-drawn images and animations, showing that even in comparison to ground-truth renderings of full 3D objects, our bas-relief approximation is able to produce convincing global illumination effects, including self-shadowing, glossy reflections, and diffuse color bleeding.

References:


    1. E. D. Andersen and K. D. Andersen. 2000. The Mosek interior point optimizer for linear programming: An implementation of the homogeneous algorithm. In High Performance Optimization, Kluwer Academic Publishers, 197–232.
    2. J. Andrews, P. Joshi, and N. A. Carr. 2011. A linear variational system for modelling from curves. Comput. Graph. Forum 30, 6, 1850–1861.
    3. P. N. Belhumeur, D. J. Kriegman, and A. L. Yuille. 1999. The bas-relief ambiguity. Int. J. Comput. Vis. 35, 1, 33–44
    4. B.-Y. Chen, Y. Ono, and T. Nishita. 2005. Character animation creation using hand-drawn sketches. Vis. Comput. 21, 8–10, 551–558.
    5. F. Cole, P. Isola, W. T. Freeman, F. Durand, and E. H. Adelson. 2012. Shapecollage: Occlusion-aware, example-based shape interpretation. In Proceedings of the European Conference on Computer Vision. 665–678.
    6. H. A. David. 1988. The Method of Paired Comparisons 2nd Ed. Oxford University Press.
    7. D. Geiger, H.-K. Pao, and N. Rubin. 1998. Salient and multiple illusory surfaces. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 118–124.
    8. Y. Gingold, T. Igarashi, and D. Zorin. 2009. Structured annotations for 2D-to-3D modeling. ACM Trans. Graph. 28, 5.
    9. Y. Hochberg and A. C. Tamhane. 1987. Multiple Comparison Procedures 1st Ed. Wiley.
    10. T. Igarashi, S. Matsuoka, and H. Tanaka. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. 409–416.
    11. O. Jamriška, D. Sýkora, and A. Hornung. 2012. Cache-efficient graph cuts on structured grids. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (SIGGRAPH’12). 3673–3680.
    12. S. Jeschke, D. Cline, and P. Wonka. 2009. A GPU laplacian solver for diffusion curves and poisson image editing. ACM Trans. Graphics 28, 5, 116.
    13. S. F. Johnston. 2002. Lumo: Illumination for cel animation. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 45–52.
    14. P. Joshi and N. A. Carr. 2008. Repousse: Automatic inflation of 2D artwork. In Proceedings of the Eurographics Workshop on Sketch-Based Interfaces and Modeling. 49–55.
    15. J. T. Kajiya. 1986. The rendering equation. SIGGRAPH Comput. Graph. 20, 4, 143–150.
    16. O. A. Karpenko and J. F. Hughes. 2006. SmoothSketch: 3D free-form shapes from complex sketches. ACM Trans. Graph. 25, 3, 589–598.
    17. E. A. Khan, E. Reinhard, R. Fleming, and H. Buelthoff. 2006. Image-based material editing. ACM Trans. Graph. 25, 3, 654–663.
    18. J. Lopez-Moreno, J. Jimenez, S. Hadap, E. Reinhard, K. Anjyo, and D. Gutierrez. 2010. Stylized depiction of images based on depth perception. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 109–118.
    19. J. Malik. 1986. Interpreting line drawings of curved objects. Ph.D. dissertation, Stanford University.
    20. D. C. Mongomery and G. C. Runger. 1999. Applied, Statistics, and, Probability, for, Engineers 2nd Ed. John Wiley and Sons.
    21. A. Nealen, T. Igarashi, O. Sorkine, and M. Alexa. 2007. FiberMesh: Designing freeform surfaces with 3D curves. ACM Trans. Graph. 26, 3.
    22. G. Noris, D. Sýkora, A. Shamir, S. Coros, B. Whited, M. Simmons, A. Hornung, M. Gross, and R. Sumner. 2012. Smart scribbles for sketch segmentation. Comput. Graph. Forum 31, 8, 2516–2527.
    23. M. Okabe, G. Zeng, Y. Matsushita, T. Igarashi, L. Quan, and H.-Y. Shum. 2006. Single-view relighting with normal map painting. In Proceedings of the Pacific Conference on Computer Graphics and Applications. 27–34.
    24. L. Olsen, F. Samavati, and J. A. Jorge. 2011. NaturaSketch: Modeling from images and natural sketches. IEEE Comput. Graph. Appl. 31, 6, 24–34.
    25. Y. Ono, B.-Y. Chen, and T. Nishita. 2004. 3D character model creation from cel animation. In Proceedings of the International Conference on Cyberworlds. 210–215.
    26. A. Orzan, A. Bousseau, H. Winnemöller, P. Barla, J. Thollot, and D. Salesin. 2008. Diffusion curves: A vector representation for smooth-shaded images. ACM Trans. Graph. 27, 3.
    27. Y. Ostrovsky, P. Cavanagh, and P. Sinha. 2005. Perceiving illumination inconsistencies. Percept. 34, 11, 1301–1314.
    28. S. G. Parker, J. Bigler, A. Dietrich, H. Friedrich, J. Hoberock, D. Luebke, D. McAllister, M. McGuire, K. Morley, A. Robison, and M. Stich. 2010. OptiX: A general purpose ray tracing engine. ACM Trans. Graph. 29, 4.
    29. L. Petrović, B. Fujito, L. Williams, and A. Finkelstein. 2000. Shadows for cel animation. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’00). 511–516.
    30. H. Read. 1961. The Art of Sculpture 2nd Ed. Bollingen Foundation, New York.
    31. M. W. Ren, J. Y. Yang, and H. Sun. 2002. Tracing boundary contours in a binary image. Image Vis. Comput. 20, 2, 125–131.
    32. A. Rivers, T. Igarashi, and F. Durand. 2010. 2.5D cartoon models. ACM Trans. Graph. 29, 4,
    33. C. Shao, A. Bousseau, A. Sheffer, and K. Singh. 2012. CrossShade: Shading concept sketches using cross-section curves. ACM Trans. Graph. 31, 4.
    34. J. R. Shewchuk. 1996. Triangle: Engineering a 2D quality mesh generator and delaunay triangulator. In Proceedings of the ACM Workshop on Applied Computational Geometry. 203–222.
    35. J. R. Shewchuk. 2002. Delaunay refinement algorithms for triangular mesh generation. Comput. Geometry: Theory Appl. 22, 1–3, 21–74.
    36. D. Sýkora, M. Ben-Chen, M. Čadík, B. Whited, and M. Simmons. 2011. TexToons: Practical texture mapping for hand-drawn cartoon animations. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 75–83.
    37. D. Sýkora, J. Buriánek, and J. Žára. 2005. Colorization of black-and-white cartoons. Image Vis. Comput. 23, 9, 767–782.
    38. D. Sýkora, J. Dingliana, and S. Collins. 2009a. As-rigid-as-possible image registration for hand-drawn cartoon animations. In Proceedings of the International Symposium on Non-photorealistic Animation and Rendering. 25–33.
    39. D. Sýkora, J. Dingliana, and S. Collins. 2009b. LazyBrush: Flexible painting tool for hand-drawn cartoons. Comput. Graph. Forum 28, 2, 599–608.
    40. D. Sýkora, D. Sedláček, S. Jinchao, J. Dingliana, and S. Collins. 2010. Adding depth to cartoons using sparse depth (in)equalities. Comput. Graph. Forum 29, 2, 615–623.
    41. B. G. Tabachnick and L. S. Fidell. 2007. Using Multivariate Statistics 5th Ed. Pearson Education.
    42. C. Toler-Franklin, A. Finkelstein, and S. Rusinkiewicz. 2007. Illustration of complex real-world objects using images with normals. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 111–119.
    43. R. Vergne, P. Barla, R. W. Fleming, and X. Granier. 2012. Surface flows for image-based shading design. ACM Trans. Graph. 31, 4.
    44. Y. Wang, Y. Chen, J. Z. Liu, and X. Tang. 2009. 3D reconstruction of curved objects from single 2D line drawings. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1834–1841.
    45. T. Weyrich, J. Deng, C. Barnes, S. Rusinkiewicz, and A. Finkelstein. 2007. Digital bas-relief from 3D scenes. ACM Trans. Graph. 26, 3.
    46. H. Winnemöller, A. Orzan, L. Boissieux, and J. Thollot. 2009. Texture design and draping in 2D images. Comput. Graph. Forum 28, 4, 1091–1099.

ACM Digital Library Publication:



Overview Page: