“Authoring and Animating Painterly Characters” by Bassett, Baran, Schmid, Gross and Sumner

  • ©Katie Bassett, Ilya Baran, Johannes Schmid, Markus Gross, and Robert W. Sumner

Conference:


Type:


Session Title:

    Non-Photorealistic Rendering

Title:

    Authoring and Animating Painterly Characters

Moderator(s):


Presenter(s)/Author(s):


Abstract:


    Artists explore the visual style of animated characters through 2D concept art, since it affords them a nearly unlimited degree of creative freedom. Realizing the desired visual style, however, within the 3D character animation pipeline is often impossible, since artists must work within the technical limitations of the pipeline toolset. In order to expand the range of possible visual styles for digital characters, our research aims to incorporate the expressiveness afforded by 2D concept painting into the computer animation pipeline as a core component of character authoring and animation. While prior 3D painting methods focus on static geometry or simple animations, we develop tools for the more difficult task of character animation. Our system shows how 3D stroke-based paintings can be deformed using standard rigging tools. We also propose a configuration-space keyframing algorithm for authoring stroke effects that depend on scene variables such as character pose or light position. During animation, our system supports stroke-based temporal keyframing for one-off effects. Our primary technical contribution is a novel interpolation scheme for configuration-space keyframing that ensures smooth, controllable results. We demonstrate several characters authored with our system that exhibit painted effects difficult to achieve with traditional animation tools.

References:


    1. Akenine-Moller, T., Haines, E., and Hoffman, N. 2008. Real-Time Rendering 3rd Ed. A. K. Peters, Ltd., Natick, MA.
    2. Baran, I., Schmid, J., Siegrist, T., Gross, M., and Sumner, R. W. 2011. Mixed-order compositing for 3d painting. ACM Trans. Graph. 30, 6, 132:1–132:6.
    3. Baran, I., Vlasic, D., Grinspun, E., and Popovic, J. 2009. Semantic deformation transfer. ACM Trans. Graph. 28, 3, 36:1–36:6.
    4. Benard, P., Bousseau, A., and Thollot, J. 2011. State-of-the-art report on temporal coherence for stylized animations. Comput. Graph. Forum 30, 8, 2367–2386.
    5. Bourguignon, D., Cani, M.-P., and Drettakis, G. 2001. Drawing for illustration and annotation in 3d. Comput. Graph. Forum 20, 3, 114–122.
    6. Bousseau, A., Kaplan, M., Thollot, J., and Sillion, F. X. 2006. Interactive watercolor rendering with temporal coherence and abstraction. In Proceedings of the 4th International Symposium on Non-Photorealistic Animation and Rendering. 141–149.
    7. Choi, B., You, M., and Noh, J. 2008. Extended spatial keyframing for complex character animation. Comput. Anim. Virtual Worlds 19, 3–4, 175–188.
    8. Cohen, J. M., Hughes, J. F., and Zeleznik, R. C. 2000. Harold: A world made of drawings. In Proceedings of the 1st International Symposium on Non-Photorealistic Animation and Rendering. 83–90.
    9. Curtis, C. J., Anderson, S. E., Seims, J. E., Fleischer, K. W., and Salesin, D. H. 1997. Computer-generated watercolor. In Proceedings of the Annual ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 421–430.
    10. Daniels, E. 1999. Deep canvas in disney’s tarzan. In Proceedings of the ACM SIGGRAPH Conference Abstracts and Applications (SIGGRAPH’99). 200.
    11. Franke, R. 1977. Locally determined smooth interpolation at irregularly spaced points in several variables. IMA J. Appl. Math. 19, 4, 471–482.
    12. Hegland, M., Roberts, S., and Altas, I. 1997. Finite element thin plate splines for surface fitting. In Proceedings of the Conference on Computational Techniques and Applications (CTAC’97). 289–296.
    13. Hertzmann, A. 2003. A survey of stroke-based rendering. IEEE Comput. Graph. Appl. 23, 4, 70–81.
    14. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In Proceedings of the Annual ACM/SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 327–340.
    15. Hertzmann, A. and Perlin, K. 2000. Painterly rendering for video and interaction. In Proceedings of the 1st International Symposium on Non-Photorealistic Animation and Rendering (NPAR’00). ACM Press, New York, 7–12.
    16. Igarashi, T., Moscovich, T., and Hughes, J. 2005. Spatial keyframing for performance-driven animation. In Proceedings of the ACM/SIGGRAPH/Eurographics Symposium on Computer Animation. 107–116.
    17. Jacobson, A., Baran, I., Popovic, J., and Sorkine, O. 2011. Bounded biharmonic weights for real-time deformation. ACM Trans. Graph. 30, 4, 78:1–78:8. Google ScholarDigital Library
    18. Kalnins, R. D., Markosian, L., Meier, B. J., Kowalski, M. A., Lee, J. C., Davidson, P. L., Webb, M., Hughes, J. F., and Finkelstein, A. 2002. Wysiwyg npr: Drawing strokes directly on 3d models. ACM Trans. Graph. 21, 3, 755–762. Google ScholarDigital Library
    19. Kalogerakis, E., Nowrouzezahrai, D., Breslav, S., and Hertzmann, A. 2011. Learning hatching for pen-and-ink illustration of surfaces. ACM Trans. Graph. 31, 1, 1:1–1:17. Google ScholarDigital Library
    20. Keefe, D., Zeleznik, R., and Laidlaw, D. 2007. Drawing on air: Input techniques for controlled 3d line illustration. IEEE Trans. Vis. Comput. Graph. 13, 1067–1081. Google ScholarDigital Library
    21. Keefe, D. F., Feliz, D. A., Moscovich, T., Laidlaw, D. H., and Laviola, J. J. Jr. 2001. Cavepainting: A fully immersive 3d artistic medium and interactive experience. In Proceedings of the ACM Symposium on Interactive 3D Graphics. 85–94. Google ScholarDigital Library
    22. Kowalski, M. A., Markosian, L., Northrup, J. D., Bourdev, L., Barzel, R., HOLDEN, L. S., and HUGHES, J. F. 1999. Art-based rendering of fur, grass, and trees. In Proceedings of the Annual ACM/SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 433–438. Google ScholarDigital Library
    23. Levin, D. 1998. The approximation power of moving least-squares. Math. Comput. 67, 224, 1517–1532. Google ScholarDigital Library
    24. Lewis, J. P., Cordner, M., and Fong, N. 2000. Pose space deformations: A unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of the Annual ACM/SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 165–172. Google ScholarDigital Library
    25. Lin, L., Zeng, K., Lv, H., Wang, Y., Xu, Y., and Zhu, S.-C. 2010. Painterly animation using video semantics and feature correspondence. In Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering (NPAR’10). ACM Press, New York, 73–80. Google ScholarDigital Library
    26. Litwinowicz, P. 1997. Processing images and video for an impressionist effect. In Proceedings of the Annual ACM/SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 407–414. Google ScholarDigital Library
    27. Lu, J., Sander, P. V., and Finkelstein, A. 2010. Interactive painterly stylization of images, videos and 3d animations. In Proceedings of the ACM Symposium on Interactive 3D Graphics and Games. 127–134. Google ScholarDigital Library
    28. Markosian, L., Kowalski, M. A., Trychin, S. J., Bourdev, L. D., Goldstein, D., and Hughes, J. F. 1997. Real-time nonphotorealistic rendering. In Proceedings of the Annual ACM/SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 415–420. Google ScholarDigital Library
    29. Maya. 2012. http://www.autodesk.com/maya.Google Scholar
    30. Meier, B. J. 1996. Painterly rendering for animation. In Proceedings of the Annual ACM/SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 477–484. Google ScholarDigital Library
    31. Ngo, T., Cutrell, D., Dana, J., Donald, B., Loeb, L., and Zhu, S. 2000. Accessible animation and customizable graphics via simplicial configuration modeling. In Proceedings of the Annual ACM/SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 403–410. Google ScholarDigital Library
    32. O’Donovan, P. and Hertzmann, A. 2012. Anipaint: Interactive painterly animation from video. IEEE Trans. Vis. Comput. Graph. 18, 3, 475–487. Google ScholarDigital Library
    33. Paint Effects. 2011. Painting in 3d using paint effects. In Autodesk Maya Learning Resources. http://download.autodesk.com/us/maya/2011help.Google Scholar
    34. Praun, E., Hoppe, H., Webb, M., and Finkelstein, A. 2001. Realtime hatching. In Proceedings of the Annual ACM/SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 579–584. Google ScholarDigital Library
    35. Rademacher, P. 1999. View-dependent geometry. In Proceedings of the Annual ACM/SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 439–446. Google ScholarDigital Library
    36. Rivers, A., Igarashi, T., and Durand, F. 2010. 2.5d cartoon models. ACM Trans. Graph. 29, 4, 59:1–59:7. Google ScholarDigital Library
    37. Schmid, J., Senn, M. S., Gross, M., and Sumner, R. W. 2011. Overcoat: An implicit canvas for 3d painting. ACM Trans. Graph. 30, 4, 28:1–28:10. Google ScholarDigital Library
    38. Shepard, D. 1968. A two-dimensional interpolation function for irregularly-spaced data. In Proceedings of the 23rd ACM National Conference. ACM Press, New York, 517–524. Google ScholarDigital Library
    39. Sibson, R. 1981. A brief description of natural neighbor interpolation. In Interpolating Multivariate Data. John Wiley and Sons, 21–36.Google Scholar
    40. Singh, K. and Kokkevis, E. 2000. Skinning characters using surface oriented free-form deformations. In Proceedings of the Annual Graphics Interface Conference. 35–42.Google Scholar
    41. Sloan, P.-P. J., Rose, C. F. III, and Cohen, M. F. 2001. Shape by example. In Proceedings of the ACM Symposium on Interactive 3D Graphics. 135–144. Google ScholarDigital Library
    42. Teece, D. 1998. 3d painting for non-photorealistic rendering. In ACM/SIGGRAPH Conference Abstracts and Applications. ACM Press, New York, 248. Google ScholarDigital Library
    43. Tolba, O., Dorsey, J., and Mcmillan, L. 2001. A projective drawing system. In Proceedings of the ACM Symposium on Interactive 3D Graphics. 25–34. Google ScholarDigital Library
    44. Zhao, M. and Zhu, S.-C. 2011. Customizing painterly rendering styles using stroke processes. In Proceedings of the ACM/SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering (NPAR’11). ACM Press, New York. 137–146. Google ScholarDigital Library

ACM Digital Library Publication: