“Example-based expressive animation of 2D rigid bodies”
Conference:
Type:
Title:
- Example-based expressive animation of 2D rigid bodies
Session/Category Title: Sketching & Curves
Presenter(s)/Author(s):
Moderator(s):
Abstract:
We present a novel approach to facilitate the creation of stylized 2D rigid body animations. Our approach can handle multiple rigid objects following complex physically-simulated trajectories with collisions, while retaining a unique artistic style directly specified by the user. Starting with an existing target animation (e.g., produced by a physical simulation engine) an artist interactively draws over a sparse set of frames, and the desired appearance and motion stylization is automatically propagated to the rest of the sequence. The stylization process may also be performed in an off-line batch process from a small set of drawn sequences. To achieve these goals, we combine parametric deformation synthesis that generalizes and reuses hand-drawn exemplars, with non-parametric techniques that enhance the hand-drawn appearance of the synthesized sequence. We demonstrate the potential of our method on various complex rigid body animations which are created with an expressive hand-drawn look using notably less manual interventions as compared to traditional techniques.
References:
1. Yunfei Bai, Danny M Kaufman, C. Karen Liu, and Jovan Popović. 2016. Artist-directed dynamics for 2D animation. ACM Transactions on Graphics 35, 4 (2016), 145.Google ScholarDigital Library
2. Ronen Barzel and Alan H. Barr. 1988. A Modeling System Based on Dynamic Constraints. In Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’88). ACM, 179–188. Google ScholarDigital Library
3. Pierre Bénard, Forrester Cole, Michael Kass, Igor Mordatch, James Hegarty, Martin Sebastian Senn, Kurt Fleischer, Davide Pesare, and Katherine Breeden. 2013. Stylizing animation by example. ACM Transactions on Graphics 32, 4 (2013), 119.Google ScholarDigital Library
4. Christoph Bregler, Lorie Loeb, Erika Chuang, and Hrishi Deshpande. 2002. Turning to the Masters: Motion Capturing Cartoons. ACM Transactions on Graphics 21, 3 (2002), 399–407. Google ScholarDigital Library
5. Erin Catto. 2007. Box2d – a 2D physics engine for games. http://www.box2d.org. (2007).Google Scholar
6. Stephen Chenney, Mark Pingel, Rob Iverson, and Marcin Szymanski. 2002. Simulating Cartoon Style Animation. In Proceedings of International Symposium on Non-photorealistic Animation and Rendering. 133–138. Google ScholarDigital Library
7. Stelian Coros, Sebastian Martin, Bernhard Thomaszewski, Christian Schumacher, Robert Sumner, and Markus Gross. 2012. Deformable Objects Alive! ACM Transactions on Graphics 31, 4 (2012), 69.Google Scholar
8. Jakub Fišer, Ondřej Jamriška, Michal Lukáč, Eli Shechtman, Paul Asente, Jingwan Lu, and Daniel Sýkora. 2016. StyLit: Illumination-guided Example-based Stylization of 3D Renderings. ACM Transactions on Graphics 35, 4 (2016), 92.Google ScholarDigital Library
9. Marcos Garcia, John Dingliana, and Carol O’Sullivan. 2007. A Physically Based Deformation Model for Interactive Cartoon Animation. In Workshop in Virtual Reality Interactions and Physical Simulation “VRIPHYS” (2007). Eurographics Association.Google Scholar
10. Leon A Gatys, Alexander S Ecker, and Matthias Bethge. 2016. Image style transfer using convolutional neural networks. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2414–2423.Google ScholarCross Ref
11. Ben Glocker, Nikos Komodakis, Georgios Tziritas, Nassir Navab, and Nikos Paragios. 2008. Dense Image Registration Through MRFs And Efficient Linear Programming. Medical Image Analysis 12, 6 (2008), 731–741. Google ScholarCross Ref
12. Michael Haller, Christian Hanl, and Jeremiah Diephuis. 2004. Non-photorealistic Rendering Techniques for Motion in Computer Games. Computers in Entertainment 2, 4 (2004). Google ScholarDigital Library
13. Aaron Hertzmann, Charles E Jacobs, Nuria Oliver, Brian Curless, and David H Salesin. 2001. Image analogies. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM, 327–340. Google ScholarDigital Library
14. Nicholas J. Higham and Robert S. Schreiber. 1990. Fast polar decomposition of an arbitrary matrix. SIAM J. Sci. Statist. Comput. 11, 4 (1990), 648–655. Google ScholarDigital Library
15. Ben Jones, Jovan Popović, James McCann, Wilmot Li, and Adam W. Bargteil. 2015. Dynamic sprites: Artistic authoring of interactive animations. Journal of Visualization and Computer Animation 26, 2 (2015), 97–108.Google ScholarDigital Library
16. Ben Jones, Nils Thuerey, Tamar Shinar, and Adam W. Bargteil. 2016. Example-based Plastic Deformation of Rigid Bodies. ACM Transactions on Graphics 35, 4 (2016), 34:1–34:11.Google ScholarDigital Library
17. Henry Kang, Seungyong Lee, and Charles K. Chui. 2007. Coherent Line Drawing. In Proceedings of International Symposium on Non-photorealistic Animation and Rendering. 43–50. Google ScholarDigital Library
18. Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, and George W. Fitzmaurice. 2014a. Kitty: Sketching dynamic and interactive illustrations. In Proceedings of ACM Symposium on User Interface Software and Technology. 395–405. Google ScholarDigital Library
19. Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, Shengdong Zhao, and George W. Fitzmaurice. 2014b. Draco: Bringing life to illustrations with kinetic textures. In Proceedings of ACM Conference on Human Factors in Computing Systems. 351–360. Google ScholarDigital Library
20. Rubaiat Habib Kazi, Tovi Grossman, Nobuyuki Umetani, and George Fitzmaurice. 2016. Motion Amplifiers: Sketching Dynamic Illustrations Using the Principles of 2D Animation. In Proceedings of ACM Conference on Human Factors in Computing Systems. 4599–4609.Google ScholarDigital Library
21. Yuki Koyama, Kenshi Takayama, Nobuyuki Umetani, and Takeo Igarashi. 2012. Real-time Example-based Elastic Deformation. In Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA ’12). Eurographics Association, 19–24.Google Scholar
22. John Lasseter. 1987. Principles of Traditional Animation Applied to 3D Computer Animation. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’87). ACM, 35–44. Google ScholarDigital Library
23. Seungyong Lee, George Wolberg, and Sung Yong Shin. 1998. Polymorph: Morphing Among Multiple Images. IEEE Computer Graphics and Applications 18, 1 (1998), 58–71. Google ScholarDigital Library
24. Sun-Young Lee, Jong-Chul Yoon, Ji-Yong Kwon, and In-Kwon Lee. 2012. CartoonModes: Cartoon stylization of video objects through modal analysis. Graphical Models 74, 2 (2012), 51–60. Google ScholarDigital Library
25. Yin Li, Michael Gleicher, Ying-Qing Xu, and Heung-Yeung Shum. 2003. Stylizing Motion with Drawings. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA ’03). Eurographics Association, 309–319.Google ScholarDigital Library
26. Jingwan Lu, Fisher Yu, Adam Finkelstein, and Stephen DiVerdi. 2012. HelpingHand: example-based stroke stylization. ACM Transactions on Graphics 31, 4 (2012), 46.Google ScholarDigital Library
27. Sebastian Martin, Bernhard Thomaszewski, Eitan Grinspun, and Markus Gross. 2011. Example-based Elastic Materials. ACM Transactions on Graphics 30, 4 (2011), 72:1–72:8.Google ScholarDigital Library
28. Matthias Müller, Bruno Heidelberger, Matthias Teschner, and Markus Gross. 2005. Meshless Deformations Based on Shape Matching. ACM Transactions on Graphics 24, 3 (2005), 471–478. Google ScholarDigital Library
29. Tom Ngo, Doug Cutrell, Jenny Dana, Bruce Donald, Lorie Loeb, and Shunhui Zhu. 2000. Accessible Animation and Customizable Graphics via Simplicial Configuration Modeling. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’00). ACM, 403–410. Google ScholarDigital Library
30. Paul Noble and Wen Tang. 2006. Automatic Expressive Deformations for Stylizing Motion. In Proceedings of the 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia (GRAPHITE ’06). ACM, 57–63. Google ScholarDigital Library
31. Daniel Sýkora, John Dingliana, and Steven Collins. 2009. As-Rigid-As-Possible Image Registration for Hand-Drawn Cartoon Animations. In Proceedings of International Symposium on Non-photorealistic Animation and Rendering. 25–33. Google ScholarDigital Library
32. Frank Thomas and Ollie Johnston. 1981. The illusion of life : Disney animation. Disney Editions, New York.Google Scholar
33. Jue Wang, Steven M. Drucker, Maneesh Agrawala, and Michael F. Cohen. 2006. The Cartoon Animation Filter. ACM Transactions on Graphics 25, 3 (2006), 1169–1173. Google ScholarDigital Library
34. Richard Williams. 2001. The animator’s survival kit. Faber and Faber, London, New York.Google Scholar
35. Andrew Witkin and Michael Kass. 1988. Spacetime Constraints. In Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’88). ACM, 159–168. Google ScholarDigital Library
36. Jun Xing, Rubaiat Habib Kazi, Tovi Grossman, Li-Yi Wei, Jos Stam, and George Fitzmaurice. 2016. Energy-Brushes: Interactive Tools for Illustrating Stylized Elemental Dynamics. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16). ACM, 755–766. Google ScholarDigital Library
37. Jun Xing, Li-Yi Wei, Takaaki Shiratori, and Koji Yatani. 2015. Autocomplete Hand-drawn Animations. ACM Transactions on Graphics 34, 6 (2015), 169:1–169:11.Google ScholarDigital Library
