“Generative AI for 2D Character Animation” by Guajardo, Bursalioglu and Goldman
Conference:
Type(s):
Title:
- Generative AI for 2D Character Animation
Session/Category Title: Animation & Simulation
Presenter(s)/Author(s):
Abstract:
In this pilot project, we teamed up with artists to develop new workflows for 2D animation while producing a short educational cartoon. We identified several workflows to streamline the animation process, bringing the artists? vision to the screen more effectively.
References:
[1]
Adobe 2024a. Adobe After Effects. Adobe. Retrieved April 10, 2024 from https://www.adobe.com/products/aftereffects.html
[2]
Adobe 2024b. Adobe Character Animator. Adobe. Retrieved April 10, 2024 from https://www.adobe.com/products/character-animator.html
[3]
Blackmagic Design 2024. DaVinci Resolve 18. Blackmagic Design. Retrieved April 10, 2024 from https://www.blackmagicdesign.com/products/davinciresolve
[4]
Foundry 2024. Nuke | VFX and Film Editing Software. Foundry. Retrieved April 23, 2024 from https://www.foundry.com/products/nuke-family/nuke
[5]
Adobe 2024. Official Adobe Photoshop. Adobe. Retrieved April 19, 2024 from https://www.adobe.com/products/photoshop.html
[6]
comfyanonymous. 2024. ComfyUI: The most powerful and modular stable diffusion GUI and backend. GitHub. Retrieved April 11, 2024 from https://github.com/comfyanonymous/ComfyUI
[7]
Yuwei Guo, Ceyuan Yang, Anyi Rao, Zhengyang Liang, Yaohui Wang, Yu Qiao, Maneesh Agrawala, Dahua Lin, and Bo Dai. 2024. AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning. International Conference on Learning Representations (2024).
[8]
Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021. LoRA: Low-Rank Adaptation of Large Language Models. arxiv:2106.09685 [cs.CL]
[9]
Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, 2023. Segment anything. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 4015?4026.
[10]
Carey Maas, Saatchi Wheeler, Shamash Billington, 2024. To infinity and beyond: Show-1 and Showrunner agents in multi-agent simulations. FableStudio. Retrieved April 19, 2024 from https://fablestudio.github.io/showrunner-agents/
[11]
Chenlin Meng, Yutong He, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, and Stefano Ermon. 2022. SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations. In International Conference on Learning Representations.
[12]
Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas M?ller, Joe Penna, and Robin Rombach. 2023. SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis. arxiv:2307.01952 [cs.CV]
[13]
Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. 2023. Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 22500?22510.
[14]
Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. 2023. Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 3836?3847.
