“Lightning Artist Toolkit: A Hand-Drawn Volumetric Animation Pipeline”
Conference:
Type(s):
Title:
- Lightning Artist Toolkit: A Hand-Drawn Volumetric Animation Pipeline
Session/Category Title: Face & Interface
Presenter(s)/Author(s):
Abstract:
We propose a set of methods for freely integrating live-action volumetric video with hand-drawn volumetric animation, which our research develops as the Lightning Artist Toolkit (Latk)—a complete pipeline for hand-drawn volumetric animation, as far as we know the only open-source example of its kind. Our goal with this project is to make creation in 3D as expressive and intuitive as creation in 2D, retaining the human gesture from its origins in hand-drawn animation on paper. This effort is less a computer vision challenge with an objective goal, as with for example point cloud segmentation, than it is an attempt to approximate human vision—a drawing process that records only information from a scene that was subjectively important to an individual artist. In addition to supporting animation efforts in the near term, we believe the public TiltSet dataset assembled for this project will remain usable in new and unexpected ways.
References:
[1]
Emilie Yu. 2020. Interactive 3D Sketching in Virtual Reality. MSc Thesis, Department of Applied Mathematics and Computer Science, Technical University of Denmark.
Google Scholar
[2]
Steven Schkolne. 2004. 3D Interfaces for Spatial Construction. PhD Thesis, California Institute of Technology, Pasadena, California, USA.
Google Scholar
[3]
Baird Jarman. 2021. Quick as a Flash: Victor Collodion and the Development of the Lightning Artist. Nineteenth-Century Art Worldwide 19(2) (Autumn 2020), https://doi.org/10.29411/ncaw.2020.19.2.3.
Crossref
Google Scholar
[4]
Richard Shoup. 2001. SuperPaint: An Early Frame Buffer Graphics System. IEEE Annals of the History of Computing. 23(2) (April-June 2001). 32–37. https://doi.org/10.1109/85.929909
Digital Library
Google Scholar
[5]
Nestor Burtnyk and Marceli Wein. 1976. Interactive Skeleton Techniques for Enhancing Motion Dynamics in Key Frame Animation. Communications of the ACM, 19(10) (October 1976), 564–569. https://dl.acm.org/doi/10.1145/360349.360357
Crossref
Google Scholar
[6]
Marc Levoy. 1977. A Color Animation System Based on the Multiplane Technique. In Proceedings of the 4th annual conference on computer graphics and interactive techniques (SIGGRAPH ’77). 65–71.
Google Scholar
[7]
Gene Youngblood. 1970. Expanded Cinema. P. Dutton & Co., Inc. New York, USA.
Google Scholar
[8]
David Ha and Douglas Eck. 2017. A Neural Representation of Sketch Drawings. arXiv:1704.03477v4 [cs.NE] 19 May 2017.
Google Scholar
[9]
Mayra Barrera-Machuca, Wolfgang Stuerzlinger, and Paul Asente. 2019. The Effect of Spatial Ability on Immersive 3D Drawing. In Proceedings of the 2019 Conference on Creativity and Cognition (C&C ’19). 173–186. https://dl.acm.org/doi/10.1145/3325480.3325489
Digital Library
Google Scholar
[10]
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei Efros. 2016. Image-to-Image Translation with Conditional Adversarial Networks. arXiv:1611.07004v3 [cs.CV] 26 Nov 2018.
Google Scholar
[11]
Difan Liu, Mohamed Nabail, Aaron Hertzmann, and Evangelos Kalogerakis. 2020. Neural Contours: Learning to Draw Lines from 3D Shapes. difarXiv:2003.10333v2 [cs.CV] 26 Mar 2020.
Google Scholar
[12]
Marco Domenico Cirillo, David Abramian, and Anders Eklund. 2020. Vox2Vox 3D-GAN for Brain Tumour Segmentation. arXiv:2003.13653v3 [cs.CV] 26 Nov 2020
Google Scholar
[13]
Sergio Orts-Escolano, Jose Garcia-Rodriguez, Vicente Morell, Miguel Cazorla, and Juan Manuel Garcia-Chamizo. 2014. 3D Colour Object Reconstruction Based on Growing Neural Gas. In Proceedings of the 2014 International Joint Conference on Neural Networks (IJCNN), Beijing, China. 1474–1481. https://doi.org/10.1109/IJCNN.2014.6889546
Crossref
Google Scholar
[14]
Dena Bazazian, Josep Casas, and Javier Ruiz-Hidalgo. 2015. Fast and Robust Edge Extraction in Unorganized Point Clouds. 2015. In Proceedings of the 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA 2015), Adelaide, Australia, 23-25 November 2015. https://doi.org/10.1109/DICTA.2015.7371262.
Crossref
Google Scholar
[15]
Bastien Wailly and Adrien Bousseau. 2019. Line Rendering of 3D Meshes for Data-Driven Sketch-Based Modeling. In Proceedings of Journ?es Fran?aises d’Informatique Graphique et de R?alit? Virtuelle (jFIG 2019), Marseille, France, 12-15 November 2019.
Google Scholar
[16]
Caroline Chan, Fr?do Durand, and Philip Isola. 2022. Learning to Generate Line Drawings That Convey Geometry and Semantics. https://doi.org/10.48550/arXiv.2203.12691
Crossref
Google Scholar
[17]
Tongjie Zhang and Ching Yee Suen. 1984. A Fast Parallel Algorithm for Thinning Digital Patterns. Communications of the ACM, 27(3) (SIGGRAPH ’84). 236–39. https://doi.org/10.1145/357994.358023
Digital Library
Google Scholar
[18]
Aaron Hertzmann. 2020. Why Do Line Drawings Work? A Realism Hypothesis. Perception 49(4) (2020), 439–451.
Crossref
Google Scholar
