“Video puppetry: a performative interface for cutout animation”
Conference:
Type(s):
Title:
- Video puppetry: a performative interface for cutout animation
Session/Category Title: Character animation II
Presenter(s)/Author(s):
Abstract:
We present a video-based interface that allows users of all skill levels to quickly create cutout-style animations by performing the character motions. The puppeteer first creates a cast of physical puppets using paper, markers and scissors. He then physically moves these puppets to tell a story. Using an inexpensive overhead camera our system tracks the motions of the puppets and renders them on a new background while removing the puppeteer’s hands. Our system runs in real-time (at 30 fps) so that the puppeteer and the audience can immediately see the animation that is created. Our system also supports a variety of constraints and effects including articulated characters, multi-track animation, scene changes, camera controls, 2 1/2-D environments, shadows, and animation cycles. Users have evaluated our system both quantitatively and qualitatively: In tests of low-level dexterity, our system has similar accuracy to a mouse interface. For simple story telling, users prefer our system over either a mouse interface or traditional puppetry. We demonstrate that even first-time users, including an eleven-year-old, can use our system to quickly turn an original story idea into an animation.
References:
1. Agarwala, A., Hertzmann, A., Salesin, D. H., and Seitz, S. M. 2004. Keyframe-based Tracking for Rotoscoping and Animation. ACM Trans. Graphics (Proc. SIGGRAPH), Vol. 23, No. 3, 584–591. Google ScholarDigital Library
2. Agarwala, A. 2002. SnakeToonz: A Semi-Automatic Approach to Creating Cel Animation from Video. In Proc. NPAR, 139–146. Google Scholar
3. Alvarado, C., and Davis, R. 2001. Resolving Ambiguities to Create a Natural Sketch Based Interface. In Proc. IJCAI, 1365–1371. Google ScholarDigital Library
4. Baecker, R. 1969. Picture-Driven Animation. In Proc. Spring Joint Computer Conference, 273–288.Google Scholar
5. Bousseau, A., Neyret, F., Thollot, J., and Salesin, D. 2007. Video Watercolorization using Bidirectional Texture Advection. ACM Trans. Graphics (Proc. SIGGRAPH), Vol. 26, No. 3, 104: 1–104: 7. Google ScholarDigital Library
6. Collomosse, J., and Hall, P. 2005. Video Paintbox: The Fine Art of Video Painting. Computers & Graphics, Vol. 29, No. 6, 862–870. Google Scholar
7. Collomosse, J., and Hall, P. 2006. Video Motion Analysis for the Synthesis of Dynamic Cues and Futurist Art. Graphical Models, Vol. 68, No. 5–6, 402–414. Google ScholarDigital Library
8. Davis, J., Agrawala, M., Chuang, E., Popović, Z., and Salesin, D. 2003. A Sketching Interface for Articulated Figure Animation. In Proc. SCA, 320–328. Google ScholarDigital Library
9. Davis, R. C., Colwell, B., and Landay, J. A. 2008. K-Sketch: A “Kinetic” Sketch Pad for Novice Animators. In Proc. SIGCHI, 413–422. Google Scholar
10. Dontcheva, M., Yngve, G., and Popović, Z. 2003. Layered acting for character animation. ACM Trans. Graphics (Proc. SIGGRAPH), Vol. 22, No. 3, 409–416. Google ScholarDigital Library
11. Fiala, M. 2005. ARTag, a Fiducial Marker System Using Digital Techniques. Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, Vol. 2, 590–596. Google Scholar
12. Gottschalk, S., Lin, M. C., and Manocha, D. 1996. OBB-Tree: A Hierarchical Structure for Rapid Interference Detection. In Proc. SIGGRAPH, 171–180. Google Scholar
13. Horn, B. K. P. 1986. Closed-Form Solution of Absolute Orientation using Unit Quaternions. Journal of the Optical Society of America, Vol. 4, 629–642.Google ScholarCross Ref
14. Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-Rigid-as-Possible Shape Manipulation. ACM Trans. Graphics (Proc. SIGGRAPH), Vol. 24, No. 3, 1134–1141. Google ScholarDigital Library
15. Ishii, H., and Ullmer, B. 1997. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In Proc. SIGCHI, 234–241. Google Scholar
16. Kim, J., Seitz, S., and Agrawala, M. 2004. Video-based Document Tracking: Unifying Your Physical and Electronic Desktops. In Proc. UIST, 99–107. Google Scholar
17. Knep, B., Hayes, C., Sayre, R., and Williams, T. 1995. Dinosaur Input Device. In Proc. SIGCHI, 304–309. Google Scholar
18. LaViola Jr, J., and Zeleznik, R. 2004. MathPad 2: A System for the Creation and Exploration of Mathematical Sketches. ACM Trans. Graphics (Proc. SIGGRAPH), Vol. 23, No. 3, 432–440. Google ScholarDigital Library
19. Lee, G., Kim, G., and Billinghurst, M. 2005. Immersive authoring: What You eXperience Is What You Get (WYXIWYG). Communications of the ACM, Vol. 48, No. 7, 76–81. Google ScholarDigital Library
20. Lowe, D. G. 1999. Object Recognition from Local Scale-Invariant Features. In International Conference on Computer Vision, 1150–1157. Google Scholar
21. Milgram, P., and Kishino, F. 1994. A Taxonomy of Mixed Reality Visual Displays. IEICE Transactions on Information and Systems, Vol. 77, No. 12, 1321–1329.Google Scholar
22. Moscovich, T., and Hughes, J. 2001. Animation Sketching: An Approach to Accessible Animation. Tech. Rep. CS04-03, Brown University CS Department.Google Scholar
23. Oore, S., Terzopoulos, D., and Hinton, G. 2002. A Desktop Input Device and Interface for Interactive 3D Character Animation. Graphics Interface, Vol. 2, 133–140.Google Scholar
24. Popović, J., Seitz, S., and Erdmann, M. 2003. Motion Sketching for Control of Rigid-Body Simulations. ACM Trans. Graphics, Vol. 22, No. 4, 1034–1054. Google ScholarDigital Library
25. Rekimoto, J., and Ayatsuka, Y. 2000. CyberCode: designing augmented reality environments with visual tags. Proceedings of DARE 2000 on Designing augmented reality environments, 1–10. Google Scholar
26. Rus, D., and deSantis, P. 1997. The Self-Organizing Desk. Tech. Rep. PCS-TR97-305, Dartmouth University CS Department. Google ScholarDigital Library
27. Sturman, D. 1998. Computer Puppetry. IEEE Computer Graphics and Applications, Vol. 18, No. 1, 38–45. Google ScholarDigital Library
28. Thomas, F., and Johnston, O. 1981. Disney Animation: The Illusion of Life. Walt Disney Productions, New York.Google Scholar
29. Thorne, M., Burke, D., and van de Panne, M. 2004. Motion Doodles: An Interface for Sketching Character Motion. ACM Trans. Graphics (Proc. SIGGRAPH), Vol. 23, No. 3, 424–431. Google ScholarDigital Library
30. Tomasi, C., and Kanade, T. 1991. Detection and Tracking of Point Features. Tech. Rep. CMU-CS-91-132, Carnegie Mellon University, Pittsburgh, PA, USA.Google Scholar
31. Trucco, E., and Plakas, K. 2006. Video Tracking: A Concise Survey. IEEE Journal of Oceanic Engineering, Vol. 31, No. 2, 520–529.Google ScholarCross Ref
32. Wang, J., Xu, Y., Shum, H., and Cohen, M. 2004. Video Tooning. ACM Trans. Graphics (Proc. SIGGRAPH), Vol. 23, No. 3, 574–583. Google ScholarDigital Library
33. Wang, J., Bhat, P., Colburn, R., Agrawala, M., and Cohen, M. 2005. Interactive video cutout. ACM Trans. Graphics (Proc. SIGGGRAPH), Vol. 24, No. 3, 585–594. Google ScholarDigital Library
34. Wang, J., Drucker, S., Agrawala, M., and Cohen, M. 2006. The Cartoon Animation Filter. ACM Trans. Graphics (Proc. SIGGRAPH), Vol. 25, No. 3, 1169–1173. Google ScholarDigital Library
35. Wellner, P. 1993. Interacting with Paper on the DigitalDesk. Communications of the ACM, Vol. 36, No. 7 (July), 86–97. Google ScholarDigital Library
36. Wilson, A. 2005. Play Anywhere: a compact interactive tabletop projection-vision system. In Proc. UIST, 83–92. Google Scholar
37. Winnemöller, H., Olsen, S., and Gooch, B. 2006. Realtime Video Abstraction. ACM Trans. Graphics (Proc. SIGGRAPH), Vol. 25, No. 3, 1221–1226. Google ScholarDigital Library
38. Wisniewski, D., and Wisniewski, D. 1996. Worlds of Shadow: Teaching with Shadow Puppetry. Teacher Ideas Press.Google Scholar
