“Autocomplete hand-drawn animations” by Xing, Wei, Shiratori and Yatani – ACM SIGGRAPH HISTORY ARCHIVES

“Autocomplete hand-drawn animations” by Xing, Wei, Shiratori and Yatani

  • 2015 SA Technical Papers_Xing_Autocomplete Hand-drawn Animations

Conference:


Type(s):


Title:

    Autocomplete hand-drawn animations

Session/Category Title:   Color and Sketching

Presenter(s)/Author(s):


Abstract:


    Hand-drawn animation is a major art form and communication medium, but can be challenging to produce. We present a system to help people create frame-by-frame animations through manual sketches. We design our interface to be minimalistic: it contains only a canvas and a few controls. When users draw on the canvas, our system silently analyzes all past sketches and predicts what might be drawn in the future across spatial locations and temporal frames. The interface also offers suggestions to beautify existing drawings. Our system can reduce manual workload and improve output quality without compromising natural drawing flow and control: users can accept, ignore, or modify such predictions visualized on the canvas by simple gestures. Our key idea is to extend the local similarity method in [Xing et al. 2014], which handles only low-level spatial repetitions such as hatches within a single frame, to a global similarity that can capture high-level structures across multiple frames such as dynamic objects. We evaluate our system through a preliminary user study and confirm that it can enhance both users’ objective performance and subjective satisfaction.

References:


    1. Baxter, W. V., and Anjyo, K. 2006. Latent doodle space. Comput. Graph. Forum 25, 3, 477–485.
    2. Belongie, S., Malik, J., and Puzicha, J. 2002. Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24, 4 (Apr.), 509–522.
    3. Bénard, P., Cole, F., Kass, M., Mordatch, I., Hegarty, J., Senn, M. S., Fleischer, K., Pesare, D., and Breeden, K. 2013. Stylizing animation by example. ACM Trans. Graph. 32, 4 (July), 119:1–119:12.
    4. Chen, H.-T., Grossman, T., Wei, L.-Y., Schmidt, R. M., Hartmann, B., Fitzmaurice, G., and Agrawala, M. 2014. History assisted view authoring for 3d models. In CHI ’14, 2027–2036.
    5. Chu, N. S.-H., and Tai, C.-L. 2005. Moxi: Real-time ink dispersion in absorbent paper. ACM Trans. Graph. 24, 3 (July), 504–511.
    6. Davis, J., Agrawala, M., Chuang, E., Popović, Z., and Salesin, D. 2003. A sketching interface for articulated figure animation. In SCA ’03, 320–328.
    7. Grabler, F., Agrawala, M., Li, W., Dontcheva, M., and Igarashi, T. 2009. Generating photo manipulation tutorials by demonstration. ACM Trans. Graph. 28, 3 (July), 66:1–66:9.
    8. Graves, A. 2013. Generating sequences with recurrent neural networks. CoRR abs/1308.0850.
    9. Guay, M., Ronfard, R., Gleicher, M., and Cani, M.-P. 2015. Space-time sketching of character animation. ACM Trans. Graph. 34, 4 (July), 118:1–118:10.
    10. Huang, Q.-X., Adams, B., Wicke, M., and Guibas, L. J. 2008. Non-rigid registration under isometric deformations. In SGP ’08, 1449–1457.
    11. Iarussi, E., Bousseau, A., and Tsandilas, T. 2013. The drawing assistant: Automated drawing guidance and feedback from photographs. In UIST ’13, 183–192.
    12. Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. ACM Trans. Graph. 24, 3 (July), 1134–1141.
    13. Jones, B., Popovic, J., McCann, J., Li, W., and Bargteil, A. W. 2015. Dynamic sprites: artistic authoring of interactive animations. Journal of Visualization and Computer Animation 26, 2, 97–108.
    14. Kazi, R. H., Chevalier, F., Grossman, T., and Fitzmaurice, G. 2014. Kitty: Sketching dynamic and interactive illustrations. In UIST ’14, 395–405.
    15. Kazi, R. H., Chevalier, F., Grossman, T., Zhao, S., and Fitzmaurice, G. 2014. Draco: Bringing life to illustrations with kinetic textures. In CHI ’14, 351–360.
    16. Kim, V. G., Li, W., Mitra, N. J., DiVerdi, S., and Funkhouser, T. 2012. Exploring collections of 3d models using fuzzy correspondences. ACM Trans. Graph. 31, 4 (July), 54:1–54:11.
    17. Lee, Y. J., Zitnick, C. L., and Cohen, M. F. 2011. ShadowDraw: Real-time user guidance for freehand drawing. ACM Trans. Graph. 30, 4 (July), 27:1–27:10.
    18. Li, H., Sumner, R. W., and Pauly, M. 2008. Global correspondence optimization for non-rigid registration of depth scans. In SGP ’08, 1421–1430.
    19. Limpaecher, A., Feltman, N., Treuille, A., and Cohen, M. 2013. Real-time drawing assistance through crowdsourcing. ACM Trans. Graph. 32, 4 (July), 54:1–54:8.
    20. Lindemeier, T., Metzner, J., Pollak, L., and Deussen, O. 2015. Hardware-based non-photorealistic rendering using a painting robot. Computer Graphics Forum 34, 2, 311–323.
    21. Lu, J., Barnes, C., DiVerdi, S., and Finkelstein, A. 2013. Realbrush: Painting with examples of physical media. ACM Trans. Graph. 32, 4 (July), 117:1–117:12.
    22. Lukáč, M., Fišer, J., Bazin, J.-C., Jamriška, O., Sorkine-Hornung, A., and Sýkora, D. 2013. Painting by feature: Texture boundaries for example-based image creation. ACM Trans. Graph. 32, 4 (July), 116:1–116:8.
    23. Ma, C., Wei, L.-Y., and Tong, X. 2011. Discrete element textures. ACM Trans. Graph. 30, 4 (July), 62:1–62:10.
    24. Milliez, A., Noris, G., Baran, I., Coros, S., Cani, M.-P., Nitti, M., Marra, A., Gross, M., and Sumner, R. W. 2014. Hierarchical motion brushes for animation instancing. In NPAR ’14, 71–79.
    25. Myers, B. A., Lai, A., Le, T. M., Yoon, Y., Faulring, A., and Brandt, J. 2015. Selective undo support for painting applications. In CHI ’15, 4227–4236.
    26. Nancel, M., and Cockburn, A. 2014. Causality: A conceptual model of interaction history. In CHI ’14, 1777–1786.
    27. Noris, G., Sýkora, D., Coros, S., Whited, B., Simmons, M., Hornung, A., Gross, M., and Sumner, R. W. 2011. Temporal noise control for sketchy animation. In NPAR ’11, 93–98.
    28. Sumner, R. W., Schmid, J., and Pauly, M. 2007. Embedded deformation for shape manipulation. ACM Trans. Graph. 26, 3 (July).
    29. Sýkora, D., Dingliana, J., and Collins, S. 2009. As-rigid-as-possible image registration for hand-drawn cartoon animations. In NPAR ’09, 25–33.
    30. Thorne, M., Burke, D., and van de Panne, M. 2004. Motion doodles: An interface for sketching character motion. ACM Trans. Graph. 23, 3 (Aug.), 424–431.
    31. Weber, O., Ben-Chen, M., and Gotsman, C. 2009. Complex barycentric coordinates with applications to planar shape deformation. Computer Graphics Forum (Proceedings of Eurographics) 28, 2.
    32. Whited, B., Noris, G., Simmons, M., Sumner, R., Gross, M., and Rossignac, J. 2010. BetweenIT: An interactive tool for tight inbetweening. Comput. Graphics Forum (Proc. Eurographics) 29, 2, 605–614.
    33. Xing, J., Chen, H.-T., and Wei, L.-Y. 2014. Autocomplete painting repetitions. ACM Trans. Graph. 33, 6 (Nov.), 172:1–172:11.
    34. Zitnick, C. L. 2013. Handwriting beautification using token means. ACM Trans. Graph. 32, 4 (July), 53:1–53:8.

ACM Digital Library Publication:


Overview Page:


Submit a story:

If you would like to submit a story about this presentation, please contact us: historyarchives@siggraph.org