“Autocomplete painting repetitions” by Xing, Chen and Wei
Conference:
Type(s):
Title:
- Autocomplete painting repetitions
Session/Category Title: Paintings, Sketches and Buildings
Presenter(s)/Author(s):
Abstract:
Painting is a major form of content creation, offering unlimited control and freedom of expression. However, it can involve tedious manual repetitions, such as stippling large regions or hatching complex contours. Thus, a central goal in digital painting research is to automate tedious repetitions while allowing user control. Existing methods impose a sequential order, in which a small exemplar is prepared and then cloned through additional gestures. Such sequential mode may break the continuous, spontaneous flow of painting. Moreover, it is more suitable for homogeneous areas than nuanced variations common in real paintings.We present an interactive digital painting system that auto-completes tedious repetitions while preserving nuanced variations and maintaining natural flows. Specifically, users paint as usual, while our system records and analyzes their workflows. When potential repetition is detected, our system predicts what the user might want to draw and offers auto-completes that adjust to the existing shape-color context. Our method eliminates the need for sequential creation-cloning and better adapts to the local painting contexts. Furthermore, users can choose to accept, ignore, or modify those predictions and thus maintain full control. Our method can be considered as the painting analogy of auto-completes in common typing and IDE systems. We demonstrate the quality and usability of our system through painting results and a pilot user study.
References:
1. Bonanni, L., Xiao, X., Hockenberry, M., Subramani, P., Ishii, H., Seracini, M., and Schulze, J. 2009. Wetpaint: scraping through multi-layered images. In CHI ’09, 571–574.
2. Callahan, S. P., Freire, J., Santos, E., Scheidegger, C. E., Silva, C. T., and Vo, H. T. 2006. Vistrails: visualization meets data management. In SIGMOD ’06, 745–747.
3. Cheema, S., Buchanan, S., Gulwani, S., and LaViola, Jr., J. J. 2014. A practical framework for constructing structured drawings. In IUI ’14, 311–316.
4. Chen, H.-T., Wei, L.-Y., and Chang, C.-F. 2011. Nonlinear revision control for images. In SIGGRAPH ’11, 105:1–10.
5. Chen, H.-T., Grossman, T., Wei, L.-Y., Schmidt, R. M., Hartmann, B., Fitzmaurice, G., and Agrawala, M. 2014. History assisted view authoring for 3d models. In CHI ’14, 2027–2036.
6. Cypher, A. 1991. Eager: Programming repetitive tasks by example. In CHI ’91, 33–39.
7. Denning, J. D., and Pellacini, F. 2013. Meshgit: diffing and merging meshes for polygonal modeling. In SIGGRAPH ’13, vol. 32, 35:1–35:10.
8. Denning, J. D., Kerr, W. B., and Pellacini, F. 2011. Mesh-flow: Interactive visualization of mesh construction sequences. In SIGGRAPH ’11, 66:1–66:8.
9. Dixon, D., Prasad, M., and Hammond, T. 2010. icandraw: Using sketch recognition and corrective feedback to assist a user in drawing human faces. In CHI ’10, 897–906.
10. Doboš, J., Mitra, N. J., and Steed, A. 2014. 3d timeline: Reverse engineering of a part-based provenance from consecutive 3d models. Computer Graphics Forum 33, 2, 135–144.
11. Fernquist, J., Grossman, T., and Fitzmaurice, G. 2011. Sketch-sketch revolution: An engaging tutorial system for guided sketching and application learning. In UIST ’11, 373–382.
12. Fu, H., Zhou, S., Liu, L., and Mitra, N. J. 2011. Animated construction of line drawings. In SIGGRAPH Asia ’11, 133:1–133:10.
13. Gleicher, M., and Witkin, A. 1994. Drawing with constraints. Vis. Comput. 11, 1 (Jan.), 39–51.
14. Grossman, T., Matejka, J., and Fitzmaurice, G. 2010. Chronicle: capture, exploration, and playback of document workflow histories. In UIST ’10, 143–152.
15. Guerrero, P., Jeschke, S., Wimmer, M., and Wonka, P. 2014. Edit propagation using geometric relationship functions. ACM Trans. Graph. 33, 2 (Apr.), 15:1–15:15.
16. Guy, E., Thiery, J.-M., and Boubekeur, T. 2014. Simselect: Similarity-based selection for 3d surfaces. Computer Graphics Forum 33, 2, 165–173.
17. Hu, S.-M., Xu, K., Ma, L.-Q., Liu, B., Jiang, B.-Y., and Wang, J. 2013. Inverse image editing: Recovering a semantic editing history from a before-and-after image pair. In SIGGRAPH Asia ’13, 194:1–194:11.
18. Huang, Q., Guibas, L. J., and Mitra, N. J. 2014. Near-regular structure discovery using linear programming. ACM Trans. Graph. 33, 3 (June), 23:1–23:17.
19. Iarussi, E., Bousseau, A., and Tsandilas, T. 2013. The drawing assistant: Automated drawing guidance and feedback from photographs. In UIST ’13, 183–192.
20. Kazi, R. H., Igarashi, T., Zhao, S., and Davis, R. 2012. Vignette: interactive texture design and manipulation with freeform gestures for pen-and-ink illustration. In CHI ’12, 1727–1736.
21. Kazi, R. H., Chevalier, F., Grossman, T., Zhao, S., and Fitzmaurice, G. 2014. Draco: Bringing life to illustrations with kinetic textures. In CHI ’14, 351–360.
22. Kong, N., Grossman, T., Hartmann, B., Agrawala, M., and Fitzmaurice, G. 2012. Delta: a tool for representing and comparing workflows. In CHI ’12, 1027–1036.
23. Kuhn, H. 1955. The hungarian method for the assignment problem. Naval research logistics quarterly 2, 1-2, 83–97.
24. Kurlander, D. 1993. Chimera: example-based graphical editing. In Watch what I do: programming by demonstration, 271–290.
25. Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. In SIGGRAPH ’05, 795–802.
26. Lafreniere, B., Grossman, T., and Fitzmaurice, G. 2013. Community enhanced tutorials: improving tutorials with multiple demonstrations. In CHI ’13, 1779–1788.
27. Landes, P.-E., Galerne, B., and Hurtut, T. 2013. A shape-aware model for discrete texture synthesis. Computer Graphics Forum 32, 4, 67–76.
28. Lee, Y. J., Zitnick, L., and Cohen, M. F. 2011. Shadowdraw: Real-time user guidance for freehand drawing. In SIGGRAPH ’11, 27:1–27:10.
29. Limpaecher, A., Feltman, N., Treuille, A., and Cohen, M. 2013. Real-time drawing assistance through crowdsourcing. In SIGGRAPH ’13, vol. 32, 54:1–54:8.
30. Lu, J., Georghiades, A. S., Glaser, A., Wu, H., Wei, L.-Y., Guo, B., Dorsey, J., and Rushmeier, H. 2007. Context-aware textures. ACM Trans. Graph. 26, 1 (Jan.).
31. Lu, J., Barnes, C., Diverdi, S., and Finkelstein, A. 2013. Realbrush: painting with examples of physical media. In SIGGRAPH ’13, vol. 32, 117:1–117:12.
32. Lu, J., Barnes, C., Wan, C., Asente, P., Mech, R., and Finkelstein, A. 2014. Decobrush: Drawing structured decorative patterns by example. In SIGGRAPH ’14.
33. Lukáč, M., Fišer, J., Bazin, J.-C., Jamriška, O., Sorkine-Hornung, A., and Sýkora, D. 2013. Painting by feature: texture boundaries for example-based image creation. In SIGGRAPH ’13, 116:1–116:8.
34. Ma, C., Wei, L.-Y., and Tong, X. 2011. Discrete element textures. In SIGGRAPH ’11, 62:1–10.
35. Ma, C., Wei, L.-Y., Lefebvre, S., and Tong, X. 2013. Dynamic element textures. In SIGGRAPH ’13, vol. 32, 90:1–90:10.
36. Maulsby, D. L., Witten, I. H., and Kittlitz, K. A. 1989. Metamouse: Specifying graphical procedures by example. In SIGGRAPH ’89, 127–136.
37. Nancel, M., and Cockburn, A. 2014. Causality: A conceptual model of interaction history. In CHI ’14, 1777–1786.
38. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. In SIGGRAPH ’02, 665–672.
39. Wei, L.-Y., Han, J., Zhou, K., Bao, H., Guo, B., and Shum, H.-Y. 2008. Inverse texture synthesis. In SIGGRAPH ’08, 52:1–9.
40. Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics ’09 STAR, 93–117.
41. Winkenbach, G., and Salesin, D. H. 1994. Computer-generated pen-and-ink illustration. In SIGGRAPH ’94, 91–100.
42. Zitnick, C. L. 2013. Handwriting beautification using token means. In SIGGRAPH ’13, 53:1–53:8.
