“Style and abstraction in portrait sketching” by Berger, Shamir, Mahler, Carter and Hodgins
Conference:
Type:
Title:
- Style and abstraction in portrait sketching
Session/Category Title: Line Drawing
Presenter(s)/Author(s):
Moderator(s):
Abstract:
We use a data-driven approach to study both style and abstraction in sketching of a human face. We gather and analyze data from a number of artists as they sketch a human face from a reference photograph. To achieve different levels of abstraction in the sketches, decreasing time limits were imposed — from four and a half minutes to fifteen seconds. We analyzed the data at two levels: strokes and geometric shape. In each, we create a model that captures both the style of the different artists and the process of abstraction. These models are then used for a portrait sketch synthesis application. Starting from a novel face photograph, we can synthesize a sketch in the various artistic styles and in different levels of abstraction.
References:
1. Belongie, S., Malik, J., and Puzicha, J. 2002. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 4, 509–522. Google ScholarDigital Library
2. Chang, I.-C., and Cheng, R.-M. 2011. Caricaturation for human face pictures. In International Conference on Machine Learning and Cybernetics, 1702–1707.Google Scholar
3. Chen, H., Zheng, N., Liang, L., Li, Y., Xu, Y., and Shum, H. 2002. Pictoon: a personalized image-based cartoon system. In Proceedings of the Tenth ACM International Conference on Multimedia, 171–178. Google ScholarDigital Library
4. Chen, H., Liu, Z., Rose, C., Xu, Y., Shum, H., and Salesin, D. 2004. Example-based composite sketching of human portraits. In Proceedings of the 3rd International Symposium on Non-photorealistic Animation and Rendering, NPAR ’04, ACM, 95–153. Google ScholarDigital Library
5. Chiang, P., Liao, W., and Li, T. 2004. Automatic caricature generation by analyzing facial features. In Proceedings of the 2004 Asia Conference on Computer Vision.Google Scholar
6. Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H. S., Finkelstein, A., Funkhouser, T., and Rusinkiewicz, S. 2008. Where do people draw lines? ACM Transactions on Graphics (Proc. SIGGRAPH) 27, 3 (Aug.). Google ScholarDigital Library
7. Colton, S. 2010. Stroke matching for paint dances. In Proceedings of the Sixth international conference on Computational Aesthetics in Graphics, Visualization and Imaging, Computational Aesthetics’10, 67–74. Google ScholarDigital Library
8. DeCarlo, D., and Santella, A. 2002. Stylization and abstraction of photographs. ACM Transactions on Graphics 21, 3, 769–776. Google ScholarDigital Library
9. Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics 21, 3, 257–266. Google ScholarDigital Library
10. Eitz, M., Hays, J., and Alexa, M. 2012. How do humans sketch objects? ACM Transactions on Graphics 31, 4, 44. Google ScholarDigital Library
11. Freeman, W. T., Tenenbaum, J. B., and Pasztor, E. C. 2003. Learning style translation for the lines of a drawing. ACM Transactions on Graphics 22, 1, 33–46. Google ScholarDigital Library
12. Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: Creation and psychophysical evaluation. ACM Transactions on Graphics 23, 1, 27–44. Google ScholarDigital Library
13. Hertzmann, A., Oliver, N., Curless, B., and Seitz, S. M. 2002. Curve analogies. In Proceedings of the 13th Eurographics Workshop on Rendering, 233–246. Google ScholarDigital Library
14. Kalogerakis, E., Nowrouzezahrai, D., Breslav, S., and Hertzmann, A. 2012. Learning Hatching for Pen-and-Ink Illustration of Surfaces. ACM Transactions on Graphics 31, 1. Google ScholarDigital Library
15. Kang, H., and Lee, S. 2008. Shape-simplifying image abstraction. Computer Graphics Forum 27, 7, 1773–1780.Google ScholarCross Ref
16. Kang, H., Lee, S., and Chui, C. 2007. Coherent line drawing. In Proceedings of the 5th International Symposium on Non-photorealistic Animation and Rendering, ACM, 43–50. Google ScholarDigital Library
17. Kyprianidis, J., and Kang, H. 2011. Image and video abstraction by coherence-enhancing filtering. Computer Graphics Forum 30, 2, 593–602.Google ScholarCross Ref
18. Kyprianidis, J. E., Collomosse, J., Wang, T., and Isenberg, T. 2013. State of the art: A taxonomy of artistic stylization techniques for images and video. IEEE Transactions on Visualization and Computer Graphics 19, 5, 866–885. Google ScholarDigital Library
19. Le, N. K. H., Why, Y. P., and Ashraf, G. 2011. Shape stylized face caricatures. In Proceedings of the 17th International Conference on Advances in Multimedia Modeling – Volume Part I, MMM’11, 536–547. Google ScholarDigital Library
20. Liang, L., Chen, H., Xu, Y.-Q., and Shum, H.-Y. 2002. Example-based caricature generation with exaggeration. In Proceedings of the 10th IEEE Pacific Conference on Computer Graphics and Applications, PG ’02, 386–393. Google ScholarDigital Library
21. Limpaecher, A., Feltman, N., Treuille, A., and Cohen, M. 2013. Real-time drawing assistance through crowdsourcing. ACM Transactions on Graphics 32, 4 (Aug.). Google ScholarDigital Library
22. Liu, Y., Su, Y., Shao, Y., and Jia, D. 2010. A parameterized representation for the cartoon sample space. In Proceedings of the 16th International Conference on Advances in Multimedia Modeling, 767–772. Google ScholarDigital Library
23. Lu, C., Xu, L., and Jia, J. 2012. Combining sketch and tone for pencil drawing production. In Proceedings of the 10th International Symposium on Non-Photorealistic Animation and Rendering, NPAR ’12, 65–73. Google ScholarDigital Library
24. Lu, J., Yu, F., Finkelstein, A., and DiVerdi, S. 2012. HelpingHand: Example-based stroke stylization. ACM Transactions on Graphics 31, 4 (Aug.), 46:1–46:10. Google ScholarDigital Library
25. Mehra, R., Zhou, Q., Long, J., Sheffer, A., Gooch, A., and Mitra, N. 2009. Abstraction of man-made shapes. ACM Transactions on Graphics 28, 5, 137. Google ScholarDigital Library
26. Meng, M., Zhao, M., and Zhu, S. 2010. Artistic paper-cut of human portraits. In Proceedings of the ACM International Conference on Multimedia, 931–934. Google ScholarDigital Library
27. Minear, M., and Park, D. 2004. A lifespan database of adult facial stimuli. Behavior Research Methods, Instruments, & Computers 36, 630–633.Google ScholarCross Ref
28. Nan, L., Sharf, A., Xie, K., Wong, T., Deussen, O., Cohen-Or, D., and Chen, B. 2011. Conjoining gestalt rules for abstraction of architectural drawings. ACM Transactions on Graphics 30, 6, 185. Google ScholarDigital Library
29. Noris, G., Hornung, A., Sumner, R. W., Simmons, M., and Gross, M. 2013. Topology-driven vectorization of clean line drawings. ACM Transaction on Graphics 32, 1, 4:1–4:11. Google ScholarDigital Library
30. Sinha, P., Balas, B., Ostrovsky, Y., and Russell, R. 2006. Face recognition by humans: Nineteen results all computer vision researchers should know about. Proceedings of the IEEE 94, 11, 1948–1962.Google ScholarCross Ref
31. Stegmann, M., and Gomez, D. 2002. A brief introduction to statistical shape analysis. Informatics and Mathematical Modelling, Technical University of Denmark, DTU, 15.Google Scholar
32. Tresset, P. A., and Leymarie, F. F. 2013. Portrait drawing by Paul the robot. Computers and Graphics 37, in press. Google ScholarDigital Library
33. Truong, V. 2011. Face alignment using active shape model and support vector machine. International Journal of Biometrics and Bioinformatics 4, 6, 224.Google Scholar
34. Wang, X., and Tang, X. 2009. Face photo-sketch synthesis and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 11, 1955–1967. Google ScholarDigital Library
35. Wang, S., Zhang, L., Liang, Y., and Pan, Q. 2012. Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis. In IEEE Conference on Computer Vision and Pattern Recognition, 2216–2223. Google ScholarDigital Library
36. Yu, H., and Zhang, J. 2010. Caricature synthesis based on mean value coordinates. In CASA 2010: Proceedings of the 23rd International Conference on Computer Animation and Social Agents.Google Scholar
37. Yumer, M., and Kara, L. 2012. Co-abstraction of shape collections. ACM Transactions on Graphics 31, 6, 166. Google ScholarDigital Library
38. Zhang, Y., McCullough, C., Sullins, J., and Ross, C. 2010. Hand-drawn face sketch recognition by humans and a pca-based algorithm for forensic applications. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 40, 3, 475–485. Google ScholarDigital Library
39. Zhao, M., and Zhu, S. 2011. Portrait painting using active templates. In Proceedings of the 11th International Symposium on Non-Photorealistic Animation and Rendering, NPAR ’11, 117–124. Google ScholarDigital Library
