“A similarity measure for illustration style” by Garces, Agarwala, Gutierrez and Hertzmann

  • ©Elena Garces, Aseem Agarwala, Diego Gutierrez, and Aaron Hertzmann

Conference:


Type:


Title:

    A similarity measure for illustration style

Session/Category Title: Typography & Illustration

Presenter(s)/Author(s):


Moderator(s):


Abstract:


    This paper presents a method for measuring the similarity in style between two pieces of vector art, independent of content. Similarity is measured by the differences between four types of features: color, shading, texture, and stroke. Feature weightings are learned from crowdsourced experiments. This perceptual similarity enables style-based search. Using our style-based search feature, we demonstrate an application that allows users to create stylistically-coherent clip art mash-ups.

References:


    1. Aucouturier, J.-J., and Pachet, F. 2002. Music Similarity Measures: What’s the Use? In Proc. SMIR, 157–163.Google Scholar
    2. Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. ACM Trans. Graphics 25, 3, 637–645. Google ScholarDigital Library
    3. Bell, R. M., and Koren, Y. 2007. Lessons from the Netflix Prize Challenge. SIGKDD Explor. Newsl. 9, 2, 75–79. Google ScholarDigital Library
    4. Chen, T., Cheng, M.-M., Tan, P., Shamir, A., and Hu, S.-M. 2009. Sketch2photo: Internet image montage. ACM Trans. Graphics 28, 5, 124:1–124:10. Google ScholarDigital Library
    5. Chen, X., Bennett, P. N., Collins-Thompson, K., and Horvitz, E. 2013. Pairwise Ranking Aggregation in a Crowdsourced Setting. In Proc. WSDM, 193–202. Google ScholarDigital Library
    6. Datta, R., Joshi, D., Li, J., and Wang, J. Z. 2008. Image Retrieval: Ideas, Influences, and Trends of the New Age. ACM Computing Surveys 40, 2, 5:1–5:60. Google ScholarDigital Library
    7. Doersch, C., Singh, S., Gupta, A., Sivic, J., and Efros, A. 2012. What Makes Paris Look like Paris? ACM Trans. Graphics 31, 4, 101:1–101:9. Google ScholarDigital Library
    8. Durand, F. 2002. An Invitation to Discuss Computer Depiction. In Proc. NPAR, 111–124. Google ScholarDigital Library
    9. Epshtein, B., Ofek, E., and Wexler, Y. 2010. Detecting Text in Natural Scenes with Stroke Width Transform. In Proc. CVPR, 2963–2970.Google Scholar
    10. Gooch, B., and Gooch, A. 2001. Non-Photorealistic Rendering. AK Peters Ltd. Google ScholarDigital Library
    11. Haralick, R. M., Shanmugam, K., and Dinstein, I. 1973. Textural Features for Image Classification. IEEE Trans. Systems, Man and Cybernetics 3, 6, 610–621.Google ScholarCross Ref
    12. Hasler, D., and Susstrunk, S. 2003. Measuring Colourfulness in Natural Images. In Proc. SPIE: Human Vision and Electronic Imaging, vol. 5007, 87–95.Google Scholar
    13. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image Analogies. In Proc. SIGGRAPH, 327–340. Google ScholarDigital Library
    14. Hurtut, T., Gousseau, Y., Cheriet, F., and Schmitt, F. 2011. Artistic line-drawings retrieval based on the pictorial content. ACM J. Computing and Cultural Heritage 4, 1, 1–23. Google ScholarDigital Library
    15. Kalogerakis, E., Nowrouzezahrai, D., Breslav, S., and Hertzmann, A. 2012. Learning Hatching for Pen-and-Ink Illustration of Surfaces. ACM Trans. Graphics 31, 1:1–1:17. Google ScholarDigital Library
    16. Kulis, B. 2013. Metric learning: A survey. Foundations and Trends in Machine Learning 5, 4, 287–364.Google ScholarCross Ref
    17. Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., and Criminisi, A. 2007. Photo clip art. ACM Trans. Graphics 26, 3, 3:1–3:10. Google ScholarDigital Library
    18. Lessig, L. 2008. Remix: Making Art and Commerce Thrive in the Hybrid Economy. Penguin Press.Google ScholarCross Ref
    19. Li, C., Member, S., and Chen, T. 2009. Aesthetic Visual Quality Assessment of Paintings. IEEE J. Sel. Topics in Signal Processing 3, 2, 236–252.Google ScholarCross Ref
    20. Li, H., Zhang, H., Wang, Y., Cao, J., Shamir, A., and Cohen-Or, D. 2013. Curve Style Analysis in a Set of Shapes. Computer Graphics Forum 32, 6, 77–88. Google ScholarDigital Library
    21. McFee, B., and Lanckriet, G. 2011. Learning Multi-modal Similarity. J. Machine Learning Research 12, 491–523. Google ScholarDigital Library
    22. Murray, N., Barcelona, D., Marchesotti, L., and Perronnin, F. 2012. AVA: A Large-Scale Database for Aesthetic Visual Analysis. In Proc. CVPR, 2408–2415. Google ScholarDigital Library
    23. O’Donovan, P., Lībeks, J., Agarwala, A., and Hertzmann, A. 2014. Exploratory Font Selection Using Crowdsourced Attributes. ACM Trans. Graphics 33. Google ScholarDigital Library
    24. Ojala, T., Pietikäinen, M., and Mäenpää, T. 2002. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. PAMI 24, 7, 971–987. Google ScholarDigital Library
    25. Parikh, D., and Grauman, K. 2011. Relative attributes. In Proc. ICCV, 503–510. Google ScholarDigital Library
    26. Radlinski, F., Bennett, P. N., Carterette, B., and Joachims, T. 2009. Redundancy, Diversity and Interdependent Document Relevance. SIGIR Forum 43, 2. Google ScholarDigital Library
    27. Schultz, M., and Joachims, T. 2003. Learning a Distance Metric from Relative Comparisons. In Proc. NIPS.Google Scholar
    28. Shamir, L., Macura, T., Orlov, N., Eckley, D. M., and Goldberg, I. G. 2010. Impressionism, Expressionism, Surrealism: Automated Recognition of Painters and Schools of Art. ACM Trans. Applied Perception 7, 2, 8:1–8:17. Google ScholarDigital Library
    29. Tamuz, O., Liu, C., Belongie, S., Shamir, O., and Kalai, A. 2011. Adaptively Learning the Crowd Kernel. In Proc. ICML, 673–680.Google Scholar
    30. Tenenbaum, J. B., and Freeman, W. T. 2000. Separating Style and Content with Bilinear Models. Neural Computation 12, 6, 1247–1283. Google ScholarDigital Library
    31. van der Maaten, L., and Hinton, G. E. 2008. Visualizing High-Dimensional Data Using t-SNE. J. Machine Learning Research 9, 2579–2605.Google Scholar
    32. Welinder, P., Branson, S., Belongie, S., and Perona, P. 2010. The Multidimensional Wisdom of Crowds. In Proc. NIPS, 2424–2432.Google Scholar
    33. Willats, J., and Durand, F. 2005. Defining pictorial style: Lessons from linguistics and computer graphics. Axiomathes 15, 3, 319–351.Google ScholarCross Ref
    34. Zhu, C., Byrd, R. H., Lu, P., and Nocedal, J. 1997. Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization. ACM Trans. on Mathematical Software 23, 4. Google ScholarDigital Library
    35. Zhu, C., Bichot, C.-E., and Chen, L. 2010. Multi-scale Color Local Binary Patterns for Visual Object Classes Recognition. In Proc. ICPR, 3065–3068. Google ScholarDigital Library

ACM Digital Library Publication:


Overview Page: