“Co-Locating Style-Defining Elements on 3D Shapes” by Hu, Hu, Kaick, Huang, Averkiou, et al. …

  • ©Ruizhen Hu, Wenchao Hu, Oliver van Kaick, Hui Huang, Melinos Averkiou, Daniel Cohen-Or, and Hao Zhang

Conference:


Type:


Title:

    Co-Locating Style-Defining Elements on 3D Shapes

Session/Category Title:   Comparing 3D Shapes and Part


Presenter(s)/Author(s):


Moderator(s):



Abstract:


    We introduce a method for co-locating style-defining elements over a set of 3D shapes. Our goal is to translate high-level style descriptions, such as “Ming” or “European” for furniture models, into explicit and localized regions over the geometric models that characterize each style. For each style, the set of style-defining elements is defined as the union of all the elements that are able to discriminate the style. Another property of the style-defining elements is that they are frequently occurring, reflecting shape characteristics that appear across multiple shapes of the same style. Given an input set of 3D shapes spanning multiple categories and styles, where the shapes are grouped according to their style labels, we perform a cross-category co-analysis of the shape set to learn and spatially locate a set of defining elements for each style. This is accomplished by first sampling a large number of candidate geometric elements and then iteratively applying feature selection to the candidates, to extract style-discriminating elements until no additional elements can be found. Thus, for each style label, we obtain sets of discriminative elements that together form the superset of defining elements for the style. We demonstrate that the co-location of style-defining elements allows us to solve problems such as style classification, and enables a variety of applications such as style-revealing view selection, style-aware sampling, and style-driven modeling for 3D shapes.

References:


    1. Sean Arietta, Alexei A. Efros, Ravi Ramamoorthi, and Maneesh Agrawala. 2014. City forensics: Using visual elements to predict non-visual city attributes. IEEE Trans. Visual. Comput. Graph. 20, 12 (2014), 2624–2633.Google ScholarCross Ref
    2. Shai Avidan and Ariel Shamir. 2007. Seam carving for content-aware image resizing. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3 (2007), 10:1–9. Google ScholarDigital Library
    3. Itamar Berger, Ariel Shamir, Moshe Mahler, Elizabeth Carter, and Jessica Hodgins. 2013. Style and abstraction in portrait sketching. ACM Trans. Graph. (Proc. SIGGRAPH) 32, 4 (2013), 55:1–12. Google ScholarDigital Library
    4. M. Corsini, P. Cignoni, and R. Scopigno. 2012. Efficient and flexible sampling with blue noise properties of triangular meshes. IEEE Trans. Visual. Comput. Graph. 18, 6 (2012), 914–924. Google ScholarDigital Library
    5. Carl Doersch, Saurabh Singh, Abhinav Gupta, Josef Sivic, and Alexei A. Efros. 2012. What makes Paris look like Paris? ACM Trans. Graph. (Proc. SIGGRAPH) 31, 4 (2012), 101:1–9. Google ScholarDigital Library
    6. Eric Fernie. 1995. Art History and Its Methods: A Critical Anthology. Phaidon, London, 361.Google Scholar
    7. William T. Freeman, Joshua B. Tenenbaum, and Egon C. Pasztor. 2003. Learning style translation for the lines of a drawing. ACM Trans. Graph. 22, 1 (2003), 33–46. Google ScholarDigital Library
    8. Elena Garces, Aseem Agarwala, Diego Gutierrez, and Aaron Hertzmann. 2014. A similarity measure for illustration style. ACM Trans. Graph. (Proc. SIGGRAPH) 33, 4 (2014), 93:1–9. Google ScholarDigital Library
    9. Ernst H. Gombrich. 1968. “Style”. In International Encyclopedia of the Social Sciences, D. L. Sills (Ed.). Vol. 15. Macmillan, New York, 352.Google Scholar
    10. Aaron Hertzmann, Nuria Oliver, Brian Curless, and Steven M. Seitz. 2002. Curve analogies. In Proceedings of the European Group Workshop on Rendering. 233–246. Google ScholarDigital Library
    11. Katrin Lang and Marc Alexa. 2015. The Markov pen: Online synthesis of free-hand drawing styles. In Proceedings of the Symposium on Non-Photorealistic Animation and Rendering (NPAR’15). 203–215. Google ScholarDigital Library
    12. Chang Ha Lee, Amitabh Varshney, and David W. Jacobs. 2005. Mesh saliency. ACM Trans. Graph. (Proc. SIGGRAPH) 24, 3 (2005), 659–666.Google ScholarDigital Library
    13. Y. J. Lee, A. A. Efros, and M. Hebert. 2013. Style-aware mid-level representation for discovering visual connections in space and time. In Proceedings of the International Conference on Computer Vision (ICCV’13). 1857–1864. Google ScholarDigital Library
    14. H. Li, H. Zhang, Y. Wang, J. Cao, A. Shamir, and D. Cohen-Or. 2013. Curve style analysis in a set of shapes. Comput. Graph. Forum 32, 6 (2013), 77–88. Google ScholarDigital Library
    15. Roee Litman, Alex Bronstein, Michael Bronstein, and Umberto Castellani. 2014. Supervised learning of bag-of-features shape descriptors using sparse coding. Comput. Graph. Forum 33, 5 (2014), 127–136.Google ScholarDigital Library
    16. Tianqiang Liu, Aaron Hertzmann, Wilmot Li, and Thomas Funkhouser. 2015. Style compatibility for 3D furniture models. ACM Trans. Graph. (Proc. SIGGRAPH) 34, 4 (2015), 85:1–9. Google ScholarDigital Library
    17. Zhaoliang Lun, Evangelos Kalogerakis, and Alla Sheffer. 2015. Elements of style: Learning perceptual shape style similarity. ACM Trans. Graph. (Proc. SIGGRAPH) 34, 4 (2015), 84:1–14. Google ScholarDigital Library
    18. Zhaoliang Lun, Evangelos Kalogerakis, Rui Wang, and Alla Sheffer. 2016. Functionality preserving shape style transfer. ACM Trans. Graph. 35, 6 (2016), 209:1–14. Google ScholarDigital Library
    19. Chongyang Ma, Haibin Huang, Alla Sheffer, Evangelos Kalogerakis, and Rui Wang. 2014. Analogy-driven 3D style transfer. Comput. Graph. Forum (Proc. Eurographics) 33, 2 (2014), 175–184. Google ScholarDigital Library
    20. L. Majerowicz, A. Shamir, A. Sheffer, and H. H. Hoos. 2014. Filling your shelves: Synthesizing diverse style-preserving artifact arrangements. IEEE Trans. Visual. Comput. Graph. 20, 11 (2014), 1507–1518.Google ScholarCross Ref
    21. Wallace Nutting. 1968. Furniture Treasury. Vol. 3. Macmillan Publishing.Google Scholar
    22. Peter O’Donovan, Jānis Lībeks, Aseem Agarwala, and Aaron Hertzmann. 2014. Exploratory font selection using crowdsourced attributes. ACM Trans. Graph. (Proc. SIGGRAPH) 33, 4 (2014), 92:1–9. Google ScholarDigital Library
    23. Hanchuan Peng, Fuhui Long, and Chris Ding. 2005. Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy. IEEE Pattern Anal. Mach. Intell. 27, 8 (2005), 1226–1238. Google ScholarDigital Library
    24. Alex Rodriguez and Alessandro Laio. 2014. Clustering by fast search and find of density peaks. Science 344, 6191 (2014), 1492–1496.Google Scholar
    25. Mark Schmidt, Glenn Fung, and Romer Rosales. 2007. Fast optimization methods for L1 regularization: A comparative study and two new approaches. In Proceedings of the European Conference on Machine Learning. 286–297. Google ScholarDigital Library
    26. Philip Shilane and Thomas Funkhouser. 2007. Distinctive regions of 3D surfaces. ACM Trans. Graph. 26, 2 (2007), 7:1–15. Google ScholarDigital Library
    27. Abhinav Shrivastava, Tomasz Malisiewicz, Abhinav Gupta, and Alexei A Efros. 2011. Data-driven visual similarity for cross-domain image matching. ACM Trans. Graph. (Proc. of SIGGRAPH Asia) 30, 6 (2011), 154:1–10. Google ScholarDigital Library
    28. E. Shtrom, G. Leifman, and A. Tal. 2013. Saliency detection in large point sets. In Proceedings of the International Conference on Computer Vision (ICCV’13). 3591–3598. Google ScholarDigital Library
    29. Denis Simakov, Yaron Caspi, Eli Shechtman, and Michal Irani. 2008. Summarizing visual data using bidirectional similarity. In Proceedings of the Conference on Computer Vision and pattern Recognition (CVPR’08). 1–8.Google ScholarCross Ref
    30. J. W. H. Tangelder and R. C. Veltkamp. 2008. A survey of content based 3D shape retrieval methods. Multimed. Tools Appl. 39, 3 (2008), 441–471. Google ScholarDigital Library
    31. R. Toldo, U. Castellani, and A. Fusiello. 2010. The bag of words approach for retrieval and categorization of 3D objects. Vis. Comput. 26, 10 (2010), 1257–1268. Google ScholarDigital Library
    32. Andrew R. Webb and Keith D. Copsey. 2011. Statistical Pattern Recognition (3rd ed.). Wiley.Google Scholar
    33. Kai Xu, Honghua Li, Hao Zhang, Daniel Cohen-Or, Yueshan Xiong, and Zhi-Quan Cheng. 2010. Style-content separation by anisotropic part scales. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 29, 6 (2010), 184:1–10. Google ScholarDigital Library


ACM Digital Library Publication:



Overview Page: