“Structure-oriented networks of shape collections”
Conference:
Type(s):
Title:
- Structure-oriented networks of shape collections
Session/Category Title: Indoor Scene Modeling
Presenter(s)/Author(s):
Abstract:
We introduce a co-analysis technique designed for correspondence inference within large shape collections. Such collections are naturally rich in variation, adding ambiguity to the notoriously difficult problem of correspondence computation. We leverage the robustness of correspondences between similar shapes to address the difficulties associated with this problem. In our approach, pairs of similar shapes are extracted from the collection, analyzed and matched in an efficient and reliable manner, culminating in the construction of a network of correspondences that connects the entire collection. The correspondence between any pair of shapes then amounts to a simple propagation along the minimax path between the two shapes in the network. At the heart of our approach is the introduction of a robust, structure-oriented shape matching method. Leveraging the idea of projective analysis, we partition 2D projections of a shape to obtain a set of 1D ordered regions, which are both simple and efficient to match. We lift the matched projections back to the 3D domain to obtain a pairwise shape correspondence. The emphasis given to structural compatibility is a central tool in estimating the reliability and completeness of a computed correspondence, uncovering any non-negligible semantic discrepancies that may exist between shapes. These detected differences are a deciding factor in the establishment of a network aiming to capture local similarities. We demonstrate that the combination of the presented observations into a co-analysis method allows us to establish reliable correspondences among shapes within large collections.
References:
1. Alhashim, I., Xu, K., Zhuang, Y., Cao, J., Simari, P., and Zhang, H. 2015. Deformation-driven topology-varying 3D shape correspondence. ACM Trans. Graph. (SIGGRAPH Asia) 34, 6, 236:1–13.
2. Bronstein, A. M., Bronstein, M. M., Guibas, L. J., and Ovsjanikov, M. 2011. Shape Google: Geometric words and expressions for invariant shape retrieval. ACM Trans. Graph. 30, 1, 1:1–20.
3. Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., Xiao, J., Yi, L., and Yu, F. 2015. ShapeNet: An Information-Rich 3D Model Repository. Tech. Rep. arXiv:1512.03012 {cs.GR}, Stanford University — Princeton University — Toyota Technological Institute at Chicago.
4. Chen, D.-Y., Tian, X.-P., Shen, Y.-T., and Ouhyoung, M. 2003. On visual similarity based 3D model retrieval. Computer Graphics Forum (Eurographics) 22, 3, 223–232. Cross Ref
5. Coifman, R. R., and Lafon, S. 2006. Diffusion maps. Applied and Computational Harmonic Analysis 21, 1, 5–30. Cross Ref
6. Dalal, N., and Triggs, B. 2005. Histograms of oriented gradients for human detection. In Proc. IEEE Conf. Comp. Vis. and Pat. Rec. (CVPR), vol. 1, 886–893.
7. Hu, R., Fan, L., and Liu, L. 2012. Co-segmentation of 3D shapes via subspace clustering. Computer Graphics Forum (SGP) 31, 5, 1703–1713.
8. Huang, Q., and Guibas, L. 2013. Consistent shape maps via semidefinite programming. Computer Graphics Forum (SGP) 32, 5, 177–186.
9. Huang, Q., Koltun, V., and Guibas, L. 2011. Joint shape segmentation with linear programming. ACM Trans. Graph. (SIGGRAPH Asia) 30, 6, 125:1–12.
10. Huang, Q., Zhang, G., Gao, L., Hu, S., Bustcher, A., and Guibas, L. 2012. An optimization approach for extracting and encoding consistent maps in a shape collection. ACM Trans. Graph. (SIGGRAPH Asia) 31, 6, 167:1–11.
11. Huang, Q., Wang, F., and Guibas, L. 2014. Functional map networks for analyzing and browsing large shape collections. ACM Trans. Graph. (SIGGRAPH) 33, 4, 36:1–11.
12. Kaibel, V., and Peinhardt, M. A. 2006. On the bottleneck shortest path problem. Konrad-Zuse-Zentrum für Informationstechnik.
13. Kalogerakis, E., Hertzmann, A., and Singh, K. 2010. Learning 3D mesh segmentation and labeling. ACM Trans. Graph. (SIGGRAPH) 29, 4, 102:1–12.
14. Kim, V., Lipman, Y., and Funkhouser, T. 2011. Blended intrinsic maps. ACM Trans. Graph. (SIGGRAPH) 30, 4.
15. Kim, V. G., Li, W., Mitra, N. J., Chaudhuri, S., DiVerdi, S., and Funkhouser, T. 2013. Learning part-based templates from large collections of 3d shapes. ACM Trans. Graph. (SIGGRAPH) 32, 4, 70:1–12.
16. Kleiman, Y., van Kaick, O., Sorkine-Hornung, O., and Cohen-Or, D. 2015. SHED: Shape edit distance for fine-grained shape similarity. ACM Trans. Graph. (SIGGRAPH Asia) 34, 6, 235:1–11.
17. Laga, H., Mortara, M., and Spagnuolo, M. 2013. Geometry and context for semantic correspondences and functionality recognition in man-made 3D shapes. ACM Trans. Graph. 32, 5, 150:1–16.
18. Li, Y., Su, H., Qi, C. R., Fish, N., Cohen-Or, D., and Guibas, L. J. 2015. Joint embeddings of shapes and images via CNN image purification. ACM Trans. Graph. (SIGGRAPH Asia) 34, 6, 234:1–12.
19. Litman, R., Bronstein, A., Bronstein, M., and Castellani, U. 2014. Supervised learning of bag-of-features shape descriptors using sparse coding. Computer Graphics Forum (SGP) 33, 5, 127–136.
20. Nguyen, A., Ben-Chen, M., Welnicka, K., Ye, Y., and Guibas, L. 2011. An optimization approach to improving collections of shape maps. Computer Graphics Forum 30, 5, 1481–1491. Cross Ref
21. Ovsjanikov, M., Mérigot, Q., Mémoli, F., and Guibas, L. 2010. One point isometric matching with the heat kernel. Computer Graphics Forum (SGP) 29, 5, 1555–1564. Cross Ref
22. Rustamov, R. M. 2007. Laplace-Beltrami eigenfunctions for deformation invariant shape representation. In Proc. Symp. Geometry Processing, 225–233.
23. Savva, M., Yu, F., Su, H., Aono, M., Chen, B., Cohen-Or, D., Deng, W., Su, H., Bai, S., Bai, X., Fish, N., Han, J., Kalogerakis, E., Learned-Miller, E. G., Li, Y., Liao, M., Maji, S., Tatsuma, A., Wang, Y., Zhang, N., and Zhou, Z. 2016. Large-Scale 3D Shape Retrieval from ShapeNet Core55. In Eurographics Workshop on 3D Object Retrieval, The Eurographics Association, A. Ferreira, A. Giachetti, and D. Giorgi, Eds.
24. Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., and Cohen-Or, D. 2011. Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering. ACM Trans. Graph. (SIGGRAPH Asia) 30, 6, 126:1–10.
25. Solomon, J., Peyré, G., Kim, V., and Sra, S. 2016. Entropic metric alignment for correspondence problems. ACM Trans. Graph. (SIGGRAPH), to appear.
26. Su, H., Maji, S., Kalogerakis, E., and Learned-Miller, E. 2015. Multi-view convolutional neural networks for 3D shape recognition. In Proc. ICCV, 945–953.
27. Tangelder, J. W. H., and Veltkamp, R. C. 2008. A survey of content based 3D shape retrieval methods. Multimedia Tools and Applications 39, 3, 441–471.
28. Tenenbaum, J. B., de Silva, V., and Langford, J. C. 2000. A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500, 2319–2323.
29. van Kaick, O., Tagliasacchi, A., Sidi, O., Zhang, H., Cohen-Or, D., Wolf, L., and Hamarneh, G. 2011. Prior knowledge for part correspondence. Computer Graphics Forum (Eurographics) 30, 2, 553–562. Cross Ref
30. van Kaick, O., Zhang, H., Hamarneh, G., and Cohen-Or, D. 2011. A survey on shape correspondence. Computer Graphics Forum 30, 6, 1681–1707. Cross Ref
31. Wang, Y., Asafi, S., van Kaick, O., Zhang, H., Cohen-Or, D., and Chen, B. 2012. Active co-analysis of a set of shapes. ACM Trans. Graph. (SIGGRAPH Asia) 31, 6, 165:1–10.
32. Wang, Y., Gong, M., Wang, T., Cohen-Or, D., Zhang, H., and Chen, B. 2013. Projective analysis for 3D shape segmentation. ACM Trans. Graph. (SIGGRAPH Asia) 32, 6, 192:1–12.
