“Split-and-Fit: Learning B-Reps via Structure-aware Voronoi Partitioning”
Conference:
Type(s):
Title:
- Split-and-Fit: Learning B-Reps via Structure-aware Voronoi Partitioning
Presenter(s)/Author(s):
Abstract:
The “Split-and-Fit” method introduces a top-down, structure-aware strategy for reconstructing B-Rep models, using Voronoi diagrams to partition the space and followed by primitive fitting. We design NVD-Net to accurately predict these partitions from point clouds or distance fields, resulting in significantly improved reconstruction quality and generalizability compared to previous methods.
References:
[1]
Pierre Alliez, David Cohen-Steiner, Yiying Tong, and Mathieu Desbrun. 2007. Voronoi-based variational reconstruction of unoriented point sets. In Proc. Eurographics Symp. on Geometry Processing, Vol. 257. 39–48.
[2]
Marco Attene and Giuseppe Patan?. 2010. Hierarchical Structure Recovery of Point-Sampled Surfaces. Computer Graphics Forum 29, 6 (2010), 1905–1920.
[3]
Jean-Philippe Bauchet and Florent Lafarge. 2020. Kinetic shape reconstruction. ACM Trans. on Graphics (Proc. SIGGRAPH) 39, 5 (2020), 156:1–15614.
[4]
Ding-Yun Chen, Xiao-Pei Tian, Yu-Te Shen, and Ming Ouhyoung. 2003. On Visual Similarity Based 3D Model Retrieval. Computer Graphics Forum 22, 3 (2003), 223–232.
[5]
Zhiqin Chen, Andrea Tagliasacchi, Thomas Funkhouser, and Hao Zhang. 2022. Neural Dual Contouring. ACM Trans. on Graphics (Proc. SIGGRAPH) 41, 4 (2022), 104:1–104:13.
[6]
Zhiqin Chen, Andrea Tagliasacchi, and Hao Zhang. 2020. BSP-Net: Generating Compact Meshes via Binary Space Partitioning. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 42–51.
[7]
David Cohen-Steiner, Pierre Alliez, and Mathieu Desbrun. 2004. Variational shape approximation. ACM Trans. on Graphics (Proc. SIGGRAPH) 23, 3 (2004), 905–914.
[8]
Jianmin Zheng Daxuan Ren, Jianfei Cai, Haiyong Jiang Jiatong Li, Zhongang Cai, Junzhe Zhang, Liang Pan, Mingyuan Zhang, Haiyu Zhao, and Shuai Yi. 2021. CSG-Stump: A Learning Friendly CSG-Like Representation for Interpretable Shape Parsing. In ICCV. 12458–12467.
[9]
David Eberly. 2000. Geometric Tools. https://www.geometrictools.com/.
[10]
Pierre-Alain Fayolle and Markus Friedrich. 2023. A Survey of Methods for Converting Unstructured Data to CSG Models. arXiv:2305.01220 [cs.GR]
[11]
Martin A Fischler and Robert C Bolles. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6 (1981), 381–395.
[12]
Rao Fu, Cheng Wen, Qian Li, Xiao Xiao, and Pierre Alliez. 2023. BPNet: B\’ezier Primitive Segmentation on 3D Point Clouds. In Proc. Int. Joint Conf. on Artificial Intelligence. 754–762.
[13]
Haoxiang Guo, Shilin Liu, Hao Pan, Yang Liu, Xin Tong, and Baining Guo. 2022. ComplexGen: CAD reconstruction by B-rep chain complex generation. ACM Trans. on Graphics (Proc. SIGGRAPH) 41, 4 (2022), 129:1–129:18.
[14]
Jingwei Huang, Yanfeng Zhang, and Mingwei Sun. 2021. PrimitiveNet: Primitive Instance Segmentation with Local Primitive Embedding under Adversarial Metric. In Proc. Int. Conf. on Computer Vision. 15323–15333.
[15]
Pradeep Kumar Jayaraman, Joseph George Lambourne, Nishkrit Desai, Karl D. D. Willis, Aditya Sanghi, and Nigel J. W. Morris. 2023. SolidGen: An Autoregressive Model for Direct B-rep Synthesis. Trans. Mach. Learn. Res. (2023).
[16]
Adrien Kaiser, Jos? Alonso Yb??ez Zepeda, and Tamy Boubekeur. 2019. A Survey of Simple Geometric Primitives Detection Methods for Captured 3D Data. Computer Graphics Forum 38, 1 (2019), 167–196.
[17]
Kacper Kania, Maciej Zieba, and Tomasz Kajdanowicz. 2020. UCSG-NET-unsupervised discovering of constructive solid geometry tree. In Proc. Conf. on Neural Information Processing Systems, Vol. 33. 8776–8786.
[18]
Sebastian Koch, Albert Matveev, Zhongshi Jiang, Francis Williams, Alexey Artemov, Evgeny Burnaev, Marc Alexa, Denis Zorin, and Daniele Panozzo. 2019. ABC: A Big CAD Model Dataset for Geometric Deep Learning. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 9601–9611.
[19]
Florent Lafarge and Cl?ment Mallet. 2012. Creating large-scale city models from 3D-point clouds: a robust approach with hybrid representation. Proc. Int. Conf. on Computer Vision 99 (2012), 69–85.
[20]
Joseph G. Lambourne, Karl D.D. Willis, Pradeep Kumar Jayaraman, Aditya Sanghi, Peter Meltzer, and Hooman Shayani. 2021. BRepNet: A topological message passing system for solid models. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 12773–12782.
[21]
Joseph G. Lambourne, Karl D. D. Willis, Pradeep Kumar Jayaraman, Longfei Zhang, Aditya Sanghi, and Kamal Rahimi Malekshan. 2022. Reconstructing Editable Prismatic CAD from Rounded Voxel Models. In Proc. SIGGRAPH Asia. 53:1–53:9.
[22]
Lingxiao Li, Minhyuk Sung, Anastasia Dubrovina, Li Yi, and Leonidas J. Guibas. 2019a. Supervised Fitting of Geometric Primitives to 3D Point Clouds. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 2652–2660.
[23]
Lingxiao Li, Minhyuk Sung, Anastasia Dubrovina, Li Yi, and Leonidas J. Guibas. 2019b. Supervised Fitting of Geometric Primitives to 3D Point Clouds. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 2652–2660.
[24]
Pu Li, Jianwei Guo, Xiaopeng Zhang, and Dong-Ming Yan. 2023a. SECAD-Net: Self-Supervised CAD Reconstruction by Learning Sketch-Extrude Operations. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 16816–16826.
[25]
Yuanqi Li, Shun Liu, Xinran Yang, Jianwei Guo, Jie Guo, and Yanwen Guo. 2023b. Surface and Edge Detection for Primitive Fitting of Point Clouds. In Proc. SIGGRAPH. 44:1–44:10.
[26]
Yangyan Li, Xiaokun Wu, Yiorgos Chrysathou, Andrei Sharf, Daniel Cohen-Or, and Niloy J Mitra. 2011. Globfit: Consistently fitting primitives by discovering global relations. ACM Trans. on Graphics (Proc. SIGGRAPH) 30, 4 (2011), 52:1–52:12.
[27]
Cheng Lin, Lingjie Liu, Changjian Li, Leif Kobbelt, Bin Wang, Shiqing Xin, and Wenping Wang. 2022. SEG-MAT: 3D Shape Segmentation Using Medial Axis Transform. IEEE Trans. Visualization & Computer Graphics 28, 6 (2022), 2430–2444.
[28]
Tsung-Yi Lin, Priya Goyal, Ross B. Girshick, Kaiming He, and Piotr Doll?r. 2020. Focal Loss for Dense Object Detection. IEEE Trans. Pattern Analysis & Machine Intelligence 42, 2 (2020), 318–327.
[29]
Yujia Liu, Anton Obukhov, Jan Dirk Wegner, and Konrad Schindler. 2023. Point2CAD: Reverse Engineering CAD Models from 3D Point Clouds. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition Workshops.
[30]
Yong-Jin Liu, Chun-Xu Xu, Dian Fan, and Ying He. 2015. Efficient Construction and Simplification of Delaunay Meshes. ACM Trans. on Graphics 34, 6 (2015), 174:1–174:13.
[31]
Nissim Maruani, Roman Klokov, Maks Ovsjanikov, Pierre Alliez, and Mathieu Desbrun. 2023. VoroMesh: Learning Watertight Surface Meshes with Voronoi Diagrams. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 14565–14574.
[32]
Albert Matveev, Ruslan Rakhimov, Alexey Artemov, Gleb Bobrovskikh, Vage Egiazarian, Emil Bogomolov, Daniele Panozzo, Denis Zorin, and Evgeny Burnaev. 2022. Def: Deep Estimation of Sharp Geometric Features in 3D Shapes. ACM Trans. on Graphics (Proc. SIGGRAPH) 41, 4 (2022), 108:1–108:22.
[33]
Liangliang Nan and Peter Wonka. 2017. PolyFit: Polygonal Surface Reconstruction from Point Clouds. In Proc. Int. Conf. on Computer Vision. 2372–2380.
[34]
Charlie Nash, Yaroslav Ganin, S. M. Ali Eslami, and Peter W. Battaglia. 2020. PolyGen: An Autoregressive Generative Model of 3D Meshes. In Proc. Int. Conf. on Machine Learning, Vol. 119. 7220–7229.
[35]
Sven Oesau, Florent Lafarge, and Pierre Alliez. 2016. Planar Shape Detection and Regularization in Tandem. Computer Graphics Forum 35, 1 (2016), 203–215.
[36]
Ruwen Schnabel, Roland Wahl, and Reinhard Klein. 2007. Efficient RANSAC for point-cloud shape detection. Computer Graphics Forum 26, 2 (2007), 214–226.
[37]
Gopal Sharma, Difan Liu, Subhransu Maji, Evangelos Kalogerakis, Siddhartha Chaudhuri, and Radom?r M?ch. 2020. ParSeNet: A Parametric Surface Fitting Network for 3D Point Clouds. In Proc. Euro. Conf. on Computer Vision, Vol. 12352. 261–276.
[38]
Yawar Siddiqui, Antonio Alliegro, Alexey Artemov, Tatiana Tommasi, Daniele Sirigatti, Vladislav Rosov, Angela Dai, and Matthias Nie?ner. 2023. MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers. arXiv:2311.15475 [cs.CV]
[39]
Martin Skrodzki, Eric Zimmermann, and Konrad Polthier. 2020. Variational shape approximation of point set surfaces. Computer Aided Geometric Design 80 (2020), 101875.
[40]
Ningna Wang, Bin Wang, Wenping Wang, and Xiaohu Guo. 2022. Computing medial axis transform with feature preservation via restricted power diagram. ACM Trans. on Graphics (Proc. SIGGRAPH) 41, 6 (2022), 188:1–188:18.
[41]
Francis Williams, Jerome Parent-Levesque, Derek Nowrouzezahrai, Daniele Panozzo, Kwang Moo Yi, and Andrea Tagliasacchi. 2020. Voronoinet: General functional approximators with local support. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition Workshops. 264–265.
[42]
Xianghao Xu, Wenzhe Peng, Chin-Yi Cheng, Karl D. D. Willis, and Daniel Ritchie. 2021. Inferring CAD Modeling Sequences Using Zone Graphs. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 6062–6070.
[43]
Dong-Ming Yan, Wenping Wang, Yang Liu, and Zhouwang Yang. 2012. Variational mesh segmentation via quadric surface fitting. Computer-Aided Design 44, 11 (2012), 1072–1082.
[44]
Siming Yan, Zhenpei Yang, Chongyang Ma, Haibin Huang, Etienne Vouga, and Qixing Huang. 2021. HPNet: Deep Primitive Segmentation Using Hybrid Representations. In Proc. Int. Conf. on Computer Vision. 2733–2742.
[45]
Fenggen Yu, Qimin Chen, Maham Tanveer, Ali Mahdavi Amiri, and Hao Zhang. 2023. D2CSG: Unsupervised Learning of Compact CSG Trees with Dual Complements and Dropouts. In Proc. Conf. on Neural Information Processing Systems.
[46]
Fenggen Yu, Zhiqin Chen, Manyi Li, Aditya Sanghi, Hooman Shayani, Ali Mahdavi-Amiri, and Hao Zhang. 2022. CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assembly. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 11758–11768.
[47]
Wenni Zheng, Pengbo Bo, Yang Liu, and Wenping Wang. 2012. Fast B-spline Curve Fitting by L-BFGS. Computer Aided Geometric Design 29, 7 (2012), 448–462.
[48]
Xiangyu Zhu, Dong Du, Weikai Chen, Zhiyou Zhao, Yinyu Nie, and Xiaoguang Han. 2023. NerVE: Neural Volumetric Edges for Parametric Curve Extraction From Point Cloud. In Proc. IEEE/CVF Conf. on Computer Vision & Pattern Recognition. 13601–13610.
