“ComplexGen: CAD reconstruction by B-rep chain complex generation” by Guo, Liu, Pan, Liu, Tong, et al. …

We view the reconstruction of CAD models in the boundary representation (B-Rep) as the detection of geometric primitives of different orders, i.e., vertices, edges and surface patches, and the correspondence of primitives, which are holistically modeled as a chain complex, and show that by modeling such comprehensive structures more complete and regularized reconstructions can be achieved. We solve the complex generation problem in two steps. First, we propose a novel neural framework that consists of a sparse CNN encoder for input point cloud processing and a tri-path transformer decoder for generating geometric primitives and their mutual relationships with estimated probabilities. Second, given the probabilistic structure predicted by the neural network, we recover a definite B-Rep chain complex by solving a global optimization maximizing the likelihood under structural validness constraints and applying geometric refinements. Extensive tests on large scale CAD datasets demonstrate that the modeling of B-Rep chain complex structure enables more accurate detection for learning and more constrained reconstruction for optimization, leading to structurally more faithful and complete CAD B-Rep models than previous results.

1. 3D Systems Inc. 2021. Geomagic Design X. https://www.3dsystems.com/software/geomagic-design-x Accessed Apr. 20, 2021.Google Scholar
2. James Andrews and Carlo H. Séquin. 2013. Type-Constrained Direct Fitting of Quadric Surfaces. Computer Aided Design and Applications (2013).Google Scholar
3. Kurt M Anstreicher. 2003. Recent advances in the solution of quadratic assignment problems. Mathematical Programming 97, 1 (2003), 27–42.Google ScholarCross Ref
4. Ansys Inc. 2021. Ansys SpaceClaim. https://www.ansys.com/products/3d-design/ansys-spaceclaim Accessed Apr. 20, 2021.Google Scholar
5. Autodesk Inc. 2021. AutoCAD. http://www.autodesk.com/products/autocad/overview Accessed Apr. 20, 2021.Google Scholar
6. Matthew Berger, Andrea Tagliasacchi, Lee M. Seversky, Pierre Alliez, Gaël Guennebaud, Joshua A. Levine, Andrei Sharf, and Claudio T. Silva. 2017. A Survey of Surface Reconstruction from Point Clouds. Computer Graphics Forum 36, 1 (2017).Google Scholar
7. Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. 2020. End-to-end object detection with transformers. In European Conference on Computer Vision. Springer.Google ScholarDigital Library
8. Dan Cascaval, Mira Shalah, Phillip Quinn, Rastislav Bodik, Maneesh Agrawala, and Adriana Schulz. 2021. Differentiable 3D CAD Programs for Bidirectional Editing. arXiv preprint arXiv:2110.01182 (2021).Google Scholar
9. Angel X. Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, Jianxiong Xiao, Li Yi, and Fisher Yu. 2015. ShapeNet: An Information-Rich 3D Model Repository. Technical Report arXiv:1512.03012 [cs.GR]. Stanford University — Princeton University — Toyota Technological Institute at Chicago.Google Scholar
10. Christopher Choy, JunYoung Gwak, and Silvio Savarese. 2019. 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google ScholarCross Ref
11. David Cohen-Steiner, Pierre Alliez, and Mathieu Desbrun. 2004. Variational Shape Approximation. In ACM SIGGRAPH 2004 Papers (SIGGRAPH ’04). Association for Computing Machinery, 10 pages.Google Scholar
12. Antonio DiCarlo, Alberto Paoluzzi, and Vadim Shapiro. 2014. Linear algebraic representation for topological structures. Computer-Aided Design 46 (2014).Google Scholar
13. Tao Du, Jeevana Priya Inala, Yewen Pu, Andrew Spielberg, Adriana Schulz, Daniela Rus, Armando Solar-Lezama, and Wojciech Matusik. 2018. InverseCSG: Automatic Conversion of 3D Models to CSG Trees. ACM Trans. Graph. (Siggraph Asia) 37, 6, Article 213 (2018).Google Scholar
14. Yaroslav Ganin, Sergey Bartunov, Yujia Li, Ethan Keller, and Stefano Saliceti. 2021. Computer-Aided Design as Language. In Advances in Neural Information Processing Systems, Vol. 34. Curran Associates, Inc.Google Scholar
15. Gurobi Optimization, LLC. 2021. Gurobi Optimizer Reference Manual. https://www.gurobi.comGoogle Scholar
16. David Ha, Andrew Dai, and Quoc V. Le. 2017. HyperNetworks. In ICLR.Google Scholar
17. Allen Hatcher. 2002. Algebraic Topology. Cambridge Univ. Press, Cambridge.Google Scholar
18. Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. 2017. Mask R-CNN. In IEEE International Conference on Computer Vision (ICCV).Google Scholar
19. Christoph Martin Hoffmann. 1989. Geometric and Solid Modeling: An Introduction. Morgan Kaufmann.Google Scholar
20. Jingwei Huang, Yanfeng Zhang, and Mingwei Sun. 2021. PrimitiveNet: Primitive Instance Segmentation With Local Primitive Embedding Under Adversarial Metric. In IEEE/CVF International Conference on Computer Vision (ICCV). 15343–15353.Google Scholar
21. Pradeep Kumar Jayaraman, Aditya Sanghi, Joseph G. Lambourne, Karl D.D. Willis, Thomas Davies, Hooman Shayani, and Nigel Morris. 2021. UV-Net: Learning from Boundary Representations. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google ScholarCross Ref
22. Kacper Kania, Maciej Zięba, and Tomasz Kajdanowicz. 2020. UCSG-NET- Unsupervised Discovering of Constructive Solid Geometry Tree. In Advances in Neural Information Processing Systems, Vol. 33. Curran Associates, Inc.Google Scholar
23. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations (ICLR).Google Scholar
24. Sebastian Koch, Albert Matveev, Zhongshi Jiang, Francis Williams, Alexey Artemov, Evgeny Burnaev, Marc Alexa, Denis Zorin, and Daniele Panozzo. 2019. Abc: A big cad model dataset for geometric deep learning. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google ScholarCross Ref
25. Harold W. Kuhn. 1955. The Hungarian method for the assignment problem. Naval Research Logistics Quarterly 2 (1955), 83–97.Google ScholarCross Ref
26. Joseph G. Lambourne, Karl D.D. Willis, Pradeep Kumar Jayaraman, Aditya Sanghi, Peter Meltzer, and Hooman Shayani. 2021. BRepNet: A Topological Message Passing System for Solid Models. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
27. Lingxiao Li, Minhyuk Sung, Anastasia Dubrovina, Li Yi, and Leonidas J. Guibas. 2019. Supervised Fitting of Geometric Primitives to 3D Point Clouds. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
28. Yangyan Li, Xiaokun Wu, Yiorgos Chrysathou, Andrei Sharf, Daniel Cohen-Or, and Niloy J. Mitra. 2011. GlobFit: Consistently Fitting Primitives by Discovering Global Relations. ACM Trans. Graph. (SIGGRAPH) 30, 4 (2011).Google ScholarDigital Library
29. Yujia Liu, Stefano D’Aronco, Konrad Schindler, and Jan Dirk Wegner. 2021. PC2WF: 3D Wireframe Reconstruction from Raw Point Clouds. In International Conference on Learning Representations.Google Scholar
30. Aman Mathur and Damien Zufferey. 2021. Constraint Synthesis for Parametric CAD. In Pacific Graphics Short Papers, Posters, and work-in-Progress Papers. The Eurographics Association.Google Scholar
31. Depu Meng, Xiaokang Chen, Zejia Fan, Gang Zeng, Houqiang Li, Yuhui Yuan, Lei Sun, and Jingdong Wang. 2021. Conditional DETR for Fast Training Convergence. In IEEE International Conference on Computer Vision (ICCV).Google Scholar
32. Ishan Misra, Rohit Girdhar, and Armand Joulin. 2021. An End-to-End Transformer Model for 3D Object Detection. In IEEE International Conference on Computer Vision (ICCV).Google ScholarCross Ref
33. James Munkres. 1957. Algorithms for the Assignment and Transportation Problems. J. Soc. Indust. Appl. Math. 5, 1 (1957), 32–38.Google ScholarCross Ref
34. Liangliang Nan and Peter Wonka. 2017. PolyFit: Polygonal Surface Reconstruction From Point Clouds. In IEEE Conference on Computer Vision (ICCV).Google Scholar
35. Charlie Nash, Yaroslav Ganin, SM Ali Eslami, and Peter Battaglia. 2020. Polygen: An autoregressive generative model of 3d meshes. In International Conference on Machine Learning. PMLR.Google Scholar
36. Wamiq Para, Shariq Bhat, Paul Guerrero, Tom Kelly, Niloy Mitra, Leonidas J Guibas, and Peter Wonka. 2021. SketchGen: Generating Constrained CAD Sketches. In Advances in Neural Information Processing Systems, Vol. 34. Curran Associates, Inc.Google Scholar
37. Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You Only Look Once: Unified, Real-Time Object Detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
38. Daxuan Ren, Jianmin Zheng, Jianfei Cai, Jiatong Li, Haiyong Jiang, Zhongang Cai, Junzhe Zhang, Liang Pan, Mingyuan Zhang, Haiyu Zhao, et al. 2021. CSG-Stump: A Learning Friendly CSG-Like Representation for Interpretable Shape Parsing. In IEEE International Conference on Computer Vision (ICCV).Google Scholar
39. Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2017. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 39, 6 (2017).Google ScholarDigital Library
40. Ruwen Schnabel, Patrick Degener, and Reinhard Klein. 2009. Completion and Reconstruction with Primitive Shapes. Computer Graphics Forum 28, 2 (2009).Google Scholar
41. Ruwen Schnabel, Roland Wahl, and Reinhard Klein. 2007. Efficient RANSAC for Point-Cloud Shape Detection. Computer Graphics Forum 26, 2 (2007).Google Scholar
42. Philip Schneider and David H. Eberly. 2003. Geometric Tools for Computer Graphics. Morgan Kaufmann.Google Scholar
43. Ari Seff, Yaniv Ovadia, Wenda Zhou, and Ryan P. Adams. 2020. SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Design. In ICML 2020 Workshop on Object-Oriented Learning.Google Scholar
44. Ari Seff, Wenda Zhou, Nick Richardson, and Ryan P Adams. 2021. Vitruvion: A Generative Model of Parametric CAD Sketches. arXiv preprint arXiv:2109.14124 (2021).Google Scholar
45. Gopal Sharma, Rishabh Goyal, Difan Liu, Evangelos Kalogerakis, and Subhransu Maji. 2018. CSGNet: Neural Shape Parser for Constructive Solid Geometry. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
46. Gopal Sharma, Difan Liu, Subhransu Maji, Evangelos Kalogerakis, Siddhartha Chaudhuri, and Radomír Měch. 2020. ParSeNet: A Parametric Surface Fitting Network for 3D Point Clouds. In European Conference on Computer Vision.Google ScholarDigital Library
47. Martin Skrodzki, Eric Zimmermann, and Konrad Polthier. 2020. Variational shape approximation of point set surfaces. Computer Aided Geometric Design 80 (2020).Google Scholar
48. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, Vol. 30. Curran Associates, Inc.Google Scholar
49. Xiaogang Wang, Yuelang Xu, Kai Xu, Andrea Tagliasacchi, Bin Zhou, Ali Mahdavi-Amiri, and Hao Zhang. 2020. PIE-NET: Parametric Inference of Point Cloud Edges. In Neural Information Processing Systems.Google Scholar
50. Kevin J. Weiler. 1986. Topological Structures for Geometric Modeling. Rensselaer Polytechnic Institute.Google Scholar
51. Naoufel Werghi, Robert Fisher, Anthony Ashbrook, and Craig Robertson. 2002. Shape Reconstruction Incorporating Multiple Nonlinear Geometric Constraints. Constraints 7 (04 2002).Google Scholar
52. Karl D. D. Willis, Pradeep Kumar Jayaraman, Hang Chu, Yunsheng Tian, Yifei Li, Daniele Grandi, Aditya Sanghi, Linh Tran, J. Lambourne, Armando Solar-Lezama, and Wojciech Matusik. 2021a. JoinABLe: Learning Bottom-up Assembly of Parametric CAD Joints. ArXiv abs/2111.12772 (2021).Google Scholar
53. Karl D. D. Willis, Pradeep Kumar Jayaraman, Joseph G. Lambourne, Hang Chu, and Yewen Pu. 2021b. Engineering Sketch Generation for Computer-Aided Design. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).Google Scholar
54. Karl D. D. Willis, Yewen Pu, Jieliang Luo, Hang Chu, Tao Du, Joseph G. Lambourne, Armando Solar-Lezama, and Wojciech Matusik. 2021c. Fusion 360 Gallery: A Dataset and Environment for Programmatic CAD Construction from Human Design Sequences. ACM Transactions on Graphics (TOG) 40, 4 (2021).Google ScholarDigital Library
55. Rundi Wu, Chang Xiao, and Changxi Zheng. 2021. DeepCAD: A Deep Generative Network for Computer-Aided Design Models. In IEEE International Conference on Computer Vision (ICCV).Google Scholar
56. Ruibin Xiong, Yunchang Yang, Di He, Kai Zheng, Shuxin Zheng, Chen Xing, Huishuai Zhang, Yanyan Lan, Liwei Wang, and Tieyan Liu. 2020. On Layer Normalization in the Transformer Architecture. In International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 119). PMLR.Google Scholar
57. Xianghao Xu, Wenzhe Peng, Chin-Yi Cheng, Karl D. D. Willis, and Daniel Ritchie. 2021. Inferring CAD Modeling Sequences Using Zone Graphs. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
58. Dong-Ming Yan, Wenping Wang, Yang Liu, and Zhouwang Yang. 2012. Variational mesh segmentation via quadric surface fitting. Computer-Aided Design 44, 11 (2012).Google Scholar
59. Siming Yan, Zhenpei Yang, Chongyang Ma, Haibin Huang, Etienne Vouga, and Qixing Huang. 2021. HPNet: Deep Primitive Segmentation Using Hybrid Representations. International Conference on Computer Vision (ICCV).Google Scholar
60. Dominic Zhao, Johannes von Oswald, Seijin Kobayashi, João Sacramento, and Benjamin F Grewe. 2020. Meta-Learning via Hypernetworks. In Workshop on Meta-Learning at NeurIPS 2020 (MetaLearn 2020). IEEE.Google Scholar