“Repairing man-made meshes via visual driven global optimization with minimum intrusion” by Chu, Pan, Liu and Wang
Conference:
Type(s):
Title:
- Repairing man-made meshes via visual driven global optimization with minimum intrusion
Session/Category Title: Geometry Brekkie
Presenter(s)/Author(s):
Moderator(s):
Abstract:
3D mesh models created by human users and shared through online platforms and datasets flourish recently. While the creators generally have spent large efforts in modeling the visually appealing shapes with both large scale structures and intricate details, a majority of the meshes are unfortunately flawed in terms of having duplicate faces, mis-oriented regions, disconnected patches, etc., due to multiple factors involving both human errors and software inconsistencies. All these artifacts have severely limited the possible low-level and high-level processing tasks that can be applied to the rich datasets. In this work, we present a novel approach to fix these man-made meshes such that the outputs are guaranteed to be oriented manifold meshes that preserve the original structures, big and small, as much as possible. Our key observation is that the models all visually look meaningful, which leads to our strategy of repairing the flaws while always preserving the visual quality. We apply local refinements and removals only where necessary to achieve minimal intrusion of the original meshes, and global adjustments through robust optimization to ensure the outputs are valid manifold meshes with optimal connections. We test the approach on large-scale 3D datasets, and obtain quality meshes that are more readily usable for further geometry processing tasks.
References:
1. 2018. 3D Warehouse. https://3dwarehouse.sketchup.com. Accessed: 2018-12-14.Google Scholar
2. MOSEK ApS. 2018. The MOSEK Optimizer API for C. https://docs.mosek.com/8.1/capi/api-reference.htmlGoogle Scholar
3. Marco Attene. 2010. A Lightweight Approach to Repairing Digitized Polygon Meshes. Vis. Comput. 26, 11 (Nov. 2010), 14.Google ScholarDigital Library
4. Marco Attene. 2014. Direct Repair of Self-intersecting Meshes. Graph. Models 76, 6 (Nov. 2014), 658–668.Google ScholarDigital Library
5. Marco Attene. 2016. As-exact-as-possible repair of unprintable STL files. Rapid Prototyping Journal (05 2016).Google Scholar
6. Marco Attene. 2017. ImatiSTL – Fast and Reliable Mesh Processing with a Hybrid Kernel. In LNCS on Transactions on Computational Science. Springer, 86–96.Google Scholar
7. Marco Attene, Marcel Campen, and Leif Kobbelt. 2013. Polygon Mesh Repairing: An Application Perspective. ACM Comput. Surv. 45, 2, Article 15 (March 2013).Google Scholar
8. Gilbert Louis Bernstein and Chris Wojtan. 2013. Putting Holes in Holey Geometry: Topology Change for Arbitrary Surfaces. ACM Trans. Graph. (SIGGRAPH) 32, 4, Article 34 (July 2013), 12 pages.Google ScholarDigital Library
9. CGAL. 2018. CGAL, Computational Geometry Algorithms Library. https://www.cgal.org/.Google Scholar
10. Angel X. Chang, Thomas A. Funkhouser, Leonidas J. Guibas, Pat Hanrahan, Qi-Xing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, Jianxiong Xiao, Li Yi, and Fisher Yu. 2015. ShapeNet: An Information-Rich 3D Model Repository. CoRR abs/1512.03012 (2015). arXiv:1512.03012 http://arxiv.org/abs/1512.03012Google Scholar
11. Brian Curless and Marc Levoy. 1996. A Volumetric Method for Building Complex Models from Range Images. In SIGGRAPH ’96. ACM.Google ScholarDigital Library
12. H. Edelsbrunner and J. Harer. 2010. Computational Topology: An Introduction. American Mathematical Society.Google Scholar
13. Xiao-Ming Fu, Yang Liu, John Snyder, and Baining Guo. 2014. Anisotropic Simplicial Meshing Using Local Convex Functions. ACM Trans. Graph. (SIGGRAPH ASIA) 33, 6, Article 182 (Nov. 2014), 11 pages.Google Scholar
14. Ryo Furukawa, Tomoya Itano, Akihiko Morisaka, and Hiroshi Kawasaki. 2007. Improved Space Carving Method for Merging and Interpolating Multiple Range Images Using Information of Light Sources of Active Stereo. In ACCV. 206–216.Google Scholar
15. Michael Garland and Paul S. Heckbert. 1997. Surface Simplification Using Quadric Error Metrics. In SIGGRAPH ’97. 209–216.Google Scholar
16. Yotam Gingold and Denis Zorin. 2008. Shading-based Surface Editing. ACM Trans. Graph. (SIGGRAPH) 27, 3, Article 95 (Aug. 2008), 9 pages.Google ScholarDigital Library
17. André Guéziec, Gabriel Taubin, Francis Lazarus, and Bill Horn. 2001. Cutting and Stitching: Converting Sets of Polygons to Manifold Surfaces. IEEE Transactions on Visualization and Computer Graphics 7, 2 (April 2001), 136–151.Google ScholarDigital Library
18. Hugues Hoppe. 1996. Progressive Meshes. In SIGGRAPH ’96. ACM, 99–108.Google Scholar
19. Alexander Hornung and Leif Kobbelt. 2006. Robust Reconstruction of Watertight 3D Models from Non-uniformly Sampled Point Clouds Without Normal Information. In SGP.Google Scholar
20. Yixin Hu, Qingnan Zhou, Xifeng Gao, Alec Jacobson, Denis Zorin, and Daniele Panozzo. 2018. Tetrahedral Meshing in the Wild. ACM Trans. Graph. (SIGGRAPH) 37, 4, Article 60 (July 2018).Google ScholarDigital Library
21. Qixing Huang, Leonidas J. Guibas, and Niloy J. Mitra. 2014. Near-Regular Structure Discovery Using Linear Programming. ACM Trans. Graph. 33, 3, Article 23 (June 2014), 17 pages.Google ScholarDigital Library
22. Zhiyang Huang, Ming Zou, Nathan Carr, and Tao Ju. 2017. Topology-controlled Reconstruction of Multi-labelled Domains from Cross-sections. ACM Trans. Graph. (SIGGRAPH) 36, 4, Article 76 (July 2017), 12 pages.Google ScholarDigital Library
23. Alec Jacobson, Ladislav Kavan, and Olga Sorkine-Hornung. 2013. Robust Inside-Outside Segmentation using Generalized Winding Numbers. ACM Trans. Graph. (SIGGRAPH) 32, 4 (2013), 33:1–33:12.Google ScholarDigital Library
24. Alec Jacobson, Daniele Panozzo, et al. 2018. libigl: A simple C++ geometry processing library. http://libigl.github.io/libigl/.Google Scholar
25. Tao Ju. 2004. Robust Repair of Polygonal Models. ACM Trans. Graph. (SIGGRAPH) 23, 3 (2004).Google ScholarDigital Library
26. Tao Ju. 2009. Fixing Geometric Errors on Polygonal Models: A Survey. Journal of Computer Science and Technology 24, 1 (01 Jan 2009).Google ScholarDigital Library
27. Michael Kazhdan and Hugues Hoppe. 2013. Screened Poisson Surface Reconstruction. ACM Trans. Graph. 32, 3, Article 29 (July 2013), 13 pages.Google ScholarDigital Library
28. V. Kolmogorov. 2006. Convergent Tree-Reweighted Message Passing for Energy Minimization. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 10 (Oct 2006).Google ScholarDigital Library
29. V. Kolmogorov and R. Zabin. 2004. What energy functions can be minimized via graph cuts? IEEE Transactions on Pattern Analysis and Machine Intelligence 26, 2 (Feb 2004).Google ScholarDigital Library
30. Roee Lazar, Nadav Dym, Yam Kushinsky, Zhiyang Huang, Tao Ju, and Yaron Lipman. 2018. Robust Optimization for Topological Surface Reconstruction. ACM Trans. Graph. (SIGGRAPH) 37, 4, Article 46 (July 2018), 10 pages.Google ScholarDigital Library
31. Peter Lindstrom and Greg Turk. 2000. Image-driven Simplification. ACM Trans. Graph. 19, 3 (July 2000), 204–241.Google ScholarDigital Library
32. Hsueh-Ti Derek Liu, Michael Tao, and Alec Jacobson. 2018. Paparazzi: Surface Editing by way of Multi-View Image Processing. ACM Trans. Graph. (SIGGRAPH ASIA) (2018).Google Scholar
33. Haggai Maron, Meirav Galun, Noam Aigerman, Miri Trope, Nadav Dym, Ersin Yumer, Vladimir G. Kim, and Yaron Lipman. 2017. Convolutional Neural Networks on Surfaces via Seamless Toric Covers. ACM Trans. Graph. (SIGGRAPH) 36, 4, Article 71 (July 2017), 10 pages.Google ScholarDigital Library
34. Jonathan Masci, Davide Boscaini, Michael M. Bronstein, and Pierre Vandergheynst. 2015. Geodesic Convolutional Neural Networks on Riemannian Manifolds. IEEE ICCV (2015), 832–840.Google ScholarDigital Library
35. Kaichun Mo, Shilin Zhu, Angel Chang, Li Yi, Subarna Tripathi, Leonidas Guibas, and Hao Su. 2019. PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understanding. (2019).Google Scholar
36. T. M. Murali and Thomas A. Funkhouser. 1997. Consistent Solid and Boundary Representations from Arbitrary Polygonal Data. In 1997 Symposium on Interactive 3D Graphics. 155–162.Google Scholar
37. Fakir S. Nooruddin and Greg Turk. 2003. Simplification and Repair of Polygonal Models Using Volumetric Techniques. IEEE Transactions on Visualization and Computer Graphics 9, 2 (April 2003).Google ScholarDigital Library
38. Keunhong Park, Konstantinos Rematas, Ali Farhadi, and Steven Mm Seitz. 2018. PhotoShape: Photorealistic Materials for Large-Scale Shape Collections. ACM Trans. Graph. (SIGGRAPH ASIA) 37, 6, Article 192 (Nov. 2018).Google Scholar
39. Adrien Poulenard and Maks Ovsjanikov. 2018. Multi-directional Geodesic Neural Networks via Equivariant Convolution. ACM Trans. Graph. (SIGGRAPH ASIA) 37, 6, Article 236 (Dec. 2018), 14 pages.Google Scholar
40. Charles R Qi, Li Yi, Hao Su, and Leonidas J Guibas. 2017. PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. In NIPS.Google Scholar
41. Jarek Rossignac and David Cardoze. 1999. Matchmaker: Manifold BReps for Non-manifold R-sets. In Proceedings of the Fifth ACM Symposium on Solid Modeling and Applications (SMA ’99). ACM, 31–41.Google ScholarDigital Library
42. Thomas Windheuser, Ulrich Schlickewei, Frank R. Schmidt, and Daniel Cremers. 2011. Large-Scale Integer Linear Programming for Orientation Preserving 3D Shape Matching. Computer Graphics Forum (2011).Google Scholar
43. Zhirong Wu, S. Song, A. Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, and J. Xiao. 2015. 3D ShapeNets: A deep representation for volumetric shapes. In IEEE CVPR.Google Scholar
44. Eugene Zhang and Greg Turk. 2002. Visibility-guided Simplification. In Proceedings of the Conference on Visualization ’02 (VIS ’02). IEEE Computer Society, 8.Google ScholarDigital Library
45. Qingnan Zhou, Eitan Grinspun, Denis Zorin, and Alec Jacobson. 2016. Mesh Arrangements for Solid Geometry. ACM Trans. Graph. (SIGGRAPH) 35, 4 (2016).Google ScholarDigital Library
46. Qingnan Zhou and Alec Jacobson. 2016. Thingi10K: A Dataset of 10, 000 3D-Printing Models. CoRR abs/1605.04797 (2016). arXiv:1605.04797 http://arxiv.org/abs/1605.04797Google Scholar
47. Ming Zou, Michelle Holloway, Nathan Carr, and Tao Ju. 2015. Topology-constrained Surface Reconstruction from Cross-sections. ACM Trans. Graph. (SIGGRAPH) 34, 4, Article 128 (July 2015), 10 pages.Google ScholarDigital Library
