“Deep points consolidation” by Wu, Huang, Gong, Zwicker and Cohen-Or
Conference:
Type(s):
Title:
- Deep points consolidation
Session/Category Title: 3D Scanning
Presenter(s)/Author(s):
Abstract:
In this paper, we present a consolidation method that is based on a new representation of 3D point sets. The key idea is to augment each surface point into a deep point by associating it with an inner point that resides on the meso-skeleton, which consists of a mixture of skeletal curves and sheets. The deep points representation is a result of a joint optimization applied to both ends of the deep points. The optimization objective is to fairly distribute the end points across the surface and the meso-skeleton, such that the deep point orientations agree with the surface normals. The optimization converges where the inner points form a coherent meso-skeleton, and the surface points are consolidated with the missing regions completed. The strength of this new representation stems from the fact that it is comprised of both local and non-local geometric information. We demonstrate the advantages of the deep points consolidation technique by employing it to consolidate and complete noisy point-sampled geometry with large missing parts.
References:
1. Adamson, A., and Alexa, M. 2006. Point-sampled cell complexes. ACM Trans. on Graphics (Proc. of SIGGRAPH) 25, 3, 671–680.
2. Alexa, M., Behr, J., Cohen-Or, D., Fleishman, S., Levin, D., and Silva, C. T. 2001. Point set surfaces. Proc. IEEE Int. Conf. on Visualization, 21–28.
3. Amenta, N., Bern, M., and Kamvysselis, M. 1998. A new voronoi-based surface reconstruction algorithm. In Proc. of SIGGRAPH, 415–421.
4. Au, O. K.-C., Tai, C.-L., Chu, H.-K., Cohen-Or, D., and Lee, T.-Y. 2008. Skeleton extraction by mesh contraction. ACM Trans. on Graphics (Proc. of SIGGRAPH) 27, 3, 44:1–44:10.
5. Avron, H., Sharf, A., Greif, C., and Cohen-Or, D. 2010. l1-sparse reconstruction of sharp point set surfaces. ACM Trans. on Graphics 29, 5, 135:1–135:12.
6. Berger, M., Levine, J. A., Nonato, L. G., Taubin, G., and Silva, C. T. 2013. A benchmark for surface reconstruction. ACM Trans. on Graphics (Proc. of SIGGRAPH) 32, 2, 20:1–20:17.
7. Berger, M., Tagliasacchi, A., Seversky, L. M., Alliez, P., Levine, J. A., Sharf, A., and Silva, C. 2014. State of the art in surface reconstruction from point clouds. Eurographics STAR, 165–185.
8. Bucksch, A., Lindenbergh, R., and Menenti, M. 2010. Skeltre: Robust skeleton extraction from imperfect point clouds. The Visual Computer 26, 10, 1283–1300.
9. Calderon, S., and Boubekeur, T. 2014. Point morphology. ACM Trans. on Graphics (Proc. of SIGGRAPH) 33, 4, 45:1–45:13.
10. Cao, J., Tagliasacchi, A., Olson, M., Zhang, H., and Su, Z. 2010. Point cloud skeletons via laplacian based contraction. Proc. IEEE Int. Conf. on Shape Modeling & Applications, 187–197.
11. Carr, J. C., Beatson, R. K., Cherrie, J. B., Mitchell, T. J., Fright, W. R., McCallum, B. C., and Evans, T. R. 2001. Reconstruction and representation of 3D objects with radial basis functions. Proc. of SIGGRAPH, 67–76.
12. Cohen, L. D., and Cohen, I. 1991. Finite element methods for active contour models and balloons for 2d and 3d images. IEEE Trans. Pattern Analysis & Machine Intelligence 15, 1131–1147.
13. Davis, J., Marschner, S. R., Garr, M., and Levoy, M. 2002. Filling holes in complex surfaces using volumetric diffusion. In Proc. Int. Symp. on 3D Data Processing, Visualization and Transmission, 428–441.
14. Esteve, J., Brunet, P., and Vinacua, À. 2005. Computer Graphics Forum 24, 4, 791–807.
15. Guennebaud, G., and Gross, M. 2007. Algebraic point set surfaces. ACM Trans. on Graphics (Proc. of SIGGRAPH) 26, 3, 23.
16. Harary, G., Tal, A., and Grinspun, E. 2014. Context-based coherent surface completion. ACM Trans. on Graphics 33, 1, 5:1–5:12.
17. Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., and Stuetzle, W. 1992. Surface reconstruction from unorganized points. Proc. of SIGGRAPH, 71–78.
18. Huang, H., Li, D., Zhang, H., Ascher, U., and Cohen-Or, D. 2009. Consolidation of unorganized point clouds for surface reconstruction. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 28, 5, 176:1–176:7.
19. Huang, H., Wu, S., Gong, M., Cohen-Or, D., Ascher, U., and Zhang, H. 2013. Edge-aware point set resampling. ACM Trans. on Graphics 32, 1, 9:1–9:12.
20. Huang, H., Wu, S., Cohen-Or, D., Gong, M., Zhang, H., Li, G., and Chen, B. 2013. l1-medial skeleton of point cloud. ACM Trans. on Graphics (Proc. of SIGGRAPH) 32, 4, 65:1–65:8.
21. Kazhdan, M., and Hoppe, H. 2013. Screened poisson surface reconstruction. ACM Trans. on Graphics 32, 1, 29:1–29:13.
22. Kazhdan, M., Bolitho, M., and Hoppe, H. 2006. Poisson surface reconstruction. Proc. Eurographics Symp. on Geometry Processing, 61–70.
23. Lange, C., and Polthier, K. 2005. Anisotropic smoothing of point sets. Computer Aided Geometric Design 22, 7, 680–692.
24. Li, G., Liu, L., Zheng, H., and Mitra, N. J. 2010. Analysis, reconstruction and manipulation using arterial snakes. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 29, 5, 152:1–152:10.
25. Li, Y., Wu, X., Chrysathou, Y., Sharf, A., Cohen-Or, D., and Mitra, N. J. 2011. Globfit: Consistently fitting primitives by discovering global relations. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 30, 4, 52.
26. Lipman, Y., Cohen-Or, D., Levin, D., and Tal-Ezer, H. 2007. Parameterization-free projection for geometry reconstruction. ACM Trans. on Graphics (Proc. of SIGGRAPH) 26, 3, 22:1–22:6.
27. Livny, Y., Yan, F., Olson, M., Chen, B., Zhang, H., and El-Sana, J. 2010. Automatic reconstruction of tree skeletal structures from point clouds. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 29, 6, 151:1–151:8.
28. Miklos, B., Giesen, J., and Pauly, M. 2010. Discrete scale axis representations for 3D geometry. ACM Trans. on Graphics (Proc. of SIGGRAPH) 29, 4 (July), 101:1–101:10.
29. Natali, M., Biasotti, S., Patan, G., and Falcidieno, B. 2011. Graph-based representations of point clouds. Graphical Models 73, 151–164.
30. NIST. 2015. Range scans based 3D shape retrieval dataset. http://www.itl.nist.gov/iad/vug/sharp/contest/2015/Range/.
31. Öztireli, C., Guennebaud, G., and Gross, M. 2009. Feature preserving point set surfaces based on non-linear kernel regression. Computer Graphics Forum (Proc. of Eurographics) 28, 2, 493–501.
32. Pauly, M., Mitra, N. J., Wallner, J., Pottmann, H., and Guibas, L. J. 2008. Discovering structural regularity in 3D geometry. In ACM Trans. on Graphics (Proc. of SIGGRAPH), vol. 27, 43:1–43:11.
33. Preiner, R., Mattausch, O., Arikan, M., Pajarola, R., and Wimmer, M. 2014. Continuous projection for fast l1 reconstruction. ACM Trans. on Graphics (Proc. of SIGGRAPH) 33, 4, 47:1–47:13.
34. Seversky, L. M., and Yin, L. 2012. A global parity measure for incomplete point cloud data. In Computer Graphics Forum (Proc. Pacific Conf. on Computer Graphics & Applications), vol. 31, 2097–2106.
35. Sharf, A., Alexa, M., and Cohen-Or, D. 2004. Context-based surface completion. ACM Trans. on Graphics (Proc. of SIGGRAPH) 23, 3, 878–887.
36. Sharf, A., Lewiner, T., Shamir, A., and Kobbelt, L. 2007. On-the-fly curve-skeleton computation for 3D shapes. Computer Graphics Forum 26, 323–328.
37. Sharf, A., Lewiner, T., Shklarski, G., Toledo, S., and Cohen-Or, D. 2007. Interactive topology-aware surface reconstruction. ACM Trans. on Graphics (Proc. of SIGGRAPH) 26, 3, 43:1–43:9.
38. Tagliasacchi, A., Zhang, H., and Cohen-Or, D. 2009. Curve skeleton extraction from incomplete point cloud. ACM Trans. on Graphics (Proc. of SIGGRAPH) 28, 3, 79:1–79:9.
39. Tagliasacchi, A., Olson, M., Zhang, H., Hamarneh, G., and Cohen-Or, D. 2011. Vase: Volume-aware surface evolution for surface reconstruction from incomplete point clouds. In Computer Graphics Forum (Proc. Eurographics Symp. on Geometry Processing), vol. 30, 1563–1571.
40. Tagliasacchi, A., Alhashim, I., Olson, M., and Zhang, H. 2012. Mean curvature skeletons. Computer Graphics Forum (Proc. Eurographics Symp. on Geometry Processing) 31, 5, 1735–1744.
41. Turk, G., and Levoy, M. 1994. Zippered polygon meshes from range images. In Proc. of SIGGRAPH, 311–318.
42. Wu, S., Sun, W., Long, P., Huang, H., Cohen-Or, D., Gong, M., Deussen, O., and Chen, B. 2014. Quality-driven poisson-guided autoscanning. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 33, 6, 203:1–203:12.
43. Yin, K., Huang, H., Gong, M., Lischinski, D., Cohen-Or, D., Ascher, U., and Chen, B. 2014. Morfit: Interactive surface reconstruction from incomplete point clouds with curve-driven topology and geometry control. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 33, 6, 202:1–202:12.
44. Zheng, Q., Sharf, A., Wan, G., Li, Y., Mitra, N. J., Chen, B., and Cohen-Or, D. 2010. Non-local scan consolidation for 3D urban scene. ACM Trans. on Graphics (Proc. of SIGGRAPH) 29, 94:1–94:10.
