“Field-aligned online surface reconstruction” by Schertler, Tarini, Jakob, Kazhdan, Gumhold, et al. …
Conference:
Type(s):
Title:
- Field-aligned online surface reconstruction
Session/Category Title: Reconstructing 3D Surfaces From Points, Lines, Images & Water
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Today’s 3D scanning pipelines can be classified into two overarching categories: offline, high accuracy methods that rely on global optimization to reconstruct complex scenes with hundreds of millions of samples, and online methods that produce real-time but low-quality output, usually from structure-from-motion or depth sensors. The method proposed in this paper is the first to combine the benefits of both approaches, supporting online reconstruction of scenes with hundreds of millions of samples from high-resolution sensing modalities such as structured light or laser scanners. The key property of our algorithm is that it sidesteps the signed-distance computation of classical reconstruction techniques in favor of direct filtering, parametrization, and mesh and texture extraction. All of these steps can be realized using only weak notions of spatial neighborhoods, which allows for an implementation that scales approximately linearly with the size of each dataset that is integrated into a partial reconstruction. Combined, these algorithmic differences enable a drastically more efficient output-driven interactive scanning and reconstruction workflow, where the user is able to see the final quality field-aligned textured mesh during the entirety of the scanning procedure. Holes or parts with registration problems are displayed in real-time to the user and can be easily resolved by adding further localized scans, or by adjusting the input point cloud using our interactive editing tools with immediate visual feedback on the output mesh. We demonstrate the effectiveness of our algorithm in conjunction with a state-of-the-art structured light scanner and optical tracking system and test it on a large variety of challenging models.
References:
1. N. Amenta, S. Choi, and R. Kolluri. 2001. Power Crust. In ACM Symposium on Solid Modeling and Applications. 249–260. Google ScholarDigital Library
2. C. Bajaj, F. Bernardini, and G. Xu. 1995. Automatic Reconstruction of Surfaces and Scalar Fields from 3D Scans. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 1995). 109–18. Google ScholarDigital Library
3. Matthew Berger, Joshua A. Levine, Luis Gustavo Nonato, Gabriel Taubin, and Claudio T. Silva. 2013. A Benchmark for Surface Reconstruction. ACM Transactions on Graphics 32, 2 (2013), 20:1–20:17.Google ScholarDigital Library
4. Matthew Berger, Andrea Tagliasacchi, Lee M. Seversky, Pierre Alliez, Joshua A. Levine, Andrei Sharf, and Claudio T. Silva. 2014. State of the Art in Surface Reconstruction from Point Clouds. In Eurographics 2014 – State of the Art Reports, Sylvain Lefebvre and Michela Spagnuolo (Eds.). The Eurographics Association. Google ScholarCross Ref
5. F. Bernardini, J. Mittleman, H. Rushmeier, C. Silva, and G. Taubin. 1999. The Ball-Pivoting Algorithm for Surface Reconstruction. IEEE Transactions on Visualization and Computer Graphics 5 (1999), 349–359. Google ScholarDigital Library
6. J.D. Boissonnat and S. Oudot. 2005. Provably good sampling and meshing of surfaces. Graphical Models 67 (2005), 405–451. Google ScholarDigital Library
7. D. Bommes, B. LÃl’vy, N. Pietroni, E. Puppo, C. Silva, M. Tarini, and D. Zorin. 2012. State of the Art in Quad Meshing. In Eurographics STARS.Google Scholar
8. Dorit Borrmann and Andreas Nüchter. 2016. Robotic 3D Scan Repository. http://kos.informatik.uni-osnabrueck.de/3Dscans. (2016). http://kos.informatik.uni-osnabrueck.de/3DscansGoogle Scholar
9. Sofien Bouaziz, Andrea Tagliasacchi, and Mark Pauly. 2013. Sparse iterative closest point. In Computer graphics forum, Vol. 32. Wiley Online Library, 113–123. Google ScholarDigital Library
10. F. Calakli and G. Taubin. 2011. SSD: Smooth Signed Distance Surface Reconstruction. Computer Graphics Forum 30 (2011), 1993–2002. Google ScholarCross Ref
11. J. Carr, R. Beatson, H. Cherrie, T. Mitchell, W. Fright, B. McCallum, and T. Evans. 2001. Reconstruction and representation of 3D objects with radial basis functions. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 2001). 67–76. Google ScholarDigital Library
12. P Cignoni, G Ranzuglia, M Callieri, M Corsini, F Ganovelli, N Pietroni, and M Tarini. 2011. MeshLab. http://www.meshlab.org/. (2011).Google Scholar
13. B. Curless and M. Levoy. 1996. A Volumetric Method for Building Complex Models from Range Images. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 1996). 303–312. Google ScholarDigital Library
14. T. Dey and S. Goswami. 2003. Tight Cocone: A Water-tight Surface Reconstructor. In Proceedings of the Symposium on Solid Modeling and Applications. 127–134. Google ScholarDigital Library
15. G. Dziuk. 1988. Finite elements for the Beltrami operator on arbitrary surfaces. In Partial Differential Equations and Calculus of Variations, Lecture Notes in Mathematics. Vol. 1357. 142–155. Google ScholarCross Ref
16. H. Edelsbrunner and E. Mücke. 1994. Three-dimensional Alpha Shapes. ACM Transactions on Graphics 13 (1994), 43–72. Google ScholarDigital Library
17. S. Fuhrmann and M. Goesele. 2014. Floating Scale Surface Reconstruction. ACM Transactions on Graphics 33 (2014), 46:1–46:11.Google ScholarDigital Library
18. H. Hoppe, T. DeRose, T. Duchamp, J. McDonald, and W. Stuetzle. 1992. Surface Reconstruction from unorganized points. In Proceedings of the Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 1992). 71–78. Google ScholarDigital Library
19. A. Hornung and L. Kobbelt. 2006. Robust reconstruction of watertight 3D models from non-uniformly sampled point clouds without normal information. In Symposium on Geometry Processing. 41–50.Google Scholar
20. Shahram Izadi, David Kim, Otmar Hilliges, David Molyneaux, Richard Newcombe, Pushmeet Kohli, Jamie Shotton, Steve Hodges, Dustin Freeman, Andrew Davison, and others. 2011. KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 559–568. Google ScholarDigital Library
21. Alec Jacobson, Ladislav Kavan, and Olga Sorkine-Hornung. 2013. Robust Inside-Outside Segmentation using Generalized Winding Numbers. ACM Transactions on Graphics (proceedings of ACM SIGGRAPH) 32, 4 (2013), 33:1–33:12.Google Scholar
22. Wenzel Jakob, Marco Tarini, Daniele Panozzo, and Olga Sorkine-Hornung. 2015. Instant Field-Aligned Meshes. ACM Transactions on Graphics (Proceedings of SIGGRAPH ASIA) 34, 6 (Nov. 2015). Google ScholarDigital Library
23. Michael Kazhdan. 2005. Reconstruction of Solid Models from Oriented Point Sets. In Proc. of the 3rd Eurographics Symp. on Geometry Processing (SGP ’05). Eurographics Association, Article 73. http://dl.acm.org/citation.cfm?id=1281920.1281931Google Scholar
24. Michael Kazhdan, Matthew Bolitho, and Hugues Hoppe. 2006. Poisson Surface Reconstruction. (2006), 61–70. http://dl.acm.org/citation.cfm?id=1281957.1281965Google Scholar
25. M. Kazhdan and H. Hoppe. 2013. Screened Poisson surface reconstruction. ACM Transactions on Graphics 32 (2013), 29:1–29:13.Google ScholarDigital Library
26. M. Kazhdan, A. Klein, K. Dalal, and H. Hoppe. 2007. Unconstrained Isosurface Extraction on Arbitrary Octrees. In Symposium on Geometry Processing. 125–133.Google Scholar
27. Leif Kobbelt, Jens Vorsatz, and Hans-Peter Seidel. 1999. Multiresolution Hierarchies on Unstructured Triangle Meshes. Comput. Geom. Theory Appl. 14, 1–3 (Nov. 1999), 5–24. Google ScholarDigital Library
28. R. Kolluri, J. Shewchuk, and J. O’Brien. 2004. Spectral Surface Reconstruction From Noise Point Clouds. In Symposium on Geometry Processing. 11–21.Google Scholar
29. P. Labatut, J.-P. Pons, and R. Keriven. 2009. Robust and efficient surface reconstruction from range data. Computer Graphics Forum 28 (2009), 2275–2290. Google ScholarCross Ref
30. Shengren Li, Lance Simons, Jagadeesh Bhaskar Pakaravoor, Fatemeh Abbasinejad, John D Owens, and Nina Amenta. 2012. kANN on the GPU with shifted sorting. In Proc. of the 4th ACM SIGGRAPH/Eurographics conf. on High-Performance Graphics. Eurographics Association, 39–47.Google Scholar
31. W. Lorensen and H. Cline. 1987. Marching Cubes: A High Resolution 3D Surface Reconstruction Algorithm. In Computer Graphics (Proceedings of SIGGRAPH 87). 163–169.Google Scholar
32. J. Manson, G. Petrova, and S. Schaefer. 2008. Streaming surface reconstruction using wavelets. In Symposium on Geometry Processing. 1411–1420. Google ScholarCross Ref
33. Microsoft. 2010. Kinect. https://developer.microsoft.com/en-us/windows/kinect. (2010).Google Scholar
34. Guy M Morton. 1966. A computer oriented geodetic data base and a new technique in file sequencing. International Business Machines Company New York.Google Scholar
35. P. Mullen, F. De Goes, M. Desbrun, D. Cohen-Steiner, and P. Alliez. 2010. Signing the Unsigned: Robust Surface Reconstruction from Raw Pointsets. Computer Graphics Forum 29 (2010), 1733–1741. Google ScholarCross Ref
36. Richard A. Newcombe, Shahram Izadi, Otmar Hilliges, David Molyneaux, David Kim, Andrew J. Davison, Pushmeet Kohli, Jamie Shotton, Steve Hodges, and Andrew Fitzgibbon. 2011. KinectFusion: Real-Time Dense Surface Mapping and Tracking. In Proceedings of IEEE ISMAR – 10th International Symposium on Mixed and Augmented Reality. IEEE, 127–136.Google ScholarDigital Library
37. Y. Ohtake, A. Belyaev, M. Alexa, G. Turk, and H. Seidel. 2003. Multi-level partition of unity implicits. ACM Transactions on Graphics 22 (2003), 463–470. Google ScholarDigital Library
38. Nico Pietroni, Marco Tarini, Olga Sorkine, and Denis Zorin. 2011. Global parametrization of range image sets. In ACM Transactions on Graphics (TOG), Vol. 30. ACM, 149. Google ScholarDigital Library
39. U. Pinkall and K. Polthier. 1993. Computing Discrete Minimal Surfaces and Their Conjugates. Experimental Mathematics 2 (1993), 15–36. Google ScholarCross Ref
40. J. Podolak and S. Rusinkiewicz. 2005. Atomic volumes for mesh completion. In Symposium on Geometry Processing. 33–41.Google Scholar
41. Szymon Rusinkiewicz, Olaf Hall-Holt, and Marc Levoy. 2002. Real-time 3D Model Acquisition. ACM Trans. Graph. 21 (2002), 438–446. Google ScholarDigital Library
42. Szymon Rusinkiewicz and Marc Levoy. 2000. QSplat: A Multiresolution Point Rendering System for Large Meshes. In Proceedings of ACM SIGGRAPH 2000. 343–352. Google ScholarDigital Library
43. Henry Schäfer, Magdalena Prus, Quirin Meyer, Jochen Süßmuth, and Marc Stamminger. 2013. Multiresolution Attributes for Hardware Tessellated Objects. IEEE transactions on visualization and computer graphics 19, 9 (2013), 1488–1498. Google ScholarDigital Library
44. Gabriel Taubin. 1995. A Signal Processing Approach to Fair Surface Design. In Proceedings of the 22Nd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’95). ACM, New York, NY, USA, 351–358. Google ScholarDigital Library
45. Xinyi Fan, Linguang Zhang, Benedict Brown, and Szymon Rusinkiewicz. 2016. Automated View and Path Planning for Scalable Multi-Object 3D Scanning. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 35, 6 (nov 2016).Google ScholarDigital Library
46. Jonathan Palacios and Eugene Zhang. 2007. Rotational Symmetry Field Design on Surfaces. ACM Trans. Graph. (SIGGRAPH 2007) 26, 3, Article 55 (jul 2007). Google ScholarDigital Library
47. Shihao Wu, Wei Sun, Pinxin Long, Hui Huang, Daniel Cohen-Or, Minglun Gong, Oliver Deussen, and Baoquan Chen. 2014. Quality-driven Poisson-guided Autoscanning. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 33, 6, Article 203 (nov 2014), 12 pages. Google ScholarDigital Library
48. Amir Vaxman, Marcel Campen, Olga Diamanti, Daniele Panozzo, David Bommes, Klaus Hildebrandt, and Mirela Ben-Chen. 2016. Directional Field Synthesis, Design, and Processing. Computer Graphics Forum (2016), 15. http://graphics.tudelft.nl/Publications-new/2016/VCDPBHB16 Google ScholarDigital Library
49. Cem Yuksel, John Keyser, and Donald H House. 2010. Mesh colors. ACM Transactions on Graphics (TOG) 29, 2 (2010), 15.Google ScholarDigital Library
