“Visibility-consistent thin surface reconstruction using multi-scale kernels”
Conference:
Type(s):
Title:
- Visibility-consistent thin surface reconstruction using multi-scale kernels
Session/Category Title: Volumes
Presenter(s)/Author(s):
Abstract:
One of the key properties of many surface reconstruction techniques is that they represent the volume in front of and behind the surface, e.g., using a variant of signed distance functions. This creates significant problems when reconstructing thin areas of an object since the backside interferes with the reconstruction of the front. We present a two-step technique that avoids this interference and thus imposes no constraints on object thickness. Our method first extracts an approximate surface crust and then iteratively refines the crust to yield the final surface mesh. To extract the crust, we use a novel observation-dependent kernel density estimation to robustly estimate the approximate surface location from the samples. Free space is similarly estimated from the samples’ visibility information. In the following refinement, we determine the remaining error using a surface-based kernel interpolation that limits the samples’ influence to nearby surface regions with similar orientation and iteratively move the surface towards its true location. We demonstrate our results on synthetic as well as real datasets reconstructed using multi-view stereo techniques or consumer depth sensors.
References:
1. Bart Adams and Martin Wicke. 2009. Meshless Approximation Methods and Applications in Physics Based Modeling and Animation. In Eurographics (Tutorials).
2. Fausto Bernardini, Joshua Mittleman, Holly Rushmeier, Claudio Silva, and Gabriel Taubin. 1999. The Ball-Pivoting Algorithm for Surface Reconstruction. IEEE TVCG 5, 4 (1999).
3. Fatih Calakli and Gabriel Taubin. 2011. SSD: Smooth Signed Distance Surface Reconstruction. CGF 30, 7 (2011).
4. Fatih Calakli and Gabriel Taubin. 2012. SSD-C: Smooth Signed Distance Colored Surface Reconstruction. In Expanding the Frontiers of Visual Analytics and Visualization.
5. Yang Chen and Gérard Medioni. 1995. Description of complex objects from multiple range images using an inflating balloon model. CVIU 61, 3 (1995).
6. Brian Curless and Marc Levoy. 1996. A Volumetric Method for Building Complex Models from Range Images. In SIGGRAPH.
7. Brian Lee Curless. 1997. New methods for Surface Reconstruction from Range Images. Dissertation. Stanford University.
8. Julie Digne, Jean-Michel Morel, Charyar-Mehdi Souzani, and Claire Lartigue. 2011. Scale space meshing of raw data point sets. In CGF, Vol. 30. Cross Ref
9. Simon Fuhrmann and Michael Goesele. 2011. Fusion of Depth Maps with Multiple Scales. ACM TOG 30, 6 (2011).
10. Simon Fuhrmann and Michael Goesele. 2014. Floating Scale Surface Reconstruction. ACM TOG 33, 4 (2014).
11. Simon Fuhrmann, Fabian Langguth, and Michael Goesele. 2014. MVE – A Multi-View Reconstruction Environment. In GCH, Vol. 6.
12. Hugues Hoppe, Tony DeRose, Tom Duchamp, John McDonald, and Werner Stuetzle. 1992. Surface Reconstruction from Unorganized Points. In SIGGRAPH.
13. Alexander Hornung and Leif Kobbelt. 2006. Robust Reconstruction of Watertight 3D Models from Non-uniformly Sampled Point Clouds Without Normal Information. In SGP.
14. Michal Jancosek and Tomás Pajdla. 2011. Multi-View Reconstruction Preserving Weakly-Supported Surfaces. In CVPR.
15. Michael Kass, Andrew Witkin, and Demetri Terzopoulos. 1988. Snakes: Active contour models. IJCV 1, 4 (1988).
16. Michael Kazhdan and Hugues Hoppe. 2013. Screened Poisson Surface Reconstruction. ACM TOG 32, 3 (2013).
17. Patrick Labatut, Jean-Philippe Pons, and Renaud Keriven. 2009. Robust and Efficient Surface Reconstruction from Range Data. In CGF, Vol. 28. Cross Ref
18. Paul Merrell, Amir Akbarzadeh, Liang Wang, Philippos Mordohai, Jan-Michael Frahm, Ruigang Yang, David Nistér, and Marc Pollefeys. 2007. Real-Time Visibility-Based Fusion of Depth Maps. In ICCV.
19. Patrick Mücke, Ronny Klowsky, and Michael Goesele. 2011. Surface Reconstruction from Multi-resolution Sample Points. In VMV.
20. Matthias Müller, David Charypar, and Markus Gross. 2003. Particle-based Fluid Simulation for Interactive Applications. In SCA.
21. Richard A. Newcombe, Shahram Izadi, Otmar Hilliges, David Molyneaux, David Kim, Andrew J. Davison, Pushmeet Kohli, Jamie Shotton, Steve Hodges, and Andrew Fitzgibbon. 2011. KinectFusion: Real-time Dense Surface Mapping and Tracking. In International Symposium on Mixed and Augmented Reality (ISMAR).
22. Yutaka Ohtake and Alexander G Belyaev. 2003. Dual-Primal Mesh Optimization for Polygonized Implicit Surfaces With Sharp Features. Journal of Computing and Information Science in Engineering 2, 4.
23. Nikolay Savinov, Christian Häne, L’ubor Ladický, and Marc Pollefeys. 2016. Semantic 3D Reconstruction with Continuous Regularization and Ray Potentials Using a Visibility Consistency Constraint. In CVPR.
24. Scott Schaefer and Joe Warren. 2004. Dual Marching Cubes: Primal Contouring of Dual Grids. In PG.
25. Steven M. Seitz, Brian Curless, James Diebel, Daniel Scharstein, and Richard Szeliski. 2006. A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms. In CVPR, Vol. 1.
26. Qi Shan, Brian Curless, Yasutaka Furukawa, Carlos Hernandez, and Steven Seitz. 2014. Occluding Contours for Multi-View Stereo. In CVPR.
27. Simon J Sheather and Michael Chris Jones. 1991. A reliable data-based bandwidth selection method for kernel density estimation. Journal of the Royal Statistical Society. Series B (Methodological). Cross Ref
28. J. Sturm, N. Engelhard, F. Endres, W. Burgard, and D. Cremers. 2012. A Benchmark for the Evaluation of RGB-D SLAM Systems. In IROS.
29. Gabriel Taubin. 1995. A Signal Processing Approach to Fair Surface Design. In SIGGRAPH.
30. George R. Terrell and David W. Scott. 1992. Variable Kernel Density Estimation. The Annals of Statistics 20, 3 (1992). Cross Ref
31. Greg Turk and Marc Levoy. 1994. Zippered Polygon Meshes from Range Images. In SIGGRAPH.
32. Benjamin Ummenhofer and Thomas Brox. 2013. Point-Based 3D reconstruction of thin objects. In ICCV.
33. Benjamin Ummenhofer and Thomas Brox. 2015. Global, Dense Multiscale Reconstruction for a Billion Points. In ICCV.
34. Hoang-Hiep Vu, Patrick Labatut, Jean-Philippe Pons, and Renaud Keriven. 2012. High Accuracy and Visibility-Consistent Dense Multiview Stereo. TPAMI 34, 5 (2012).
35. Ingo Wald, Sven Woop, Carsten Benthin, Gregory S. Johnson, and Manfred Ernst. 2014. Embree: A Kernel Framework for Efficient CPU Ray Tracing. ACM TOG 33, 4, Article 143.
36. Kaan Yücer, Changil Kim, Alexander Sorkine-Hornung, and Olga Sorkine-Hornung. 2016a. Depth from Gradients in Dense Light Fields for Object Reconstruction. In 3DV.
37. Kaan Yücer, Alexander Sorkine-Hornung, Oliver Wang, and Olga Sorkine-Hornung. 2016b. Efficient 3D Object Segmentation from Densely Sampled Light Fields with Applications to 3D Reconstruction. ACM TOG 35, 3 (2016).
