“Mesh denoising via cascaded normal regression”
Conference:
Type(s):
Title:
- Mesh denoising via cascaded normal regression
Session/Category Title: Meshes & Fields
Presenter(s)/Author(s):
Abstract:
We present a data-driven approach for mesh denoising. Our key idea is to formulate the denoising process with cascaded non-linear regression functions and learn them from a set of noisy meshes and their ground-truth counterparts. Each regression function infers the normal of a denoised output mesh facet from geometry features extracted from its neighborhood facets on the input mesh and sends the result as the input of the next regression function. Specifically, we develop a filtered facet normal descriptor (FND) for modeling the geometry features around each facet on the noisy mesh and model a regression function with neural networks for mapping the FNDs to the facet normals of the denoised mesh. To handle meshes with different geometry features and reduce the training difficulty, we cluster the input mesh facets according to their FNDs and train neural networks for each cluster separately in an offline learning stage. At runtime, our method applies the learned cascaded regression functions to a noisy input mesh and reconstructs the denoised mesh from the output facet normals.Our method learns the non-linear denoising process from the training data and makes no specific assumptions about the noise distribution and geometry features in the input. The runtime denoising process is fully automatic for different input meshes. Our method can be easily adapted to meshes with arbitrary noise patterns by training a dedicated regression scheme with mesh data and the particular noise pattern. We evaluate our method on meshes with both synthetic and real scanned noise, and compare it to other mesh denoising algorithms. Results demonstrate that our method outperforms the state-of-the-art mesh denoising methods and successfully removes different kinds of noise for meshes with various geometry features.
References:
1. Adams, A., Baek, J., and Davis, M. A. 2010. Fast high-dimensional filtering using the permutohedral lattice. Comput. Graph. Forum (EG) 29, 2, 753–762. Cross Ref
2. Bajaj, C. L., and Xu, G. 2003. Anisotropic diffusion of surfaces and functions on surfaces. ACM Trans. Graph. 22, 1, 4–32.
3. Boulch, A., and Marlet, R. 2016. Deep learning for robust normal estimation in unstructured point clouds. Comput. Graph. Forum (SGP) 35, 5.
4. Burger, H., Schuler, C., and Harmeling, S. 2012. Image denoising: Can plain neural networks compete with BM3D? In CVPR, 2392–2399.
5. Cao, C., Hou, Q., and Zhou, K. 2014. Displaced dynamic expression regression for real-time facial tracking and animation. ACM Trans. Graph. (SIGGRAPH) 33, 4, 43:1–43:10.
6. Chen, D., Ren, S., Wei, Y., Cao, X., and Sun, J. 2014. Joint cascade face detection and alignment. In ECCV, 109–122.
7. Clarenz, U., Diewald, U., and Rumpf, M. 2000. Anisotropic geometric diffusion in surface processing. In Proc. of the conference on Visualization, 397–405.
8. Desbrun, M., Meyer, M., Schröder, P., and Barr, A. H. 1999. Implicit fairing of irregular meshes using diffusion and curvature flow. In SIGGRAPH, 317–324.
9. Diebel, J. R., Thrun, S., and Brünig, M. 2006. A Bayesian method for probable surface reconstruction and decimation. ACM Trans. Graph. 25, 1, 39–59.
10. Dollár, P., Welinder, P., and Perona, P. 2010. Cascaded pose regression. In CVPR, 1078–1085.
11. Fan, H., Yu, Y., and Peng, Q. 2010. Robust feature-preserving mesh denoising based on consistent subneighborhoods. IEEE. T. Vis. Comput. Gr. 16, 2, 312–324.
12. Fanello, S., Keskin, C., Kohli, P., Izadi, S., Shotton, J., Criminisi, A., Pattacini, U., and Paek, T. 2014. Filter forests for learning data-dependent convolutional kernels. In CVPR, 1709–1716.
13. Fleishman, S., Drori, I., and Cohen-Or, D. 2003. Bilateral mesh denoising. ACM Trans. Graph. (SIGGRAPH) 22, 3, 950–953.
14. He, L., and Schaefer, S. 2013. Mesh denoising via L0 minimization. ACM Trans. Graph. (SIGGRAPH) 32, 4, 64:1–64:8.
15. Hildebrandt, K., and Polthier, K. 2004. Anisotropic filtering of non-linear surface features. Comput. Graph. Forum (EG) 23, 3, 391–400. Cross Ref
16. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. 2011. KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, 559–568.
17. Johnson, A., and Hebert, M. 1999. Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Trans. Pattern Anal. Mach. Intell. 21, 5, 433–449.
18. Jones, T. R., Durand, F., and Desbrun, M. 2003. Non-iterative, feature-preserving mesh smoothing. ACM Trans. Graph. (SIGGRAPH) 22, 3, 943–949.
19. Kalantari, N. K., Bako, S., and Sen, P. 2015. A machine learning approach for filtering Monte Carlo noise. ACM Trans. Graph. (SIGGRAPH) 34, 4, 122:1–122:12.
20. Kalogerakis, E., Hertzmann, A., and Singh, K. 2010. Learning 3D mesh segmentation and labeling. ACM Trans. Graph. (SIGGRAPH) 29, 4, 102:1–102:12.
21. Kopf, J., Cohen, M. F., Lischinski, D., and Uyttendaele, M. 2007. Joint bilateral upsampling. ACM Trans. Graph. (SIGGRAPH) 26, 3, 96:1–96:5.
22. Lee, K.-W., and Wang, W.-P. 2005. Feature-preserving mesh denoising via bilateral normal filtering. In Ninth International Conference on Computer Aided Design and Computer Graphics.
23. Lee, D., Park, H., and Yoo, C. 2015. Face alignment using cascade Gaussian process regression trees. In CVPR, 4204–4212.
24. Lu, X., Deng, Z., , and Chen, W. 2016. A robust scheme for feature-preserving mesh denoising. IEEE. T. Vis. Comput. Gr. 22, 3, 1181–1194.
25. Maes, C., Fabry, T., Keustermans, J., Smeets, D., Suetens, P., and Vandermeulen, D. 2010. Feature detection on 3D face surfaces for pose normalisation and recognition. In Biometrics: Theory Applications and Systems (BTAS), 1–6.
26. Mallick, T., Das, P., and Majumdar, A. 2014. Characterizations of noise in Kinect depth images: A review. IEEE Sensors J. 14, 6, 1731–1740. Cross Ref
27. Moon, B., Carr, N., and Yoon, S. E. 2014. Adaptive rendering based on weighted local regression. ACM Trans. Graph. (SIGGRAPH) 33, 5, 170:1–170:14.
28. Moon, B., Iglesias-Guitian, J. A., Yoon, S.-E., and Mitchell, K. 2015. Adaptive rendering with linear predictions. ACM Trans. Graph. 34, 4, 121:1–121:11.
29. Nguyen, D., and Widrow, B. 1990. Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights. In Neural Networks, 1990., 1990 IJCNN International Joint Conference on, 21–26.
30. Sarbolandi, H., Lefloch, D., and Kolb, A. 2015. Kinect range sensing: structured-light versus time-of-flight Kinect. Journal of Computer Vision and Image Understanding 13, 1–20.
31. Schelten, K., Nowozin, S., Jancsary, J., Rother, C., and Roth, S. 2015. Interleaved regression tree field cascades for blind image deconvolution. In Applications of Computer Vision (WACV), 2015 IEEE Winter Conference on, 494–501.
32. Schmidt, U., Jancsary, J., Nowozin, S., Roth, S., and Rother, C. 2016. Cascades of regression tree fields for image restoration. IEEE Trans. Pattern Anal. Mach. Intell. 38, 4, 677–689.
33. Shen, Y., and Barner, K. 2004. Fuzzy vector median-based surface smoothing. IEEE. T. Vis. Comput. Gr. 10, 3, 252–265.
34. Solomon, J., Crane, K., Butscher, A., and Wojtan, C. 2014. A general framework for bilateral and mean shift filtering. arXiv:1405.4734 {cs.GR}.
35. Sun, X., Rosin, P. L., Martin, R. R., and Langbein, F. C. 2007. Fast and effective feature-preserving mesh denoising. IEEE. T. Vis. Comput. Gr. 13, 5, 925–938.
36. Sun, X., Rosin, P. L., Martin, R. R., and Langbein, F. C. 2009. Noise analysis and synthesis for 3D laser depth scanners. Graphical Models 71, 2, 34–48.
37. Sun, X., Wei, Y., Liang, S., Tang, X., and Sun, J. 2015. Cascaded hand pose regression. In CVPR, 824–832.
38. Tasdizen, T., Whitaker, R., Burchard, P., and Osher, S. 2002. Geometric surface smoothing via anisotropic diffusion of normals. In Proc. of the conference on Visualization, 125–132.
39. Taubin, G. 1995. A signal processing approach to fair surface design. In SIGGRAPH, 351–358.
40. Wang, R., Yang, Z., Liu, L., Deng, J., and Chen, F. 2014. Decoupling noise and features via weighted l1-analysis compressed sensing. ACM Trans. Graph. 33, 2, 18:1–18:12.
41. Wei, M., Yu, J., Pang, W.-M., Wang, J., Qin, J., Liu, L., and Heng, P.-A. 2015. Bi-normal filtering for mesh denoising. IEEE. T. Vis. Comput. Gr. 21, 1, 43–55. Cross Ref
42. Xu, L., Ren, J. S., Yan, Q., Liao, R., and Jia, J. 2015. Deep edge-aware filters. In ICML.
43. Yagou, H., Ohtake, Y., and Belyaev, A. 2002. Mesh smoothing via mean and median filtering applied to face normals. In Geom. Model. and Proc., 124–131.
44. Yagou, H., Ohtake, Y., and Belyaev, A. 2003. Mesh denoising via iterative alpha-trimming and nonlinear diffusion of normals with automatic thresholding. In Computer Graphics International, 28–33.
45. Zaharescu, A., Boyer, E., Varanasi, K., and Horaud, R. 2009. Surface feature detection and description with applications to mesh matching. In CVPR, 373–380.
46. Zhang, W., Deng, B., Zhang, J., Bouaziz, S., and Liu, L. 2015. Guided mesh normal filtering. Comput. Graph. Forum (PG) 34, 23–34.
47. Zheng, Y., Fu, H., Au, O. K.-C., and Tai, C.-L. 2011. Bilateral normal filtering for mesh denoising. IEEE. T. Vis. Comput. Gr. 17, 10, 1521–1530.
