“Context-Based Coherent Surface Completion” by Harary, Tal and Grinspun

  • ©Gur Harary, Ayellet Tal, and Eitan Grinspun

Conference:


Type:


Title:

    Context-Based Coherent Surface Completion

Session/Category Title: Surfaces, Deformation, and Correspondence


Presenter(s)/Author(s):


Moderator(s):



Abstract:


    We introduce an algorithm to synthesize missing geometry for a given triangle mesh that has “holes.” Similarly to previous work, the algorithm is context based in that it fills the hole by synthesizing geometry that is similar to the remainder of the input mesh. Our algorithm goes further to impose a coherence objective. A synthesis is coherent if every local neighborhood of the filled hole is similar to some local neighborhood of the input mesh. This requirement avoids undesired features such as can occur in context-based completion. We demonstrate the algorithm’s ability to fill holes that were difficult or impossible to fill in a compelling manner by earlier approaches.

References:


    1. G. H. Bendels, 2007. Methods for 3D geometry processing in the cultural heritage domain. Ph.D. Dissertation, University of Bonn.
    2. G. H. Bendels, R. Schnabel, and R. Klein. 2005. Detail-preserving surface inpainting. In Proceedings of the 6th International Conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage (VAST’05). 41–48.
    3. S. Bischoff, D. Pavic, and L. Kobbelt. 2005. Automatic restoration of polygon models. ACM Trans. Graph. 24, 4, 1332–1352.
    4. J. Branch, F. Prieto, and P. Boulanger. 2006. A hole-filling algorithm for triangular meshes using local radial basis function. In Proceedings of the 3rd International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT’06). 727–734.
    5. T. P. Breckon and R. B. Fisher. 2005. Non-parametric 3D surface completion. In Proceedings of the 5th International Conference on 3-D Digital Imaging and Modeling (3DIM’05). 573–580.
    6. C. Y. Chen and K. Y. Cheng. 2008. A sharpness-dependent filter for recovering sharp features in repaired 3D mesh models. IEEE Trans. Vis. Comput. Graph. 14, 1, 200–212.
    7. U. Clarenz, U. Diewald, G. Dziuk, M. Rumpf, and R. Rusu. 2004. A finite element method for surface restoration with smooth boundary conditions. Comput. Aid. Geom. Des. 21, 5, 427–445.
    8. J. Davis, S. R. Marschner, M. Garr, and M. Levoy. 2002. Filling holes in complex surfaces using volumetric diffusion. In Proceedings of the 1st International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT’02). 428–441.
    9. A. P. Dempster, N. M. Laird, and D. B. Rubin. 1977. Maximum likelihood from incomplete data via the em algorithm. J. Royal Statist. Soc. Series B 39, 1, 1–38.
    10. A. A. Efros and T. K. Leung. 1999. Texture synthesis by non-parametric sampling. In Proceedings of the IEEE International Conference on Computer Vision (ICCV’99), vol. 2. 1033–1038.
    11. M. Fisher, P. Schröder, M. Desbrun, and H. Hoppe. 2007. Design of tangent vector fields. ACM Trans. Graph. 26, 3, 1–9.
    12. R. Gal, A. Shamir, T. Hassner, M. Pauly, and D. Cohen-Or. 2007. Surface reconstruction using local shape priors. In Proceedings of the 5th Eurographics Symposium on Geometry Processing (SGP’07). 253–262.
    13. M. Garland and P. S. Heckbert. 1997. Surface simplification using quadric error metrics. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’97). 209–216.
    14. T. Q. Guo, J. J. Li, J. G. Weng, and Y. T. Zhuang. 2006. Filling holes in complex surfaces using oriented voxel diffusion. In Proceedings of the International Conference on Machine Learning and Cybernetics. 4370–4375.
    15. P. Heider, A. Pierre-Pierre, R. Li, and C. Grimm. 2011. Local shape descriptors, a survey and evaluation. In Proceedings of the 4th Eurographics Conference on 3D Object Retrieval (3DOR’11). 49–56.
    16. A. E. Johnson and M. Hebert. 1999. Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Trans. Pattern Anal. Mach. Intell. 21, 5, 433–449.
    17. T. Ju. 2004. Robust repair of polygonal models. ACM Trans. Graph. 23, 3, 888–895.
    18. T. Ju. 2009. Fixing geometric errors on polygonal models: A survey. J. Comput. Sci. Technol. 24, 1, 19–29.
    19. J. J. Koenderink and A. J. van Doorn. 1992. Surface shape and curvature scales. Image Vis. Comput. 10, 8, 557–564.
    20. M. Kolomenkin, I. Shimshoni, and A. Tal. 2011. Prominent field for shape processing and analysis of archaeological artifacts. Int. J. Comput. Vis. 94, 1, 89–100.
    21. J. Kopf, C. W. Fu, D. Cohen-Or, O. Deussen, D. Lischinski, and T. T. Wong. 2007. Solid texture synthesis from 2D exemplars. ACM Trans. Graph. 26, 3, 1–9.
    22. V. Kraevoy and A. Sheffer. 2005. Template-based mesh completion. In Proceedings of the Symposium on Geometry Processing (SGP’05). 13–22.
    23. V. Kwatra, D. Adalsteinsson, T. Kim, N. Kwatra, M. Carlson, and M. C. Lin. 2007. Texturing fluids. IEEE Trans. Vis. Comput. Graph. 13, 5, 939–952.
    24. V. Kwatra, I. Essa, A. Bobick, and N. Kwatra. 2005. Texture optimization for example-based synthesis. ACM Trans. Graph. 24, 3, 795–802.
    25. G. Leifman and A. Tal. 2012. Mesh colorization. Comput. Graph. Forum 31, 2.
    26. P. Liepa. 2003. Filling holes in meshes. In Proceedings of the Eurographics/ACM SIGGRAPH Symposium on Geometry Processing (SGP’03). 200–205.
    27. M. Müller, B. Heidelberger, M. Teschner, and M. Gross. 2005. Meshless deformations based on shape matching. ACM Trans. Graph. 24, 3, 471–478.
    28. M. X. Nguyen, X. Yuan, and B. Chen. 2005. Geometry completion and detail generation by texture synthesis. Vis. Comput. 21, 8–10, 669–678.
    29. Y. Ohtake, A. Belyaev, M. Alexa, G. Turk, and H. P. Seidel. 2003. Multilevel partition of unity implicits. ACM Trans. Graph. 22, 3, 463–470.
    30. Y. Ohtake, A. Belyaev, and H. P. Seidel. 2004. Ridge-valley lines on meshes via implicit surface fitting. ACM Trans. Graph. 23, 3, 609–612.
    31. S. Park, X. Guo, H. Shin, and H. Qin. 2006. Surface completion for shape and appearance. Vis. Comput. 22, 3, 168–180.
    32. M. Pauly, N. J. Mitra, J. Giesen, M. Gross, and L. J. Guibas. 2005. Example based 3D scan completion. In Proceedings of the 3rd Eurographics Symposium on Geometry Processing (SGP’05).
    33. M. Pauly, N. J. Mitra, J. Wallner, H. Pottmann, and L. J. Guibas. 2008. Discovering structural regularity in 3D geometry. ACM Trans. Graph. 27, 3, 1–12.
    34. J. P. Pernot, G. Moraru, and P. Véron. 2006. Filling holes in meshes using a mechanical model to simulate the curvature variation minimization. Comput. Graph. 30, 6, 892–902.
    35. S. Rusinkiewicz and M. Levoy. 2001. Efficient variants of the icp algorithm. In Proceedings of the 3rd International Conference on 3D Digital Imaging and Modeling (3DIM’01). 145–152.
    36. A. Sharf, M. Alexa, and D. Cohen-Or. 2004. Context-based surface completion. ACM Trans. Graph. 23, 3, 878–887.
    37. D. Simakov, Y. Caspi, E. Shechtman, and M. Irani. 2008. Summarizing visual data using bidirectional similarity. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’08). 1–8.
    38. O. Sorkine and D. Cohen-Or. 2004. Least-squares meshes. In Proceedings of the International Conference on Shape Modeling and Applications (SMI’04). 191–199.
    39. J. Sun, M. Ovsjanikov, and L. Guibas. 2009. A concise and provably informative multi-scale signature based on heat diffusion. Comput. Graph. Forum 28, 5, 1383–1392.
    40. A. Vaxman, M. Ben-Chen, and C. Gotsman. 2010. A multi-resolution approach to heat kernels on discrete surfaces. ACM Trans. Graph. 29, 4, 1–10.
    41. J. Verdera, V. Caselles, M. Bertalmio, and G. Sapiro. 2003. Inpainting surface holes. In Proceedings of the International Conference on Image Processing (ICIP’03), vol. 2. 903–906.
    42. J. Wang and M. M. Oliveira. 2007. Filling holes on locally smooth surfaces reconstructed from point clouds. Image Vis. Comput. 25, 1, 103–113.
    43. Y. Wexler, E. Shechtman, and M. Irani. 2007. Space-time completion of video. IEEE Trans. Pattern Anal. Mach. Intell. 29, 3, 463–476.
    44. C. Xiao, W. Zheng, Y. Miao, Y. Zhao, and Q. Peng. 2007. A unified method for appearance and geometry completion of point set surfaces. Vis. Comput. 23, 6, 433–443.
    45. K. Xu, D. Cohen-Or, T. Ju, L. Liu, H. Zhang, S. Zhou, and Y. Xiong. 2009a. Feature-aligned shape texturing. ACM Trans. Graph. 28, 5, 108: 1–8.
    46. K. Xu, H. Zhang, A. Tagliasacchi, L. Liu, G. Li, M. Meng, and Y. Xiong. 2009b. Partial intrinsic reflectional symmetry of 3D shapes. ACM Trans. Graph. 28, 5, 138: 1–10.
    47. S. Xu, A. Georghiades, H. Rushmeier, J. Dorsey, and L. McMillan. 2006. Image guided geometry inference. In Proceedings of the 3rd International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT’06). 310–317.
    48. S. Zelinka and M. Garland. 2004. Similarity-based surface modelling using geodesic fans. In Proceedings of the Eurographics/ACM SIGGRAPH Symposium on Geometry Processing (SGP’04). 204–213.
    49. W. Zhao, S. Gao, and H. Lin. 2007. A robust hole-filling algorithm for triangular mesh. The Vis. Comput. 23, 12, 987–997.
    50. K. Zhou, X. Huang, X. Wang, Y. Tong, M. Desbrun, B. Guo, and H. Y. Shum. 2006. Mesh quilting for geometric texture synthesis. ACM Trans. Graph. 25, 3, 690–697.

ACM Digital Library Publication: