“Texture synthesis over arbitrary manifold surfaces” by Wei and Levoy

Algorithms exist for synthesizing a wide variety of textures over rectangular domains. However, it remains difficult to synthesize general textures over arbitrary manifold surfaces. In this paper, we present a solution to this problem for surfaces defined by dense polygon meshes. Our solution extends Wei and Levoy’s texture synthesis method [25] by generalizing their definition of search neighborhoods. For each mesh vertex, we establish a local parameterization surrounding the vertex, use this parameterization to create a small rectangular neighborhood with the vertex at its center, and search a sample texture for similar neighborhoods. Our algorithm requires as input only a sample texture and a target model. Notably, it does not require specification of a global tangent vector field; it computes one as it goes – either randomly or via a relaxation process. Despite this, the synthesized texture contains no discontinuities, exhibits low distortion, and is perceived to be similar to the sample texture. We demonstrate that our solution is robust and is applicable to a wide range of textures.

1. M. Ashikhmin. Synthesizing natural textures. 2001 ACM Symposium on Interactive 3D Graphics, pages 217-226, March 2001. ISBN 1-58113-292-1.
2. P. Brodatz. Textures: A Photographic Album for Artists and Designers. Dover, New York, 1966.
3. P. Cignoni, C. Montani, C. Rocchini, R. Scopigno, and M. Tarini. Preserving attribute values on simplified meshes by resampling detail textures. The Visual Computer, 15(10):519-539, 1999. ISSN 0178-2789.
4. J. S. De Bonet. Multiresolution sampling procedure for analysis and synthesis of texture images. In T. Whitted, editor, SIGGRAPH 97 Conference Proceedings, Annual Conference Series, pages 361-368. ACMSIGGRAPH, Addison Wesley, Aug. 1997.
5. D. S. Ebert, F. K. Musgrave, D. Peachey, K. Perlin, and S. Worley. Texturing and Modeling: A Procedural Approach. Morgan Kaufmann Publishers, 1998.
6. A. Efros and T. Leung. Texture synthesis by non-parametric sampling. In International Conference on Computer Vision, volume 2, pages 1033-8, Sep 1999.
7. A. Gagalowicz and Song-Di-Ma. Model driven synthesis of natural textures for 3-D scenes. Computers and Graphics, 10(2):161-170, 1986.
8. D. Ghazanfarpour and J. Dischler. Generation of 3D texture using multiple 2D models analysis. Computer Graphics Forum, 15(3):311-324, Aug. 1996. Proceedings of Eurographics ’96. ISSN 1067-7055. 360
9. L. Guibas and J. Stolfi. Primitives for the manipulation of general subdivisions and computation of voronoi diagrams. ACM Transactions on Graphics, 4(2):74- 123, April 1985.
10. I. Guskov, W. Sweldens, and P. Schroder. Multiresolution signal processing for meshes. Proceedings of SIGGRAPH 99, pages 325-334, August 1999.
11. D. J. Heeger and J. R. Bergen. Pyramid-Based texture analysis/synthesis. In R. Cook, editor, SIGGRAPH 95 Conference Proceedings, Annual Conference Series, pages 229-238. ACM SIGGRAPH, Addison Wesley, Aug. 1995.
12. A. Hertzmann and D. Zorin. Illustrating smooth surfaces. Proceedings of SIG- GRAPH 2000, pages 517-526, July 2000. ISBN 1-58113-208-5.
13. M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S. Anderson, J. Davis, J. Ginsberg, J. Shade, and D. Fulk. The digital michelangelo project: 3d scanning of large statues. Proceedings of SIGGRAPH 2000, pages 131-144, 2000.
14. B. Levy and J.-L. Mallet. Non-distorted texture mapping for sheared triangulated meshes. Proceedings of SIGGRAPH 98, pages 343-352, July 1998.
15. J. Maillot, H. Yahia, and A. Verroust. Interactive texture mapping. In J. T. Kajiya, editor, Computer Graphics (SIGGRAPH ’93 Proceedings), volume 27, pages 27-34, Aug. 1993.
16. MIT Media Lab. Vision texture. http://www-white.media.mit.edu/vismod/- imagery/VisionTexture/vistex.html.
17. F. Neyret and M.-P. Cani. Pattern-based texturing revisited. Proceedings of SIGGRAPH 99, pages 235-242, August 1999.
18. H. K. Pedersen. Decorating implicit surfaces. Proceedings of SIGGRAPH 95, pages 291-300, August 1995.
19. K. Popat and R. Picard. Novel cluster-based probability model for texture synthesis, classification, and compression. In Visual Communications and Image Processing, pages 756-68, 1993.
20. E. Praun, A. Finkelstein, and H. Hoppe. Lapped textures. Proceedings of SIG- GRAPH 2000, pages 465-470, July 2000.
21. P. Schroder and W. Sweldens. Spherical wavelets: Efficiently representing functions on the sphere. Proceedings of SIGGRAPH 95, pages 161-172, August 1995.
22. E. Simoncelli and J. Portilla. Texture characterization via joint statistics of wavelet coefficient magnitudes. In Fifth International Conference on Image Processing, volume 1, pages 62-66, Oct. 1998.
23. G. Turk. Re-tiling polygonal surfaces. Computer Graphics (Proceedings of SIGGRAPH 92), 26(2):55-64, July 1992.
24. G. Turk. Texture synthesis on surfaces. Proceedings of SIGGRAPH 2001, August 2001.
25. L.-Y. Wei and M. Levoy. Fast texture synthesis using tree-structured vector quantization. Proceedings of SIGGRAPH 2000, pages 479-488, July 2000.