“Pyramid-based texture analysis/synthesis” by Heeger and Bergen

This paper describes a method for synthesizing images that match the texture appearance of a given digitized sample. This synthesis is completely automatic and requires only the “target” texture as input. It allows generation of as much texture as desired so that any object can be covered. It can be used to produce solid textures for creating textured 3-d objects without the distortions inherent in texture mapping. It can also be used to synthesize texture mixtures, images that look a bit like each of several digitized samples. The approach is based on a model of human texture perception, and has potential to be a practically useful tool for graphics applications.

1. BENNIS, C., AND GAGALOWICZ, A. 2-D Macroscopic Texture Synthesis. Computer Graphics Forum 8 (1989), 291-300.
2. BERGEN, J.R. Theories of Visual Texture Perception. In Spatial Vision, D. Regan, Ed. CRC Press, 1991, pp. 114-133.
3. BERGEN, J. R., AND ADELSON, E. H. Early Vision and Texture Perception. Nature 333 (1988), 363-367.
4. BURY, P. Fast Filter Transforms for Image Processing. Computer Graphics and Image Processing 16 (1981), 20-51.
5. BURY, P. J., AND ADELSON, E. H. A Multiresolution Spline with Application to Image Mosaics. ACM Transactions on Graphics 2 (1983), 217-236.
6. CHELLAPPA, R., AND KASHYAP, R. L. Texture Synthesis Using 2-D Noncausal Autoregressive Models. IEEE Transactions on Acoustics, Speech, and Signal Processing 33 (1985), 194-203.
7. CHUBB, C., AND LANDY, M. S. Orthogonal Distribution Analysis: A New Approach to the Study of Texture Perception. In Computational Models of Visual Processing, M. S. Landy and J. A. Movshon, Eds. MIT Press, Cambridge, MA, 1991, pp. 291-301.
8. CROSS, G. C., AND JAIN, A. K. Markov Random Field Texture Models. IEEE Transactions on Pattern Analysis and Machine Intelligence 5 (1983), 25-39.
9. FOURNmR, A., FUSSEL, D., AND CARPENTER, L. Computer Rendering of Stochastic Models. Communications of the ACM 25 (1982), 371-384.
10. FRANCOS, J. M., MEIRI, A. Z., AND PORAT, B. A Unified Texture Model Based on a 2D Wold-Like Decomposition. IEEE Transactions on Signal Processing 41 (1993), 2665- 2678.
11. FREEMAN, W. T., AND ADELSON, E. U. The Design and Use of Steerable Filters. IEEE Transactions on Pattern Analysis and Machine Intelligence 13 (1991), 891-906.
12. GAGALOWICZ, A. Texture Modelling Applications. The Visual Compuwr 3 (1987), 186-200.
13. GAGALOWICZ, A., AND MA, S. D. Sequential Synthesis of Natural Textures. Computer Vision, Graphics, and Image Processing 30 (1985), 289-315.
14. HANRAHAN, P., AND HAEBERLI, P. Direct WYSIWYG Painting and Texturing of 3D Shapes. Proceedings of SIC- GRAPH 90. In Computer Graphics (1990), vol. 24, ACM SIGGRAPH, pp. 215-223.
15. HECKBERT, P. S. Survey of Texture Mapping. IEEE Computer Graphics and Applications 6 (1986), 56-67.
16. LANDY, M. S., AND BERGEN, J. R. Texture Segregation and Orientation Gradient. Vision Research 31 (1991), 679-691.
17. LEWIS, J.P. Texture Synthesis for Digital Painting. Proceedings of SIGGRAPH 84. In Computer Graphics (1984), vol. 18, ACM SIGGRAPH, pp. 245-252.
18. LEWIS, J.P. Generalized Stochastic Subdivision. ACM Transactions on Graphics 6 (1987), 167-190.
19. LEWIS, J.P. Algorithms for Solid Noise Synthesis. Proceedings of SIGGRAPH 89. In Computer Graphics (1989), vol. 23, ACM SIGGRAPH, pp. 263-270.
20. MALIK, J., AND PERONA, P. Preattentive Texture Discrimination with Early Vision Mechanisms. Journal of the Optical Society ofAmerica A 7 (1990), 923-931.
21. MALZBENDER, T., AND SPACH, S. A Context Sensitive Texture Nib. In Communicating with Virtual Worlds, N. M. Thalmann and D. Thalmann, Eds. Springer-Verlag, New York, 1993, pp. 151-163.
22. OGDEN, J. M., ADELSON, E. H., BERGEN, J. R., AND BURY, P. J. Pyramid-Based Computer Graphics. RCA Engineer 30 (1985), 4-15.
23. PEACHY, D. R. Solid Texturing of Complex Surfaces. Proceedings of SIGGRAPH 85. In Computer Graphics (1985), vol. 19, ACM SIGGRAPH, pp. 279-286.
24. PERLIN, K. An Image Synthesizer. Proceedings of SIG- GRAPH 85. In Computer Graphics (1985), vol. 19, ACM SIGGRAPH, pp. 287-296.
25. PERONA, P. Deformable Kernels for Early Vision. IEEE Transactions on Pattern Analysis and Machine Intelligence (1995). To appear May 1995.
26. POPAT, K., AND PICARD, R. W. Novel Cluster-Based Probability Model for Texture Synthesis, Classification, and Compression. In Proceedings of SPIE Visual Communications and Image Processing (1993), pp. 756-768.
27. RUDERMAN, D. L., AND BIALEK, W. Statistics of Natural Images: Scaling in the Woods. Physical Review Letters 73 (1994), 814-817.
28. SIMONCELLI, E. P., AND ADELSON, E. H. Subband Transforms. In Subband Image Coding, J. W. Woods, Ed. Kluwer Academic Publishers, Norwell, MA, 1990.
29. SIMONCELLI, E. P., FREEMAN, W. T., ADELSON, E. H., AND HEEGER, D.J. Shiftable Multi-Scale Transforms. IEEE Transactions on Information Theory, Special Issue on Wavelets 38 (1992), 587-607.
30. STRANG, G. Wavelets and Dilation Equations: A Brief Introduction. SIAM Review 31 (1989), 614-627.
31. TURK, G. Generating Textures on Arbitrary Surfaces Using Reaction-Diffusion. Proceedings of SIGGRAPH 91. In Computer Graphics (1991), vol. 25, ACM SIGGRAPH, pp. 289- 298.
32. TURNER, M. R. Texture Discrimination by Gabor Functions. Biological Cybernetics 55 (1986), 71-82.
33. WILLIAMS, L. Pyramidal Parametrics. Proceedings of SIC- GRAPH 83. In Computer Graphics (1983), vol. 17, ACM SIGGRAPH, pp. 1-11.
34. WITKIN, A., AND KASS, M. Reaction-Diffusion Textures. Proceedings of SIGGRAPH 91. In Computer Graphics (1991), vol. 25, ACM SIGGRAPH, pp. 299-308.