“Synthesis of progressively-variant textures on arbitrary surfaces” by Zhou, Zhang, Velho, Guo and Shum

We present an approach for decorating surfaces with progressively-variant textures. Unlike a homogeneous texture, a progressively-variant texture can model local texture variations, including the scale, orientation, color, and shape variations of texture elements. We describe techniques for modeling progressively-variant textures in 2D as well as for synthesizing them over surfaces. For 2D texture modeling, our feature-based warping technique allows the user to control the shape variations of texture elements, making it possible to capture complex texture variations such as those seen in animal coat patterns. In addition, our feature-based blending technique can create a smooth transition between two given homogeneous textures, with progressive changes of both shapes and colors of texture elements. For synthesizing textures over surfaces, the biggest challenge is that the synthesized texture elements tend to break apart as they progressively vary. To address this issue, we propose an algorithm based on texton masks, which mark most prominent texture elements in the 2D texture sample. By leveraging the power of texton masks, our algorithm can maintain the integrity of the synthesized texture elements on the target surface.

1. ASHIKHMIN, M. 2001. Synthesizing natural textures. ACM Symposium on Interactive 3D Graphics, 217–226. Google Scholar
2. BAR-JOSEPH, Z., EL-YANIV, R., LISCHINSKI, D., AND WERMAN, M. 2001. Texture mixing and texture movie synthesis using statistical learning. IEEE Transactions on Visualization and Computer Graphics 7, 2, 120–135. Google ScholarDigital Library
3. BEIER, T., AND NEELY, S. 1992. Feature-based image metamorphosis. Computer Graphics (Proceedings of SIGGRAPH 92) 26, 2 (July), 35–42. Google Scholar
4. BROOKS, S., AND DODGSON, N. 2002. Self-similarity based texture editing. ACM Tansactions on Graphics 21, 3 (July), 653–656. (Proceedings of ACM SIGGRAPH 2002). Google Scholar
5. DISCHLER, J., MARITAUD, K., LÉVY, B., AND GHAZANFARPOUR, D. 2002. Texture particles. Computer Graphics Forum 21, 3, 401–410.Google ScholarCross Ref
6. EFROS, A. A., AND FREEMAN, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 341–346. Google Scholar
7. EFROS, A. A., AND LEUNG, T. K. 1999. Texture synthesis by non-parametric sampling. In Proceedings of International Conference on Computer Vision. Google Scholar
8. GOMES, J., COSTA, B., DARSA, L., AND VELHO, L. 1998. Warping and Morphing of Graphics Objects. Morgan Kaufmann. Google Scholar
9. GORLA, G., INTERRANTE, V., AND SAPIRO, G. 2001. Growing fitted textures. SIGGRAPH 2001 Sketches and Applications (August), 191.Google Scholar
10. GUO, C., ZHU, S. C., AND WU, Y.-N. 2001. Visual learning by integrating descriptive and generative methods. In Proceedings of International Conference on Computer Vision (ICCV), 370–377.Google Scholar
11. HARRISON, P. 2001. A non-hierarchical procedure for synthesis of complex textures. I Proceedings of Winter School of Computer Graphics.Google Scholar
12. HERTZMANN, A., JACOBS, C. E., OLIVER, N., CURLESS, B., AND SALESIN, D. H. 2001. Image analogies. Proceedings of SIGGRAPH 2001 (August), 327–340. Google Scholar
13. KINGDON, J. 1977. East African Mammals, vol. III A. The University of Chicago Press.Google Scholar
14. LEUNG, T. K., AND MALIK, J. 1996. Detecting, localizing and grouping repeated scene elements from an image. In Proceedings of European Conference on Computer Vision. Google Scholar
15. LIANG, L., LIU, C., XU, Y., GUO, B., AND SHUM, H.-Y. 2001. Real-time texture synthesis using patch-based sampling. ACM Transactions on Graphics 20, 3 (July). Google ScholarDigital Library
16. LIU, Z., LIU, C., SHUM, H.-Y., AND YU, Y. 2002. Pattern-based texture metamorphosis. In Proceedings of Pacific Graphics, 184–191. Google Scholar
17. MALIK, J., BELONGIE, S., SHI, J., AND LEUNG, T. 1999. Textons, contours and regions: cue integration in image segmentation. In Proceedings of International Conference on Computer Vision (ICCV), 918–925. Google Scholar
18. MALLAT, S., PAPANICOLAOU, G., AND ZHANG, Z. 1998. Adaptive covariance estimation of locally stationary processes. Annals of Statistics 26, 1, 1–47.Google ScholarCross Ref
19. MALLAT, S. 2003. Personal communication.Google Scholar
20. PRAUN, E., FINKELSTEIN, A., AND HOPPE, H. 2000. Lapped textures. Proceedings of SIGGRAPH 2000 (July), 465–470. Google ScholarDigital Library
21. SOLER, C., CANI, M.-P., AND ANGELIDIS, A. 2002. Hierarchical pattern mapping. ACM Transactions on Graphics 21, 3 (July), 673–680. (Proceedings of ACM SGGRAPH 2002). Google ScholarDigital Library
22. SUZUKI, S., AND ABE, K. 1985. Topological structural analysis of digital binary images by border following. Computer Vision, Graphics, and Image Processing 30, 1, 32–46.Google ScholarCross Ref
23. TONG, X., ZHANG, J., LIU, L., WANG, X., GUO, B., AND SHUM, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Transactions on Graphics 21, 3 (July), 665–672. (Proceedings of ACM SIGGRAPH 2002). Google ScholarDigital Library
24. TONIETTO, L., AND WALTER, M. 2002. Towards local control for image-based texture synthesis. In Proceedings of SIBGRAPI 2002 – XV Brazilian Symposium on Computer Graphics and Image Processing. Google Scholar
25. TURK, G. 1991. Generating textures for arbitrary surfaces using reaction-diffusion. Computer Graphics (Proceedings of SIGGRAPH 91) 25, 4 (July), 289–298. Google Scholar
26. TURK, G. 2001. Texture synthesis on surfaces. Proceedings of SIGGRAPH 2001 (August), 347–354. Google Scholar
27. WALTER, M., FOURNIER, A., AND MENEVAUX, D. 2001. Integrating shape and pattern in mammalian models. Proceedings of SIGGRAPH 2001 (August), 317–326. Google Scholar
28. WEI, L.-Y., AND LEVOY, M. 2000. Fast texture synthesis using tree-structured vector quantization. Proceedings of SIGGRAPH 2000 (July), 479–488. Google ScholarDigital Library
29. WEI, L.-Y., AND LEVOY, M. 2001. Texture synthesis over arbitrary manifold surfaces. Proceedings of SIGGRAPH 2001 (August), 355–360. Google Scholar
30. WEI, L.-Y. 2001. Texture Synthesis by Fixed Neighborhood Searching. Ph.D. Dissertation, Stanford University. Google Scholar
31. WITKIN, A., AND KASS, M. 1991. Reaction-diffusion textures. Computer Graphics (Proceedings of SIGGRAPH 91) 25, 4 (July), 299–308. Google Scholar
32. YING, L., HERTZMANN, A., BIERMANN, H., AND ZORIN, D. 2001. Texture and shape synthesis on surfaces. Proceedings of 12th Eurographics Workshop on Rendering (June), 301–312. Google Scholar
33. ZALESNY, A., FERRARI, V., CAENEN, G., DER MAUR, D. A., AND GOOL, L. V. 2002. Composite texture descriptions. In Proceedings of ECCV, vol. 3, 341–346. Google ScholarDigital Library
34. ZHU, S., WU, Y., AND MUMFORD, D. 1998. Filters random fields and maximum entropy (frame). International Journal of Computer Vision 27, 2 (March), 107–126. Google ScholarCross Ref