“Multiscale texture synthesis” by Han, Risser, Ramamoorthi and Grinspun

Example-based texture synthesis algorithms have gained widespread popularity for their ability to take a single input image and create a perceptually similar non-periodic texture. However, previous methods rely on single input exemplars that can capture only a limited band of spatial scales. For example, synthesizing a continent-like appearance at a variety of zoom levels would require an impractically high input resolution. In this paper, we develop a multiscale texture synthesis algorithm. We propose a novel example-based representation, which we call an exemplar graph, that simply requires a few low-resolution input exemplars at different scales. Moreover, by allowing loops in the graph, we can create infinite zooms and infinitely detailed textures that are impossible with current example-based methods. We also introduce a technique that ameliorates inconsistencies in the user’s input, and show that the application of this method yields improved interscale coherence and higher visual quality. We demonstrate optimizations for both CPU and GPU implementations of our method, and use them to produce animations with zooming and panning at multiple scales, as well as static gigapixel-sized images with features spanning many spatial scales.

1. Ashikhmin, M. 2001. Synthesizing natural textures. In SI3D, 217–226. Google ScholarDigital Library
2. Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., and Werman, M. 2001. Texture mixing and texture movie synthesis using statistical learning. IEEE TVCG 7, 2, 120–135. Google ScholarDigital Library
3. DeBonet, J. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. In SIGGRAPH, 361–368. Google ScholarDigital Library
4. Ebert, D. S., Musgrave, F. K., Peachey, D., Perlin, K., and Worley, S. 2003. Texturing and Modeling: A Procedural Approach. Morgan Kaufmann, San Francisco, CA. Google ScholarDigital Library
5. Efros, A., and Freeman, W. 2001. Image quilting for texture synthesis and transfer. In SIGGRAPH, 341–346. Google ScholarDigital Library
6. Efros, A., and Leung, T. 1999. Texture synthesis by non-parametric sampling. In ICCV, 1033–1038. Google ScholarDigital Library
7. Freeman, W. T., Jones, T. R., and Pasztor, E. C. 2001. Examplebased super-resolution. Tech. Rep. TR-2001-30, MERL.Google Scholar
8. Han, C., Sun, B., Ramamoorthi, R., and Grinspun, E. 2007. Frequency domain normal map filtering. In SIGGRAPH, 28. Google ScholarDigital Library
9. Heeger, D. J., and Bergen, J. R. 1995. Pyramid-based texture analysis/synthesis. In SIGGRAPH, 229–238. Google ScholarDigital Library
10. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In SIGGRAPH, 327–340. Google ScholarDigital Library
11. Kopf, J., Fu, C.-W., Cohen-Or, D., Deussen, O., Lischinski, D., and Wong, T.-T. 2007. Solid texture synthesis from 2d exemplars. In SIGGRAPH, 2. Google ScholarDigital Library
12. Kwatra, V., Schodl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. In SIGGRAPH, 277–286. Google ScholarDigital Library
13. Kwatra, V., Essa, I., Bobick, A. F., and Kwatra, N. 2005. Texture optimization for example-based synthesis. In SIGGRAPH, 795–802. Google ScholarDigital Library
14. Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. In SIGGRAPH, 777–786. Google ScholarDigital Library
15. Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. In SIGGRAPH, 541–548. Google ScholarDigital Library
16. Liang, L., Liu, C., Xu, Y., Guo, B., and Shum, H. 2001. Real-time texture synthesis by patch-based sampling. Tech. Rep. MSR-TR-2001-40, Microsoft Research.Google Scholar
17. Matusik, W., Zwicker, M., and Durand, F. 2005. Texture design using a simplicial complex of morphable textures. In SIGGRAPH, 787–794. Google ScholarDigital Library
18. Perlin, K. 1985. An image synthesizer. In SIGGRAPH, 287–296. Google ScholarDigital Library
19. Popat, K., and Picard, R. 1993. Novel cluster-based probability model for texture synthesis, classification, and compression. In SPIE VCIP, 756–768.Google Scholar
20. Portilla, J., and Simoncelli, E. 2000. A parametric texture model based on joint statistics of complex wavelet coefficients. IJCV 40, 1, 49–70. Google ScholarDigital Library
21. Praun, E., Finkelstein, A., and Hoppe, H. 2000. Lapped textures. In SIGGRAPH, 465–470. Google ScholarDigital Library
22. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. In SIGGRAPH, 665–672. Google ScholarDigital Library
23. Tonietto, L., and Walter, M. 2002. Towards local control for image-based texture synthesis. In SIBGRAPI, 252. Google ScholarDigital Library
24. Wei, L., and Levoy, M. 2000. Fast texture synthesis using treestructured vector quantization. In SIGGRAPH, 355–360. Google ScholarDigital Library
25. Wei, L., and Levoy, M. 2002. Order-independent texture synthesis. Tech. Rep. TR-2002-01, Stanford University CS Dept.Google Scholar
26. Wei, L.-Y. 2002. Texture synthesis by fixed neighborhood searching. PhD thesis, Stanford University. Google ScholarDigital Library
27. Wu, Q., and Yu, Y. 2004. Feature matching and deformation for texture synthesis. In SIGGRAPH, 364–367. Google ScholarDigital Library
28. Zalesny, A., Ferrari, V., Caenen, G., and Gool, L. V. 2005. Composite texture synthesis. IJCV 62, 1–2, 161–176. Google ScholarDigital Library
29. Zelinka, S., and Garland, M. 2002. Towards real-time texture synthesis with the jump map. In EGWR, 99–104. Google ScholarDigital Library
30. Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively-variant textures on arbitrary surfaces. In SIGGRAPH, 295–302. Google ScholarDigital Library