“Synthesizing structured image hybrids” by Risser, Han, Dahyot and Grinspun

Example-based texture synthesis algorithms generate novel texture images from example data. A popular hierarchical pixel-based approach uses spatial jitter to introduce diversity, at the risk of breaking coarse structure beyond repair. We propose a multiscale descriptor that enables appearance-space jitter, which retains structure. This idea enables repurposing of existing texture synthesis implementations for a qualitatively different problem statement and class of inputs: generating hybrids of structured images.

1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Transactions on Graphics 23, 3, 294–302. Google ScholarDigital Library
2. Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., and Werman, M. 2001. Texture mixing and texture movie synthesis using statistical learning. IEEE Transactions on Visualization and Computer Graphics 7, 2, 120–135. Google ScholarDigital Library
3. Barnes, C., Shechtman, E., Finkelstein, A., and Goldman, D. B. 2009. PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics 28, 3, 3:1–3:11. Google ScholarDigital Library
4. Cho, T. S., Butman, M., Avidan, S., and Freeman, W. T. 2008. The patch transform. In IEEE Conference on Computer Vision and Pattern Recognition.Google Scholar
5. DeBonet, J. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. In Proceedings of SIGGRAPH 1997, 361–368. Google ScholarDigital Library
6. Dischler, J.-M., and Zara, F. 2006. Real-time structured texture synthesis and editing using image-mesh analogies. The Visual Computer 22, 9, 926–935. Google ScholarDigital Library
7. Efros, A., and Leung, T. 1999. Texture synthesis by non-parametric sampling. In International Conference on Computer Vision, 1033–1038. Google ScholarDigital Library
8. Han, C., Risser, E., Ramamoorthi, R., and Grinspun, E. 2008. Multiscale texture synthesis. ACM Transactions on Graphics 27, 3, 51:1–51:8. Google ScholarDigital Library
9. Heeger, D. J., and Bergen, J. R. 1995. Pyramid-based texture analysis/synthesis. In Proceedings of SIGGRAPH 1995, 229–238. Google ScholarDigital Library
10. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In Proceedings of SIGGRAPH 2001, 327–340. Google ScholarDigital Library
11. Kopf, J., Fu, C.-W., Cohen-Or, D., Deussen, O., Lischinski, D., and Wong, T.-T. 2007. Solid texture synthesis from 2d exemplars. ACM Transactions on Graphics 26, 3, 2:2–2:9. Google ScholarDigital Library
12. Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. ACM Transactions on Graphics 24, 3, 777–786. Google ScholarDigital Library
13. Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. ACM Transactions on Graphics 25, 3, 541–548. Google ScholarDigital Library
14. Liu, Y., Lin, W.-C., and Hays, J. 2004. Near-regular texture analysis and manipulation. ACM Transactions on Graphics 23, 3, 368–376. Google ScholarDigital Library
15. Matusik, W., Zwicker, M., and Durand, F. 2005. Texture design using a simplicial complex of morphable textures. ACM Transactions on Graphics 24, 3, 787–794. Google ScholarDigital Library
16. Moghaddam, B., and Pentland, A. 1997. Probabilistic visual learning for object representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 7. Google ScholarDigital Library
17. Mohammed, U., Prince, S. J., and Kautz, J. 2009. Visio-lization: generating novel facial images. ACM Transactions on Graphics 28, 3, 57:1–57:8. Google ScholarDigital Library
18. Pitié, F., Kokaram, A. C., and Dahyot, R. 2007. Automated colour grading using colour distribution transfer. Computer Vision and Image Understanding 107, 1–2, 123–137. Google ScholarDigital Library
19. Portilla, J., and Simoncelli, E. 2000. A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision 40, 1, 49–70. Google ScholarDigital Library
20. Pritch, Y., Kav-Venaki, E., and Peleg, S. 2009. Shift-map image editing. In International Conference on Computer Vision, 151–158.Google Scholar
21. Ramanarayanan, G., and Bala, K. 2007. Constrained texture synthesis via energy minimization. IEEE Transactions on Visualization and Computer Graphics 13, 1, 167–178. Google ScholarDigital Library
22. Rosenberger, A., Cohen-Or, D., and Lischinski, D. 2009. Layered shape synthesis: automatic generation of control maps for non-stationary textures. ACM Transactions on Graphics 28, 5, 107:1–107:9. Google ScholarDigital Library
23. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Transactions on Graphics 21, 3, 665–672. Google ScholarDigital Library
24. Wei, L., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Proceedings of SIGGRAPH 2000, 355–360. Google ScholarDigital Library
25. Wei, L.-Y., Han, J., Zhou, K., Bao, H., Guo, B., and Shum, H.-Y. 2008. Inverse texture synthesis. ACM Transactions on Graphics 27, 3, 52:1–52:9. Google ScholarDigital Library
26. Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics 2009: State of the Art Reports.Google Scholar
27. Wu, Q., Shi, L., Bond, S., and Yu, Y. 2006. Laplacian texture synthesis and mixing on surfaces. In Pacific Graphics.Google Scholar
28. Zelinka, S., and Garland, M. 2002. Towards real-time texture synthesis with the jump map. In Eurographics Workshop on Rendering, 99–104. Google ScholarDigital Library
29. Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively-variant textures on arbitrary surfaces. ACM Transactions on Graphics 22, 3, 295–302. Google ScholarDigital Library