“By-example synthesis of architectural textures” by Lefebvre, Hornus and Lasram

Textures are often reused on different surfaces in large virtual environments. This leads to unpleasing stretch and cropping of features when textures contain architectural elements. Existing retargeting methods could adapt each texture to the size of their support surface, but this would imply storing a different image for each and every surface, saturating memory. Our new texture synthesis approach casts synthesis as a shortest path problem in a graph describing the space of images that can be synthesized. Each path in the graph describes how to form a new image by cutting strips of the source image and reassembling them in a different order. Only the paths describing the result need to be stored in memory: synthesized textures are reconstructed at rendering time. The user can control repetition of features, and may specify positional constraints. We demonstrate our approach on a variety of textures, from facades for large city rendering to structured textures commonly used in video games.

1. Avidan, S., and Shamir, A. 2007. Seam carving for content-aware image resizing. ACM Transactions on Graphics (Proc. ACM SIGGRAPH) 26, 3. Google ScholarDigital Library
2. Barnes, C., Shechtman, E., Finkelstein, A., and Goldman, D. B. 2009. PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics (Proc. ACM SIGGRAPH) 28, 3. Google ScholarDigital Library
3. Cabral, M., Lefebvre, S., Dachsbacher, C., and Drettakis, G. 2009. Structure preserving reshape for textured architectural scenes. Computer Graphics Forum (Proc. Eurographics conference) 28, 2.Google Scholar
4. Cho, T. S., Butman, M., Avidan, S., and Freeman, W. T. 2008. The patch transform and its applications to image editing. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
5. Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proc. ACM SIGGRAPH, 341–346. Google ScholarDigital Library
6. Gal, R., Sorkine, O., and Cohen-Or, D. 2006. Featureaware texturing. In Rendering Techniques, Proc. Eurographics Symposium on Rendering, 297–303. Google ScholarDigital Library
7. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics (Proc. ACM SIGGRAPH) 22, 3. Google ScholarDigital Library
8. Lefebvre, L., and Poulin, P. 2000. Analysis and synthesis of structural textures. In Proc. Graphics Interface (GI), 77–86.Google Scholar
9. Legakis, J., Dorsey, J., and Gortler, S. 2001. Feature-based cellular texturing for architectural models. In Proc. ACM SIGGRAPH, 309–316. Google ScholarDigital Library
10. Müller, P., Zeng, G., Wonka, P., and Gool, L. V. 2007. Image-based procedural modeling of facades. ACM Transactions on Graphics (Proc. ACM SIGGRAPH) 26, 3. Google ScholarDigital Library
11. Pritch, Y., Kav-Venaki, E., and Peleg, S. 2009. Shift-map image editing. In Proc. IEEE International Conference on Computer Vision (ICCV).Google Scholar
12. Rubinstein, M., Shamir, A., and Avidan, S. 2009. Multioperator media retargeting. ACM Transactions on Graphics (Proc. ACM SIGGRAPH) 28, 3. Google ScholarDigital Library
13. Schödl, A., Szeliski, R., Salesin, D., and Essa, I. 2000. Video textures. In Proc. ACM SIGGRAPH, 489–498. Google ScholarDigital Library
14. Simakov, D., Caspi, Y., Shechtman, E., and Irani, M. 2008. Summarizing visual data using bidirectional similarity. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
15. Sun, J., Yuan, L., Jia, J., and Shum, H.-Y. 2005. Image completion with structure propagation. In Proc. ACM SIGGRAPH, 861–868. Google ScholarDigital Library
16. Teboul, O., Simon, L., Koutsourakis, P., and Paragios, N. 2010. Segmentation of building facades using procedural shape priors. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
17. Wang, Y.-S., Tai, C.-L., Sorkine, O., and Lee, T.-Y. 2008. Optimized scale-and-stretch for image resizing. ACM Transactions on Graphics (Proc. ACM SIGGRAPH Asia) 27, 5. Google ScholarDigital Library
18. Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics 2009, State of the Art Report, EG-STAR, Eurographics Association.Google Scholar
19. Worley, S. P. 1996. A cellular texturing basis function. In Proc. ACM SIGGRAPH, 291–294. Google ScholarDigital Library