“On-the-fly multi-scale infinite texturing from example”
Conference:
Type(s):
Title:
- On-the-fly multi-scale infinite texturing from example
Session/Category Title: Fast, Cheap and Out-of-Core Rendering
Presenter(s)/Author(s):
Abstract:
In computer graphics, rendering visually detailed scenes is often achieved through texturing. We propose a method for on-the-fly non-periodic infinite texturing of surfaces based on a single image. Pattern repetition is avoided by defining patches within each texture whose content can be changed at runtime. In addition, we consistently manage multi-scale using one input image per represented scale. Undersampling artifacts are avoided by accounting for fine-scale features while colors are transferred between scales. Eventually, we allow for relief-enhanced rendering and provide a tool for intuitive creation of height maps. This is done using an ad-hoc local descriptor that measures feature self-similarity in order to propagate height values provided by the user for a few selected texels only.Thanks to the patch-based system, manipulated data are compact and our texturing approach is easy to implement on GPU. The multi-scale extension is capable of rendering finely detailed textures in real-time.
References:
1. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., and Susstrunk, S. 2012. Slic superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34, 11 (Nov.), 2274–2282.
2. Bosch, C., Laffont, P.-Y., Rushmeier, H., Dorsey, J., and Drettakis, G. 2011. Image-guided weathering: A new approach applied to flow phenomena. ACM Trans. Graph. 30, 3 (May), 20:1–20:13.
3. Bourque, E., and Dudek, G. 2004. Procedural texture matching and transformation. Comp. Graph. Forum 23, 3, 461–468.
4. Brooks, S., and Dodgson, N. 2002. Self-similarity based texture editing. In ACM SIGGRAPH 2002 papers, ACM, New York, NY, USA, 653–656.
5. Chen, Y., Tong, X., Wang, J., Lin, S., Guo, B., and Shum, H.-Y. 2004. Shell texture functions. In ACM SIGGRAPH 2004 Papers, ACM, New York, NY, USA, 343–353.
6. Cohen, M. F., Shade, J., Hiller, S., and Deussen, O. 2003. Wang tiles for image and texture generation. In ACM SIGGRAPH 2003 Papers, ACM, New York, NY, USA, 287–294.
7. Dischler, J.-M., Maritaud, K., and Ghazanfarpour, D. 2002. Coherent bump map recovery from a single texture image. In Proc. of Graphics Interface, 201–208.
8. Ebert, D. S., Musgrave, F. K., Peachey, D., Perlin, K., and Worley, S. 2002. Texturing and Modeling: A Procedural Approach, 3rd ed. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
9. Galerne, B., Lagae, A., Lefebvre, S., and Drettakis, G. 2012. Gabor noise by example. ACM Trans. Graph. 31, 4 (July), 73:1–73:9.
10. Gervautz, M., and Purgathofer, W. 1990. A simple method for color quantization: Octree quantization. In Graphics Gems, A. S. Glassner, Ed. Academic Press, 287–293.
11. Gilet, G., and Dischler, J.-M. 2010. Procedural descriptions of anisotropic noisy textures by example. In Eurographics 2010, Short Paper, Eurographics Association.
12. Han, C., Risser, E., Ramamoorthi, R., and Grinspun, E. 2008. Multiscale texture synthesis. In ACM SIGGRAPH 2008 papers, ACM, New York, NY, USA, 51:1–51:8.
13. Kopf, J., Cohen-Or, D., Deussen, O., and Lischinski, D. 2006. Recursive wang tiles for real-time blue noise. In ACM SIGGRAPH 2006 Papers, ACM, New York, NY, USA, 509–518.
14. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: image and video synthesis using graph cuts. In ACM SIGGRAPH 2003 Papers, ACM, New York, NY, USA, 277–286.
15. Lagae, A., and Dutré, P. 2005. A procedural object distribution function. ACM Trans. Graph. 24, 4 (Oct.), 1442–1461.
16. Lagae, A., and Dutré, P. 2006. An alternative for Wang tiles: Colored edges versus colored corners. ACM Trans. Graph. 25, 4 (Oct.), 1442–1459.
17. Laine, S., and Karras, T. 2010. Efficient sparse voxel octrees. In Proc. of the 2010 ACM SIGGRAPH symp. on Interactive 3D Graphics and Games, ACM, New York, NY, USA, 55–63.
18. Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. In ACM SIGGRAPH 2005 Papers, ACM, New York, NY, USA, 777–786.
19. Losasso, F., and Hoppe, H. 2004. Geometry clipmaps: terrain rendering using nested regular grids. In ACM SIGGRAPH 2004 Papers, ACM, New York, NY, USA, 769–776.
20. Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 2 (Nov.), 91–110.
21. Ma, W.-C., Jones, A., Chiang, J.-Y., Hawkins, T., Frederiksen, S., Peers, P., Vukovic, M., Ouhyoung, M., and Debevec, P. 2008. Facial performance synthesis using deformation-driven polynomial displacement maps. In ACM SIGGRAPH Asia 2008 papers, ACM, New York, NY, USA, 121:1–121:10.
22. Müller, P., Zeng, G., Wonka, P., and Van Gool, L. 2007. Image-based procedural modeling of facades. In ACM SIGGRAPH 2007 papers, ACM, New York, NY, USA, 85:1–85:9.
23. Omer, I., and Werman, M. 2004. Color lines: image specific color representation. In Proc. of the 2004 IEEE conf. on Computer Vision and Pattern Recognition, IEEE Computer Society, Washington, DC, USA, 946–953.
24. Perazzi, F., Krähenbühl, P., Pritch, Y., and Hornung, A. 2012. Saliency filters: Contrast based filtering for salient region detection. In Proc. of the 2012 IEEE conf. on Computer Vision and Pattern Recognition, IEEE Computer Society, Washington, DC, USA, 733–740.
25. Perlin, K. 1985. An image synthesizer. In ACM SIGGRAPH 1985 papers, ACM, New York, NY, USA, 287–296.
26. Policarpo, F., Oliveira, M. M., and Comba, J. a. L. D. 2005. Real-time relief mapping on arbitrary polygonal surfaces. In ACM SIGGRAPH 2005 Papers, ACM, New York, NY, USA, 935–935.
27. Tou, J. Y., Tay, Y. H., and Lau, P. Y. 2009. Recent trends in texture classification: a review. In Proc. of the 2009 symp. on Progress in Information and Communication Technology.
28. Treib, M., Reichl, F., Auer, S., and Westermann, R. 2012. Interactive editing of gigasample terrain fields. Comp. Graph. Forum 31, 2pt2 (May), 383–392.
29. Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics 2009, State of the Art Report, Eurographics Association.
30. Wu, H., Dorsey, J., and Rushmeier, H. 2011. Physically-based interactive bi-scale material design. In ACM SIGGRAPH Asia 2011 papers, ACM, New York, NY, USA, 145:1–145:10.
31. Zeng, G., Matsushita, Y., Quan, L., and Shum, H.-Y. 2005. Interactive shape from shading. In Proc. of the 2005 IEEE conf. on Computer Vision and Pattern Recognition, IEEE Computer Society, Washington, DC, USA, 343–350.
32. Zhang, R., Tsai, P.-S., Cryer, J. E., and Shah, M. 1999. Shape from shading: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 21, 8 (Aug.), 690–706.
