“Texture design using a simplicial complex of morphable textures” by Matusik, Zwicker and Durand

We present a system for designing novel textures in the space of textures induced by an input database. We capture the structure of the induced space by a simplicial complex where vertices of the simplices represent input textures. A user can generate new textures by interpolating within individual simplices. We propose a morphable interpolation for textures, which also defines a metric used to build the simplicial complex. To guarantee sharpness in interpolated textures, we enforce histograms of high-frequency content using a novel method for histogram interpolation. We allow users to continuously navigate in the simplicial complex and design new textures using a simple and efficient user interface. We demonstrate the usefulness of our system by integrating it with a 3D texture painting application, where the user interactively designs desired textures.

1. Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., and Werman, M. 2001. Texture mixing and texture movie synthesis using statistical learning. IEEE Transactions on Visualization and Computer Graphics 7, 2, 120–135. Google ScholarDigital Library
2. Blanz, V., and Vetter, T. 1999. A morphable model for the synthesis of 3d faces. In Proceedings of SIGGRAPH 99, Annual Conference Series, 187–194. Google ScholarDigital Library
3. Bonet, J. S. D. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. In Proceedings of SIGGRAPH 97, Annual Conference Series, 361–368. Google ScholarDigital Library
4. Brooks, S., and Dodgson, N. 2002. Self-similarity based texture editing. In Proceedings of SIGGRAPH 2002, Annual Conference Series, 653–656. Google ScholarDigital Library
5. Dana, K. J., Van Ginneken, B., Nayar, S. K., and Koenderink, J. J. 1999. Reflectance and texture of real world surfaces. ACM Transactions on Graphics 1, 18, 1–34. Google ScholarDigital Library
6. Dorsey, J., Pedersen, H. K., and Hanrahan, P. M. 1996. Flow and changes in appearance. In Proceedings of SIGGRAPH 96, Annual Conference Series, 411–420. Google ScholarDigital Library
7. Dorsey, J., Edelman, A., Legakis, J., Jensen, H. W., and Pedersen, H. K. 1999. Modeling and rendering of weathered stone. In Proceedings of SIGGRAPH 99, Annual Conference Series, 225–234. Google ScholarDigital Library
8. Ebert, D., Musgrave, K., Peachey, D., Perlin, K., and Worley. 1994. Texturing and Modeling: A Procedural Approach. Academic Press, Oct. ISBN 0–12–228760-6. Google ScholarDigital Library
9. Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of ACM SIGGRAPH 2001, Annual Conference Series, 341–346. Google ScholarDigital Library
10. Efros, A. A., and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In International Conference on Computer Vision, 1033–1038. Google ScholarDigital Library
11. Giesen, J., and Wagner, U. 2003. Shape dimension and intrinsic metric from samples of manifolds with high co-dimension. In Symposium on Computational Geometry, 329–337. Google ScholarDigital Library
12. Gomes, J., and Mojsilovic, A. 2002. A variational approach to recovering a manifold from sample points. Lecture Notes in Computer Science 2351, 3–17. Google ScholarDigital Library
13. Heaps, C., and Handel, S. 1999. Similarity and features of natural textures. Journal of Experimental Psychology: Human Perception and Performance 25, 1–24.Google ScholarCross Ref
14. Heeger, D. J., and Bergen, J. R. 1995. Pyramid-based texture analysis/synthesis. In Proceedings of SIGGRAPH 95, Annual Conference Series, 229–238. Google ScholarDigital Library
15. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In Proceedings of SIGGRAPH 2001, Annual Conference Series, 327–340. Google ScholarDigital Library
16. Jojic, N., Frey, B., and Kannan, A. 2003. Epitomic analysis of appearance and shape. In ICCV, 34–41. Google ScholarDigital Library
17. Jones, M. J., and Poggio, T. 1998. Multidimensional morphable models. In ICCV, 683–688. Google ScholarDigital Library
18. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22, 3, 277–286. Google ScholarDigital Library
19. Liu, Z., Liu, C., Shum, H.-Y., and Yu, Y. 2002. Pattern-based texture metamorphosis. In PG ’02: Proceedings of the 10th Pacific Conference on Computer Graphics and Applications, 184–191. Google ScholarDigital Library
20. Liu, Y., Lin, W.-C., and Hays, J. H. 2004. Near regular texture analysis and manipulation. ACM Transactions on Graphics (SIGGRAPH 2004) 23, 3 (August), 368–376. Google ScholarDigital Library
21. Ngo, T., Cutrell, D., Dana, J., Donald, B., Loeb, L., and Zhu, S. 2000. Accessible animation and customizable graphics via simplicial configuration modeling. In Proceedings of ACM SIGGRAPH 2000, Annual Conference Series, 403–410. Google ScholarDigital Library
22. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. Graph. 22, 3, 313–318. Google ScholarDigital Library
23. Perlin, K. 1985. An image synthesizer. In Proceedings of SIGGRAPH 85, Annual Conference Series, 287–296. Google ScholarDigital Library
24. Peters, M. R. 2003. Multidimensional image morphs: construction and user interface. Master’s thesis, Massachusetts Institute of Technology.Google Scholar
25. Portilla, J., and Simoncelli, E. P. 2000. A parametric texture model based on joint statistics of complex wavelet coefficients. Int. Journal of Computer Vision 40, 1 (Oct.), 49–70. Google ScholarDigital Library
26. Richards, W., and Koenderink, J. J. 1995. Trajectory mapping (“TM”): A new non-metric scaling technique. Perception 24, 1315–1331.Google ScholarCross Ref
27. Roweis, S., and Saul, L. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290, 5500 (December), 2323–2326.Google ScholarCross Ref
28. Ruzon, M., and Tomasi, C. 2001. Edge, junction, and corner detection using color distributions. IEEE Trans. on Pattern Analysis and Machine Intelligence 23, 11 (November), 1281–1295. Google ScholarDigital Library
29. Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In Proceedings of SIGGRAPH 2000, Annual Conference Series, 489–498. Google ScholarDigital Library
30. Simoncelli, E. P., and Freeman, W. T. 1995. The steerable pyramid: a flexible architecture for multi-scale derivative computation. In Proceedings of the 1995 IEEE International Conference on Image Processing, 3444. Google ScholarDigital Library
31. Tenenbaum, J., De Silva, V., and Langford, J. 2000. A global geometric framework for nonlinear dimensionality reduction. Science 290, 5500 (December), 2319–2323.Google ScholarCross Ref
32. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Transactions on Graphics 21, 3 (July), 665–672. Google ScholarDigital Library
33. Walter, M., Fournier, A., and Menevaux, D. 2001. Integrating shape and pattern in mammalian models. In Proceedings of ACM SIGGRAPH 2001, Annual Conference Series, 317–326. Google ScholarDigital Library
34. Wei, L.-Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Proceedings of SIGGRAPH 2000, Annual Conference Series, 479–488. Google ScholarDigital Library
35. Wei, L.-Y. 2001. Texture Synthesis by Fixed Neighborhood Searching. PhD thesis, Stanford University. Google ScholarDigital Library
36. Wu, Q., and Yu, Y. 2004. Feature matching and deformation for texture synthesis. ACM Transactions on Graphics (SIGGRAPH 2004) 23, 3 (August), 362–365. Google ScholarDigital Library
37. Zelinka, S., and Garland, M. 2002. Towards real-time texture synthesis with the jump map. In Rendering Techniques 2002: 13th Eurographics Workshop on Rendering, 99–104. Google ScholarDigital Library
38. Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively variant textures on arbitrary surfaces. ACM Transactions on Graphics 22, 3 (July), 295–302. Google ScholarDigital Library
39. Zhu, C. S., Wu, Y., and Mumford, D. 1997. Minimax entropy principle and its application to texture modeling. Neural Computation 9, 8. Google ScholarDigital Library
40. Zhu, C. S., Wu, Y., and Mumford, D. 1998. Filters, random fields and maximum entropy (frame): Towards a unified theory for texture modeling. International Journal of Computer Vision 27, 2. Google ScholarDigital Library