“Discrete element textures”

A variety of phenomena can be characterized by repetitive small scale elements within a large scale domain. Examples include a stack of fresh produce, a plate of spaghetti, or a mosaic pattern. Although certain results can be produced via manual placement or procedural/physical simulation, these methods can be labor intensive, difficult to control, or limited to specific phenomena.We present discrete element textures, a data-driven method for synthesizing repetitive elements according to a small input exemplar and a large output domain. Our method preserves both individual element properties and their aggregate distributions. It is also general and applicable to a variety of phenomena, including different dimensionalities, different element properties and distributions, and different effects including both artistic and physically realistic ones. We represent each element by one or multiple samples whose positions encode relevant element attributes including position, size, shape, and orientation. We propose a sample-based neighborhood similarity metric and an energy optimization solver to synthesize desired outputs that observe not only input exemplars and output domains but also optional constraints such as physics, orientation fields, and boundary conditions. As a further benefit, our method can also be applied for editing existing element distributions.

1. Ahuja, N., and Todorovic, S. 2007. Extracting texels in 2.1D natural textures. ICCV 0, 1–8.Google Scholar
2. Barla, P., Breslav, S., Thollot, J., Sillion, F., and Markosian, L. 2006. Stroke pattern analysis and synthesis. In EUROGRAPH ’06, vol. 25, 663–671.Google Scholar
3. Bhat, P., Ingram, S., and Turk, G. 2004. Geometric texture synthesis by example. In SGP ’04, 41–44. Google Scholar
4. Brooks, S., and Dodgson, N. 2002. Self-similarity based texture editing. In SIGGRAPH ’02, 653–656. Google Scholar
5. Cheng, M.-M., Zhang, F.-L., Mitra, N. J., Huang, X., and Hu, S.-M. 2010. Repfinder: finding approximately repeated scene elements for image editing. In SIGGRAPH ’10, 83:1–8. Google Scholar
6. Cho, J. H., Xenakis, A., Gronsky, S., and Shah, A. 2007. Course 6: Anyone can cook: inside ratatouille’s kitchen. In SIGGRAPH 2007 Courses.Google Scholar
7. Coumans, E., 2009. Bullet physics engine. http://www.bulletphysics.com/.Google Scholar
8. Crane, K., Llamas, I., and Tariq, S. 2007. Real-Time Simulation and Rendering of 3D Fluids. In GPU Gems 3, H. Nguyen, Ed. Addison-Wesley Professional, ch. 30, 633–675.Google Scholar
9. Dischler, J., Maritaud, K., Lévy, B., and Ghazanfarpour, D. 2002. Texture particles. In EUROGRAPH ’02, vol. 21, 401–410.Google Scholar
10. Ebert, D. S., Musgrave, K. F., Peachey, D., Perlin, K., and Worley, S. 2002. Texturing & Modeling: A Procedural Approach. Morgan Kaufmann. Google Scholar
11. Efros, A. A., and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In ICCV ’99, 1033–1038. Google ScholarDigital Library
12. Fleischer, K. W., Laidlaw, D. H., Currin, B. L., and Barr, A. H. 1995. Cellular texture generation. In SIGGRAPH ’95, 239–248. Google Scholar
13. Gal, R., Sorkine, O., Popa, T., Sheffer, A., and Cohen-Or, D. 2007. 3D collage: expressive non-realistic modeling. In NPAR ’07, 7–14. Google Scholar
14. Han, J., Zhou, K., Wei, L.-Y., Gong, M., Bao, H., Zhang, X., and Guo, B. 2006. Fast example-based surface texture synthesis via discrete optimization. Vis. Comput. 22, 9, 918–925. Google ScholarDigital Library
15. Hausner, A. 2001. Simulating decorative mosaics. In SIGGRAPH ’01, 573–580. Google Scholar
16. Hsu, S.-W., and Keyser, J. 2010. Piles of objects. In SIGGRAPH Asia ’10, 155:1–6. Google Scholar
17. Hurtut, T., Landes, P.-E., Thollot, J., Gousseau, Y., Drouillhet, R., and Coeurjolly, J.-F. 2009. Appearance-guided synthesis of element arrangements by example. In NPAR ’09, 51–60. Google Scholar
18. Ijiri, T., Mech, R., Igarashi, T., and Miller, G. 2008. An example-based procedural system for element arrangement. In EUROGRAPH ’08, vol. 27, 429–436.Google Scholar
19. Jagnow, R., Dorsey, J., and Rushmeier, H. 2004. Stereological techniques for solid textures. In SIGGRAPH ’04, 329–335. Google Scholar
20. Jodoin, P.-M., Epstein, E., Granger-Piché, M., and Ostromoukhov, V. 2002. Hatching by example: a statistical approach. In NPAR ’02, 29–36. Google Scholar
21. Ju, E., Choi, M. G., Park, M., Lee, J., Lee, K. H., and Takahashi, S. 2010. Morphable crowds. In SIGGRAPH Asia ’10, 140:1–10. Google Scholar
22. Kim, J., and Pellacini, F. 2002. Jigsaw image mosaics. In SIGGRAPH ’02, 657–664. Google Scholar
23. Kim, T., Thürey, N., James, D., and Gross, M. 2008. Wavelet turbulence for fluid simulation. In SIGGRAPH ’08, 50:1–6. Google Scholar
24. Kim, S., Maciejewski, R., Isenberg, T., Andrews, W. M., Chen, W., Sousa, M. C., and Ebert, D. S. 2009. Stippling by example. In NPAR’09, 41–50. Google Scholar
25. Kopf, J., Fu, C.-W., Cohen-Or, D., Deussen, O., Lischinski, D., and Wong, T.-T. 2007. Solid texture synthesis from 2D exemplars. In SIGGRAPH ’07, 2:1–9. Google Scholar
26. Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. In SIGGRAPH ’05, 795–802. Google Scholar
27. Lagae, A., and Dutré, P. 2005. A procedural object distribution function. ACM Trans. Graph. 24, 4, 1442–1461. Google ScholarDigital Library
28. Landreneau, E., and Schaefer, S. 2010. Scales and scale-like structures. In SGP ’10, 1653–1660.Google Scholar
29. Lerner, A., Chrysanthou, Y., and Lischinski, D. 2007. Crowds by example. In EUROGRAPH ’07, vol. 26, 655–664.Google Scholar
30. Ma, C., Wei, L.-Y., Guo, B., and Zhou, K. 2009. Motion field texture synthesis. In SIGGRAPH Asia 2009, 110:1–8. Google Scholar
31. Martín, D., Arroyo, G., Luzón, M. V., and Isenberg, T. 2010. Example-based stippling using a scale-dependent grayscale process. In NPAR ’10, 51–61. Google Scholar
32. Matusik, W., Zwicker, M., and Durand, F. 2005. Texture design using a simplicial complex of morphable textures. In SIGGRAPH ’05, 787–794. Google Scholar
33. Merrell, P., and Manocha, D. 2008. Continuous model synthesis. In SIGGRAPH Asia ’08, 158:1–7. Google Scholar
34. Merrell, P., and Manocha, D. 2010. Example-based curve generation. Computers & Graphics 34, 304–311. Google ScholarDigital Library
35. Narain, R., Golas, A., Curtis, S., and Lin, M. 2009. Aggregate dynamics for dense crowd simulation. In SIGGRAPH Asia ’09, 122:1–8. Google Scholar
36. Owada, S., Nielsen, F., Okabe, M., and Igarashi, T. 2004. Volumetric illustration: designing 3d models with internal textures. In SIGGRAPH ’04, 322–328. Google Scholar
37. Pauly, M., Mitra, N. J., Wallner, J., Pottmann, H., and Guibas, L. J. 2008. Discovering structural regularity in 3d geometry. In SIGGRAPH ’08, 43:1–11. Google Scholar
38. Peytavie, A., Galin, E., Merillou, S., and Grosjean, J. 2009. Procedural generation of rock piles using aperiodic tiling. In Pacific Graphics ’09, 1801–1809.Google Scholar
39. Ramanarayanan, G., Bala, K., and Ferwerda, J. A. 2008. Perception of complex aggregates. In SIGGRAPH ’08, 60:1–10. Google Scholar
40. Rubner, Y., Tomasi, C., and Guibas, L. 2000. The earth mover’s distance as a metric for image retrieval. International Journal of Computer Vision 40, 2, 99–121. Google ScholarDigital Library
41. Shi, X., Zhou, K., Tong, Y., Desbrun, M., Bao, H., and Guo, B. 2007. Mesh puppetry: cascading optimization of mesh deformation with inverse kinematics. In SIGGRAPH ’07, 81:1–10. Google Scholar
42. Simakov, D., Caspi, Y., Shechtman, E., and Irani, M. 2008. Summarizing visual data using bidirectional similarity. In CVPR ’08, 1–8.Google Scholar
43. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. In SIGGRAPH ’02, 665–672. Google Scholar
44. Turk, G. 2001. Texture synthesis on surfaces. In SIGGRAPH ’01, 347–354. Google Scholar
45. Wang, L., Yu, Y., Zhou, K., and Guo, B. 2009. Example-based hair geometry synthesis. In SIGGRAPH ’09, 56:1–9. Google Scholar
46. Wei, L.-Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In SIGGRAPH ’00, 479–488. Google ScholarDigital Library
47. Wei, L.-Y., Han, J., Zhou, K., Bao, H., Guo, B., and Shum, H.-Y. 2008. Inverse texture synthesis. In SIGGRAPH ’08, 1–9. Google Scholar
48. Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics ’09 State of the Art Report, 93–117.Google Scholar
49. Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively-variant textures on arbitrary surfaces. In SIGGRAPH ’03, 295–302. Google Scholar
50. Zhou, K., Huang, X., Wang, X., Tong, Y., Desbrun, M., Guo, B., and Shum, H.-Y. 2006. Mesh quilting for geometric texture synthesis. In SIGGRAPH ’06, 690–697. Google Scholar
51. Zhou, H., Sun, J., Turk, G., and Rehg, J. M. 2007. Terrain synthesis from digital elevation models. IEEE Transactions on Visualization and Computer Graphics 13, 4, 834–848. Google ScholarDigital Library