“Self-similarity based texture editing”

We present a simple method of interactive texture editing that utilizes self-similarity to replicate intended operations globally over an image. Inspired by the recent successes of hierarchical approaches to texture synthesis, this method also uses multi-scale neighborhoods to assess the similarity of pixels within a texture. However, neighborhood matching is not employed to generate new instances of a texture. We instead locate similar neighborhoods for the purpose of replicating editing operations on the original texture itself, thereby creating a fundamentally new texture. This general approach is applied to texture painting, cloning and warping. These global operations are performed interactively, most often directed with just a single mouse movement.

1. ASHIKHMIN, M. 2001. Synthesizing Natural Textures. ACM Symposium on Interactive 3D Graphics, 217-226. Google Scholar
2. BAR-JOSEPH, Z., EL-YANIV, R., LISCHINSKI, D., AND WERMAN, M. 2001. Texture Mixing and Texture Movie Synthesis Using Statistical Learning. IEEE Transactions on Visualization and Computer Graphics, 7, 2, 120-135. Google Scholar
3. BEIER, T., AND NEELY, S. 1992. Feature-Based Image Metamorphosis. In Computer Graphics (Proceedings of ACM SIGGRAPH 92), 26(2), ACM, 35-42. Google Scholar
4. BERMAN, D., BARTELL, J., AND SALESIN, D. 1994. Multiresolution Painting and Compositing. ACM SIGGRAPH 94, 85-90. Google Scholar
5. BURT, P., AND ADELSON, E. 1983. A Multiresolution Spline with Application to Image Mosaics. ACM Transactions on Graphics, 2, 4, 217-236. Google Scholar
6. DE BONET, J. S. 1997. Multiresolution Sampling Procedure for Analysis and Synthesis of Texture Images. ACM SIGGRAPH 97, 361-368. Google Scholar
7. DISCHLER, J., AND GHAZANFARPOUR, D. 1999. Interactive Image-Based Modeling of Macrostructured Textures. IEEE Computer Graphics and Applications, 19, 1, 66-74. Google Scholar
8. EBERT, D., MUSGRAVE, F., PEACHEY, D., PERLIN, K., AND WORLEY, S. 1994. Texturing and Modeling: A Procedural Approach. AP Professional. Google Scholar
9. EFROS, A., AND FREEMAN, W. 2001. Image Quilting For Texture Synthesis and Transfer. ACM SIGGRAPH 2001, 341-346. Google Scholar
10. ELDER, J., AND GOLDBERG, R. 1998. Image Editing In the Contour Domain. IEEE Computer Vision and Pattern Recognition, 374-381. Google Scholar
11. GLASBEY, C., AND MARDIA, K. 1998. A Review of Image-Warping Methods. Journal of Applied Statistics, 25, 2, 155-172.Google Scholar
12. GLEICHER, M. 1995. Image Snapping. ACM SIGGRAPH 95, 183-190. Google Scholar
13. HEEGER, D. J., AND BERGEN, J. R. 1995. Pyramid-Based Texture Analysis/Synthesis. ACM SIGGRAPH 95, 229-238. Google Scholar
14. HERTZMANN, A., JACOBS, C., OLIVER, N., CURLESS, B., AND SALESIN, D. H. 2001. Image Analogies. ACM SIGGRAPH 2001, 327-340. Google Scholar
15. KEAHEY, A., AND ROBERTSON, E. 1997. Nonlinear Magnification Fields. IEEE Symposium on Information Visualization, 51-58. Google Scholar
16. KURLANDER, D., AND BIER, E. 1988. Graphical Search and Replace. In Computer Graphics (Proceedings of ACM SIGGRAPH 88), 22(4), ACM, 113-120. Google Scholar
17. LEWIS, J. P. 1984. Texture Synthesis for Digital Painting. Computer Graphics, 18, 3, 245-252. Google Scholar
18. LIANG, L., LIU, C., XU, Y., GUO, B., AND SHUM, H. 2001. Real-Time Texture Synthesis by Patch-Based Sampling. ACM Transactions on Graphics. 20, 3, 127-150. Google Scholar
19. MORTENSEN, E., AND BARRETT, W. 1995. Intelligent Scissors for Image Composition. ACM SIGGRAPH 95, 191-198. Google Scholar
20. OH, B., CHEN, M., DORSEY, J., AND DURAND, F. 2001. Image-Based Modeling and Photo Editing. ACM SIGGRAPH 2001, 433-442. Google Scholar
21. PERLIN, K., AND VELHO, L. 1995. Live Paint: Painting With Procedural Multiscale Textures. ACM SIGGRAPH 95, 153-160. Google Scholar
22. PORTER, T., AND DUFF, T. 1984. Compositing Digital Images. Computer Graphics, 18, 3, 253-259. Google Scholar
23. SIMS, K. 1993. Interactive Evolution of Equations for Procedural Models. The Visual Computer, 9, 8, 466-476.Google Scholar
24. WEI, L., AND LEVOY, M. 2000. Fast Texture Synthesis Using Tree-Structured Vector Quantization. ACM SIGGRAPH 2000, 479-488. Google Scholar