“Image quilting for texture synthesis and transfer” by Efros and Freeman

We present a simple image-based method of generating novel visual appearance in which a new image is synthesized by stitching together small patches of existing images. We call this process image quilting. First, we use quilting as a fast and very simple texture synthesis algorithm which produces surprisingly good results for a wide range of textures. Second, we extend the algorithm to perform texture transfer — rendering an object with a texture taken from a different object. More generally, we demonstrate how an image can be re-rendered in the style of a different image. The method works directly on the images and does not require 3D information.

1. M. Ashikhmin. Synthesizing natural textures. In Symposium on Interactive 3D Graphics, 2001.
2. J. Bergen and E. Adelson. Early vision and texture perception. Nature, 333:363- 364, 1988.
3. J. S. De Bonet. Multiresolution sampling procedure for analysis and synthesis of texture images. In SIGGRAPH 97, pages 361-368, 1997.
4. C. J. Curtis, S. E. Anderson, J. E. Seims, Kurt W. Fleisher, and D. H. Salsin. Computer-generated watercolor. In SIGGRAPH 97, pages 421-430, 1997.
5. J. Davis. Mosaics of scenes with moving objects. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog., 1998.
6. A. A. Efros and T. K. Leung. Texture synthesis by non-parametric sampling. In International Conference on Computer Vision, pages 1033-1038, Corfu, Greece, September 1999.
7. D.D.Garber.Computational Models for Texture Analysis and Texture Synthesis. PhD thesis, University of Southern California, Image Processing Institute, 1981.
8. J. J. Gibson. The Perception of the Visual World. Houghton Mifflin, Boston, Massachusetts, 1950.
9. P. Harrison. A non-hierarchical procedure for re-synthesis of complex textures. In WSCG ‘2001 Conference proceedings, pages 190-197, 2001. See also http://www.csse.monash.edu.au/~pfh/resynthesizer/.
10. David J. Heeger and James R. Bergen. Pyramid-based texture analysis/synthesis. In SIGGRAPH 95, pages 229-238, 1995.
11. A. Hertzmann, C.E. Jacobs, N. Oliver, B. Curless, and D.H. Salesin. Image analogies. In SIGGRAPH 01, 2001.
12. Bela Julesz. Visual pattern discrimination. IRE Transactions on Information Theory, 8(2):84-92, 1962.
13. L. Liang, C. Liu, , Y. Xu, B. Guo, and H.-Y. Shum. Real-time texture synthesis by patch-based sampling. Technical Report MSR-TR-2001-40, Microsoft Research, March 2001.
14. J. Malik and P. Perona. Preattentive texture discrimination with early vision mechanism. JOSA-A, 5(5):923-932, May 1990.
15. V. Ostromoukhov and R. D. Hersch. Multi-color and artistic dithering. In SIG- GRAPH 99, pages 425-432, 1999.
16. Kris Popat and Rosalind W. Picard. Novel cluster-based probability model for texture synthesis, classification, and compression. In Proc. SPIE Visual Comm. and Image Processing, 1993.
17. J. Portilla and E. P. Simoncelli. A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision, 40(1):49-71, December 2000.
18. Emil Praun, Adam Finkelstein, and Hugues Hoppe. Lapped textures. In SIG- GRAPH 00, pages 465-470, 2000.
19. M. P. Salisbury, M. T. Wong, J. F. Hughes, and D. H. Salesin. Orientable textures for image-based pen-and-ink illustration. In SIGGRAPH 97, 1997.
20. Li-Yi Wei and Marc Levoy. Fast texture synthesis using tree-structured vector quantization. In SIGGRAPH 00, pages 479-488, 2000.
21. Y. Xu, B. Guo, and H.-Y. Shum. Chaos mosaic: Fast and memory efficient texture synthesis. Technical Report MSR-TR-2000-32, Microsoft Research, April 2000.
22. Song Chun Zhu, Yingnian Wu, and David Mumford. Filters, random fields and maximum entropy (frame). International Journal of Computer Vision, 27(2):1- 20, March/April 1998.