“Textureshop: texture synthesis as a photograph editing tool” by Fang and Hart

We combine existing techniques for shape-from-shading and texture synthesis to create a new tool for texturing objects in photographs. Our approach clusters pixels with similar recovered normals into patches on which texture is synthesized. Distorting the texture based on the recovered normals creates the illusion that the texture adheres to the undulations of the photographed surface. Inconsistencies in the recovered surface are disguised by the graphcut blending of the individually textured patches. Further applications include the generation of detail on manually-shaded painting, extracting and synthesizing a displacement map from a texture swatch, and the embossed transfer of normals from one image to another, which would be difficult to create with current image processing packages.

1. BERTALMIO, M., SAPIRO, G., CASELLES, V., AND BALLESTER, C. 2000. Image inpainting. In Proc. SIGGRAPH 00, 417–424. Google ScholarDigital Library
2. DRORI, I., COHEN-OR, D., AND YESHURUN, H. 2003. Fragment-based image completion. Proc. SIGGRAPH 03, 303–312. Google ScholarDigital Library
3. EFROS, A. A., AND FREEMAN, W. T. 2001. Image quilting for texture synthesis and transfer. SIGGRAPH 2001. Google ScholarDigital Library
4. HORN, B. K. 1990. Height and gradient from shading. International journal of computer vision, 5:1, 37–75, 1990. Google ScholarDigital Library
5. ISMERT, R. M., BALA, K., AND GREENBERG, D. P. 2003. Detail synthesis for image-based texturing. In Proc. 13D, 171–175. Google ScholarDigital Library
6. KWATRA, V., SCHOEDL, A., ESSA, I., TURK, G., AND BOBICK, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. Proc. SIGGRAPH 2003. Google ScholarDigital Library
7. MCNAMARA, A., TREUILLE, A., POPOVIC, Z., AND STAM, J. 2003. Keyframe control of smoke simulations. Proc. SIGGRAPH 2003. Google ScholarDigital Library
8. OH, B. M., CHEN, M., DORSEY, J., AND DURAND, F. 2001. Image-based modeling and photo editing. In Proc. SIGGRAPH 2001, 433–442. Google ScholarDigital Library
9. PEREZ, P., GANGNET, M., AND BLAKE, A. 2003. Poisson image editing. Proc. SIGGRAPH 2003, 313 — 318. Google ScholarDigital Library
10. SHADE, J., GORTLER, S., WEI HE, L., AND SZELISKI, R. 1998. Layered depth images. In Proc. SIGGRAPH 98, 231–242. Google ScholarDigital Library
11. TURK, G. 2001. Texture synthesis on surfaces. Proc. SIGGRAPH 2001. Google ScholarDigital Library
12. WEI, L.-Y., AND LEVOY, M. 2001. Texture synthesis over arbitrary manifold surfaces. SIGGRAPH 2001. Google ScholarDigital Library