“Painterly rendering with curved brush strokes of multiple sizes” by Hertzmann

We present a new method for creating an image with a hand-painted appearance from a photograph, and a new approach to designing styles of illustration. We “paint” an image with a series of spline brush strokes. Brush strokes are chosen to match colors in a source image. A painting is built up in a series of layers, starting with a rough sketch drawn with a large brush. The sketch is painted over with progressively smaller brushes, but only in areas where the sketch differs from the blurred source image. Thus, visual emphasis in the painting corresponds roughly to the spatial energy present in the source image. We demonstrate a technique for painting with long, curved brush strokes, aligned to normals of image gradients. Thus we begin to explore the expressive quality of complex brush strokes. Rather than process images with a single manner of painting, we present a framework for describing a wide range of visual styles. A style is described as an intuitive set of parameters to the painting algorithm that a designer can adjust to vary the style of painting. We show examples of images rendered with different styles, and discuss long-term goals for expressive rendering styles as a general-purpose design tool for artists and animators.

1. ADOBE SYSTEMS. Adobe Photoshop 4.0
2. DEBORAH F. BERMAN, JASON T. BARTELL, DAVID H. SALESIN. Multiresolution Painting and Compositing. SIGGRAPH 94 Conference Proceedings, pp. 85-90. July 1994.
3. PETER J. BURT AND EDWARD U. ADELSON. The Laplacian Pyramid as a Compact Image Code. IEEE Transactions on Communications. 31:532-540, April 1983.
4. HAROLD COHEN. The Further Exploits of Aaron, Painter. Stanford Humanities Review. Vol. 4, No. 2. pp. 141-158. 1995
5. CASSlDY J. CURTIS, SEAM E. ANDERSON, JOSHUA E. SEIMS, KURT W. FLEISCHER, DAVID H. SALESIN. Computer-Generated Watercolor. SIGGRAPH 97 Conference Proceedings, pp. 421- 430. August 1997.
6. JAMES FOLEY, ANDRIES VAN DAM, STEPHEN FEINER, JOHN HUGHES. Computer Graphics: Principles and Practice, Addison- Wesley, 1995.
7. FRACTAL DESIGN CORPORATION. Fractal Design Painter.
8. PAUL HAEBERLI. Paint by numbers: Abstract image representations. Computer Graphics (SIGGRAPH 90 Conference Proceedings), 24(4):207-214, August 1990
9. PAUL HAEBERLI. The Impressionist. http ://www. sgi.com/graphica/impression
10. JOHN LANSDOWN AND SIMON SCHOFIELD. Expressive rendering: A review of nonphotorealistic techniques. IEEE Computer Graphics and Applications, 15(3):29-37, May 1995.
11. PETER LITWINOWICZ. Processing Images and Video for An Impressionist Effect. SIGGRAPH 97 Conference Proceedings, pp. 407-414. August 1997.
12. LEE MARKOSIAN, MICHAEL A. KOWALSKI, S AMUEL J. TRYCHIN, LUBOMIR D. BOURDEV, DANIEL GOLDSTEIN, JOHN F. HUGHES. Real-Time Nonphotorealistic Rendering. SIGGRAPH 97 Conference Proceedings, pp. 415-420. August 1997.
13. PAMELA MCCORDUCK. AARON’s CODE: Meta-Art, Artificial Intelligence, and the Work of Harold Cohen. New York: W. H. Freeman & Co. 225 pages. 1991.
14. MICROSOFT CORPORATION. Microsoft Image Composer 1.5
15. KEN PERLIN AND LUIZ VELHO. LivePaint: Painting with Procedural Multiscale Textures, SIGGRAPH 95 Conference Proceedings, pp. 153-160. 1995.
16. MICHAELP. SALISBURY, MICHAEL T. WONG, JOHN F. HUGHES, DAVID H. SALESIN. Orientable Textures for Image- Based Pen-and-Ink Illustration. SIGGRAPH 97 Conference Proceedings, pp. 401-406. August 1997.
17. S.M.F. TREAVETT AND M. CHEN. Statistical Techniques for the Automated Synthesis of Non-Photorealistic Images. Proc. 15th Eurographics UK Conference, March 1997.
18. GREG TURK AND DAVID BANKS. Image-Guided Streamline Placement. SIGGRAPH 96 Conference Proceedings, pp. 453- 460. August 1996.
19. JOACHIM WEICKERT, BART M. TER HAAR ROMNEY, MAX A. VIERGEVEP~ Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Transactions on Image Processing. March 1998.
20. GEORGES WINKENBACH AND DAVID H. SALESIN. Computer- Generated Pen-and-Ink Illustration. SIGGRAPH 94 Conference Proceedings, pp. 91-100. July 1994.
21. GEORGES WINKENBACH AND DAVID H. SALESIN. Rendering Parametric Surfaces in Pen and Ink. SIGGRAPH 96 Conference Proceedings, pp. 469-476. August 1996.
22. XAOS TOOLS. Paint Alchemy 2.0