“Interactive on-surface signal deformation” by Ritschel, Thormählen, Dachsbacher, Kautz and Seidel

We present an interactive system for the artistic control of visual phenomena visible on surfaces. Our method allows the user to intuitively reposition shadows, caustics, and indirect illumination using a simple click-and-drag user interface working directly on surfaces. In contrast to previous approaches, the positions of the lights or objects in the scene remain unchanged, enabling localized edits of individual shading components. Our method facilitates the editing by computing a mapping from one surface location to another. Based on this mapping, we can not only edit shadows, caustics, and indirect illumination but also other surface properties, such as color or texture, in a unified way. This is achieved using an intuitive user-interface that allows the user to specify position constraints with drag-and-drop or sketching operations directly on the surface. Our approach requires no explicit surface parametrization and handles scenes with arbitrary topology. We demonstrate the applicability of the approach to interactive editing of shadows, reflections, refractions, textures, caustics, and diffuse indirect light. The effectiveness of the system to achieve an artistic goal is evaluated by a user study.

1. Alexa, M., Cohen-Or, D., and Levin, D. 2000. As-rigid-as-possible shape interpolation. In Proc. SIGGRAPH, 157–164. Google ScholarDigital Library
2. Balzer, M., Schlömer, T., and Deussen, O. 2009. Capacity-constrained point distributions: A variant of Lloyd’s method. ACM Trans Graph. (Proc. SIGGRAPH) 28, 3, 86:1–8. Google ScholarDigital Library
3. Barzel, R. 1997. Lighting controls for computer cinematography. Journal of Graphics Tools 2, 1, 1–20. Google ScholarDigital Library
4. Birn, J. 2006. Digital Lighting and Rendering, 2nd ed. New Riders Press. Google ScholarDigital Library
5. Botsch, M., and Kobbelt, L. 2004. An intuitive framework for real-time freeform modeling. ACM Trans. Graph. (Proc. SIGGRAPH) 23, 3, 630–634. Google ScholarDigital Library
6. Bronstein, A. M., Bronstein, M. M., Bruckstein, A. M., and Kimmel, R. 2006. Matching two-dimensional articulated shapes using generalized multidimensional scaling. In AMDO, 48–57. Google ScholarDigital Library
7. DeCoro, C., Cole, F., Finkelstein, A., and Rusinkiewicz, S. 2007. Stylized shadows. In Proc. NPAR. Google ScholarDigital Library
8. Hormann, K., Lévy, B., and Sheffer, A., 2007. Mesh parameterization: Theory and practice. ACM SIGGRAPH 2007 Courses. Google ScholarDigital Library
9. Kerr, W. B., and Pellacini, F. 2009. Toward evaluating lighting design interface paradigms for novice users. ACM Trans. Graph. (Proc. SIGGRAPH) 28, 3, 1–9. Google ScholarDigital Library
10. Ko, H.-S., and Breen, D., 2003. Clothing simulation and animation. ACM SIGGRAPH 2003 Courses.Google Scholar
11. Kobbelt, L., Campagna, S., Vorsatz, J., and Seidel, H.-P. 1998. Interactive multi-resolution modeling on arbitrary meshes. In SIGGRAPH ’98, 105–114. Google ScholarDigital Library
12. Li, H., Adams, B., Guibas, L. J., and Pauly, M. 2009. Robust single-view geometry and motion reconstruction. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 28, 5. Google ScholarDigital Library
13. Lévy, B., and Mallet, J.-L. 1998. Non-distorted texture mapping for sheared triangulated meshes. In Proc. SIGGRAPH, 343–352. Google ScholarDigital Library
14. Müller, M., Heidelberger, B., Teschner, M., and Gross, M. 2005. Meshless deformations based on shape matching. ACM Trans. Graph. (Proc. SIGGRAPH) 24, 3, 471–478. Google ScholarDigital Library
15. Obert, J., Krivánek, J., Pellacini, F., Sýkora, D., and Pattanaik, S. N. 2008. iCheat: A representation for artistic control of indirect cinematic lighting. Computer Graphics Forum (Proc. EGSR) 27, 4, 1217–1223. Google ScholarDigital Library
16. Okabe, M., Matsushita, Y., Shen, L., and Igarashi, T. 2007. Illumination brush: Interactive design of all-frequency lighting. In Proc. Pacific Graphics 2007, 171–180. Google ScholarDigital Library
17. Pellacini, F., Tole, P., and Greenberg, D. P. 2002. A user interface for interactive cinematic shadow design. In ACM Trans. Graph. (Proc. SIGGRAPH), 563–566. Google ScholarDigital Library
18. Poulin, P., and Fournier, A. 1992. Lights from highlights and shadows. In Proc. I3D, 31–38. Google ScholarDigital Library
19. Poulin, P., Ratib, K., and Jacques, M. 1997. Sketching shadows and highlights to position lights. In Proc. CGI, 56–63. Google ScholarDigital Library
20. Ragan-Kelley, J., Kilpatrick, C., Smith, B. W., Epps, D., Green, P., Hery, C., and Durand, F. 2007. The lightspeed automatic interactive lighting preview system. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3. Google ScholarDigital Library
21. Ritschel, T., Okabe, M., Thormählen, T., and Seidel, H.-P. 2009. Interactive reflection editing. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 28, 5. Google ScholarDigital Library
22. Schmidt, R., Grimm, C., and Wyvill, B. 2006. Interactive decal compositing with discrete exponential maps. ACM Trans. Graph. (Proc. SIGGRAPH) 25, 3, 605–613. Google ScholarDigital Library
23. Schoeneman, C., Dorsey, J., Smits, B., Arvo, J., and Greenberg, D. 1993. Painting with light. In SIGGRAPH ’93, 143–146. Google ScholarDigital Library
24. Schreiner, J., Asirvatham, A., Praun, E., and Hoppe, H. 2004. Inter-surface mapping. ACM Trans. Graph. (Proc. SIGGRAPH) 23, 3, 870–877. Google ScholarDigital Library
25. Sumner, R. W., Schmid, J., and Pauly, M. 2007. Embedded deformation for shape manipulation. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3, 80. Google ScholarDigital Library
26. Tabellion, E., and Lamorlette, A. 2004. An approximate global illumination system for computer generated films. ACM Trans. Graph. (Proc. SIGGRAPH) 23, 3, 469–476. Google ScholarDigital Library
27. Todo, H., Anjyo, K.-I., Baxter, W., and Igarashi, T. 2007. Locally controllable stylized shading. ACM Trans. Graph. (Proc. SIGGRAPH) 26, 3, 17. Google ScholarDigital Library
28. Trottenberg, U., Oosterlee, C., and Schuller, A. 2000. Multigrid. Academic Press. Google ScholarDigital Library
29. Tzur, Y., and Tal, A. 2009. Flexistickers: Photogrammetric texture mapping using casual images. ACM Trans. Graph. (Proc. SIGGRAPH) 28, 3, 1–10. Google ScholarDigital Library
30. Zorin, D., Schröder, P., and Sweldens, W. 1997. Interactive multiresolution mesh editing. In SIGGRAPH ’97, 259–268. Google ScholarDigital Library
31. Zwicker, M., Pauly, M., Knoll, O., and Gross, M. 2002. Pointshop 3D: An interactive system for point-based surface editing. In Proc. SIGGRAPH, 322–329. Google ScholarDigital Library