“AppIm: linear spaces for image-based appearance editing” by Renzo, Calabrese and Pellacini
Conference:
Type(s):
Title:
- AppIm: linear spaces for image-based appearance editing
Session/Category Title: Displays, Reflectance and Texture
Presenter(s)/Author(s):
Abstract:
Editing spatially-varying appearance is commonplace in most graphics applications. In this paper, we focus on materials whose appearance is described by BRDFs or BSSRDFs, with parameters specified by textures, and with local frame perturbations, namely bump, normal and tangent maps. Editing these materials amounts to editing the textures that encode the spatial variation. To perform these edits, artists commonly adopt imaging softwares since they have rich toolsets and well-understood user interfaces. But editing material parameters as images does not produce consistent results since the parameters’ behaviours in their relative spaces are not taken in account. Our goal is to address this issue with a solution that is practical, in that we do not want to change material representation or editing workflow to ensure adoption. We observe that most image editing operations can be written as linear combination of colors. We thus define editing spaces for material parameters such that linear operations in these spaces respect their inherent meaning of the parameters. Transformations to and from editing spaces are non-linear to capture the non-linear behaviour of the parameters. Since GPUs are particularly efficient when executing linear operations, they can be used well with editing spaces. We demonstrate the use of editing spaces to edit microfacet BRDFs and SubEdit BSSRDFs by performing various imaging operations such as layering, linear and non-linear filtering, local and global contrast enhancements, and hardware-accelerated painting.
References:
1. Aittala, M., Weyrich, T., and Lehtinen, J. 2013. Practical SVBRDF Capture in the Frequency Domain. ACM Trans. Graph. 32, 4, 110:1–110:12.
2. An, X., and Pellacini, F. 2008. AppProp: All-Pairs Appearance-Space Edit Propagation. ACM Trans. Graph. 27, 3, 40:1–40:9.
3. An, X., Tong, X., Denning, J. D., and Pellacini, F. 2011. AppWarp: Retargeting Measured Materials by Appearance-space Warping. ACM Trans. Graph. 30, 6, 147:1–147:10.
4. Ashikhmin, M., and Shirley, P. S. 2000. An Anisotropic Phong BRDF Model. Journal of Graphics Tools 5, 2, 25–32.
5. Cook, R. L., and Torrance, K. E. 1981. A Reflectance Model for Computer Graphics. SIGGRAPH Comput. Graph. 15, 3, 307–316.
6. Debevec, P. E., and Malik, J. 1997. Recovering High Dynamic Range Radiance Maps from Photographs. In SIGGRAPH ’97, 369–378.
7. Dong, Y., Tong, X., Pellacini, F., and Guo, B. 2011. App-Gen: Interactive Material Modeling from a Single Image. ACM Trans. Graph. 30, 6 (Dec.), 146:1–146:10.
8. Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., and Lischinski, D. 2009. Coordinates for Instant Image Cloning. ACM Trans. Graph. 28, 3, 67:1–67:9.
9. Grassia, F. S. 1998. Practical Parameterization of Rotations Using the Exponential Map. Journal of Graphics Tools 3, 3, 29–48.
10. Kerr, W. B., and Pellacini, F. 2010. Toward Evaluating Material Design Interface Paradigms for Novice Users. ACM Trans. Graph. 29, 4, 35:1–35:10.
11. Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse Shade Trees for Non-parametric Material Representation and Editing. ACM Trans. Graph. 25, 3, 735–745.
12. Lee, J. 2008. Representing Rotations and Orientations in Geometric Computing. IEEE Comput. Graph. Appl. 28, 2, 75–83.
13. MARI. 3D Texture Painting Software Documentation. www.thefoundry.co.uk/products/mari/.
14. Markley, F. L., Cheng, Y., Crassidis, J. L., and Oshman, Y. 2007. Averaging Quaternions. Journal of Guidance Control and Dynamics 30, 1193–1197.Cross Ref
15. McAuley, S., Hill, S., Martinez, A., Villemin, R., Pettineo, M., Lazarov, D., Neubelt, D., Karis, B., Hery, C., Hoffman, N., and Zap Andersson, H. 2013. Physically Based Shading in Theory and Practice. In ACM SIGGRAPH 2013 Courses, 22:1–22:8.
16. Ngan, A., Durand, F., and Matusik, W. 2005. Experimental Analysis of BRDF Models. In EGSR 2005, 117–126.
17. Paul Rosin and John Collomosse. 2013. Image and Video-Based Artistic Stylisation. Springer, ch. A Brush Stroke Synthesis Toolbox.
18. Pellacini, F., and Lawrence, J. 2007. AppWand: Editing Measured Materials using Appearance-Driven Optimization. ACM Trans. Graph. 26, 3, 54:1–54:9.
19. Pellacini, F., Ferwerda, J. A., and Greenberg, D. P. 2000. Toward a Psychophysically-based Light Reflection Model for Image Synthesis. In SIGGRAPH ’00, 55–64.
20. Pereira, T., and Rusinkiewicz, S. 2012. Gamut Mapping Spatially Varying Reflectance with an Improved BRDF Similarity Metric. Computer Graphics Forum (EGSR) 31, 4.
21. Phong, B. T. 1975. Illumination for Computer Generated Pictures. Commun. ACM 18, 6, 311–317.
22. Read, A. L. 1999. Linear interpolation of histograms. Nucl. Instrum. Meth. A425, 357–360.Cross Ref
23. Schlick, C. 1994. An Inexpensive BRDF Model for Physically-Based Rendering. Computer Graphics Forum 13, 3, 233–246.Cross Ref
24. Song, Y., Tong, X., Pellacini, F., and Peers, P. 2009. SubEdit: A Representation for Editing Measured Heterogeneous Subsurface Scattering. ACM Trans. Graph. 28, 3, 31:1–31:10.
25. Van Ginneken, B., Stavridi, M., and Koenderink, J. J. 1998. Diffuse and Specular Reflectance from Rough Surfaces. Appl. Opt. 37, 1, 130–139.Cross Ref
26. Vangorp, P., Laurijssen, J., and Dutré, P. 2007. The Influence of Shape on the Perception of Material Reflectance. ACM Trans. Graph. 26, 3 (July).
27. Walter, B., Marschner, S. R., Li, H., and Torrance, K. E. 2007. Microfacet Models for Refraction through Rough Surfaces. In EGSR 2007, 195–206.
28. Westlund, H. B., and Meyer, G. W. 2001. Applying Appearance Standards to Light Reflection Models. In Proceedings of ACM SIGGRAPH 2001, 501–510.
29. Wills, J., Agarwal, S., Kriegman, D. J., and Belongie, S. J. 2009. Toward a Perceptual Space for Gloss. ACM Trans. Graph. 28, 4.
30. Wu, H., Dorsey, J., and Rushmeier, H. 2011. Physically-based Interactive Bi-scale Material Design. ACM Trans. Graph. 30, 6, 145:1–145:10.
31. Wu, H., Dorsey, J., and Rushmeier, H. 2013. Inverse Bi-scale Material Design. ACM Trans. Graph. 32, 6 (Nov.), 163:1–163:10.
