“Toward evaluating material design interface paradigms for novice users” by Kerr and Pellacini

Material design is the process by which artists specify the reflectance properties of a surface, such as its diffuse color and specular roughness. We present a user study to evaluate the relative benefits of different material design interfaces, focusing on novice users since they stand to gain the most from intuitive interfaces. Specifically, we investigate the editing of the parameters of analytic bidirectional distribution functions (BRDFs) using three interface paradigms: physical sliders by which users set the parameters of analytic BRDF models, such as diffuse albedo and specular roughness; perceptual sliders by which users set perceptually-inspired parameters, such as diffuse luminance and gloss contrast; and image navigation by which material variations are displayed in arrays of image thumbnails and users make edits by selecting them.We investigate two design tasks: precise adjustment and artistic exploration. We collect objective and subjective data, finding that subjects can perform equally well with physical and perceptual sliders as long as the interface responds interactively. Image navigation performs worse than the other interfaces on precise adjustment tasks, but excels at aiding in artistic exploration. We find that given enough time, novices can perform relatively complex material editing tasks with little training, and most novices work similarly to one another.

1. Adobe Systems Inc., 2009. Photoshop CS 4.Google Scholar
2. Ashikhmin, M., and Shirley, P. S. 2000. An anisotropic phong brdf model. Journal of Graphics Tools 5, 2, 25–32. Google ScholarDigital Library
3. Autodesk Inc., 2010. Maya 2010.Google Scholar
4. Ben-Artzi, A., Overbeck, R., and Ramamoorthi, R. 2006. Real-time BRDF editing in complex lighting. ACM Transactions on Graphics 25, 3 (July), 945–954. Google ScholarDigital Library
5. Ben-Artzi, A., Egan, K., Ramamoorthi, R., and Durand, F. 2008. A precomputed polynomial representation for interactive BRDF editing with global illumination. ACM Transactions on Graphics 27, 2 (Apr.), 13:1–13:13. Google ScholarDigital Library
6. Blinn, J. F. 1977. Models of light reflection for computer synthesized pictures. In Computer Graphics (Proceedings of SIGGRAPH 77), 192–198. Google ScholarDigital Library
7. Colbert, M., Pattanaik, S., and Krivanek, J. 2006. BRDF-shop: Creating physically correct bidirectional reflectance distribution functions. IEEE Comput. Graph. Appl. 26, 1, 30–36. Google ScholarDigital Library
8. Cook, R. L., and Torrance, K. E. 1981. A reflectance model for computer graphics. In SIGGRAPH ’81: Proceedings of the 8th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, 307–316. Google ScholarDigital Library
9. Debevec, P. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 189–198. Google ScholarDigital Library
10. Dror, R. O., Adelson, E. H., and Willsky, A. S. 2001. Recognition of surface reflectance properties from a single image under unknown real-world illumination. In Proceedings of the Workshop on Identifying Objects Across Variations in Lighting at the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
11. Fairchild, M. D. 1998. Color Appearance Models. Addison-Wesley, Reading, MA.Google Scholar
12. Fleming, R. W., Dror, R. O., and Adelson, E. H. 2001. How do humans determine reflectance properties under unknown illumination? In Proceedings of the Workshop on Identifying Objects Across Variations in Lighting at the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
13. Friedman, M. 1937. The use of ranks to avoid the assumption of normality implicit in the analysis of variance. Journal of the American Statistical Association 32, 200, 675–701.Google ScholarCross Ref
14. He, X. D., Torrance, K. E., Sillion, F. X., and Greenberg, D. P. 1991. A comprehensive physical model for light reflection. In Computer Graphics (Proceedings of SIGGRAPH 91), 175–186. Google ScholarDigital Library
15. Kerr, W. B., and Pellacini, F. 2009. Toward evaluating lighting design interface paradigms for novice users. ACM Transactions on Graphics 28, 3 (July), 26:1–26:9. Google ScholarDigital Library
16. Lafortune, E. P. F., Foo, S.-C., Torrance, K. E., and Greenberg, D. P. 1997. Non-linear approximation of reflectance functions. In Proceedings of SIGGRAPH 97, Computer Graphics Proceedings, Annual Conference Series, 117–126. Google ScholarDigital Library
17. Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse shade trees for non-parametric material representation and editing. ACM Transactions on Graphics (Proc. SIGGRAPH) 25, 3 (July), 735–745. Google ScholarDigital Library
18. Marks, J., Andalman, B., Beardsley, P. A., Freeman, W., Gibson, S., Hodgins, J. K., Kang, T., Mirtich, B., Pfister, H., Ruml, W., Ryall, K., Seims, J., and Shieber, S. 1997. Design galleries: A general approach to setting parameters for computer graphics and animation. In Proceedings of SIGGRAPH ’97, 389–400. Google ScholarDigital Library
19. Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics 22, 3 (July), 759–769. Google ScholarDigital Library
20. Ngan, A., Durand, F., and Matusik, W. 2005. Experimental analysis of BRDF models. In Rendering Techniques 2005: 16th Eurographics Workshop on Rendering, 117–126. Google ScholarDigital Library
21. Ngan, A., Durand, F., and Matusik, W. 2006. Image-driven navigation of analytical BRDF models. In Eurographics Symposium on Rendering 2006, 399–408. Google ScholarDigital Library
22. Nicodemus, F. E., Richmond, J. C., Hsia, J. J., Ginsberg, I. W., and Limperis, T. 1977. Geometrical Considerations and Nomenclature for Reflectance. National Bureau of Standards (US) Monograph 160.Google Scholar
23. Pacanowski, R., Granier, X., Schlick, C., and Poulin, P. 2008. Sketch and paint-based interface for highlight modeling. In Eurographics Workshop on Sketch-based Interfaces and Modeling 2008, 17–23. Google ScholarDigital Library
24. Pellacini, F., and Lawrence, J. 2007. Appwand: Editing measured materials using appearance-driven optimization. ACM Transactions on Graphics 26, 3, 54:1–54:9. Google ScholarDigital Library
25. Pellacini, F., Ferwerda, J. A., and Greenberg, D. P. 2000. Toward a psychophysically-based light reflection model for image synthesis. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 55–64. Google ScholarDigital Library
26. Poulin, P., and Fournier, A. 1995. Painting surface charactristics. In Eurographics Rendering Workshop, 160–169.Google Scholar
27. Stevens, J. P. 1996. Applied Multivariate Statistics for the Social Sciences, third ed. Lawrence Erlbaum Associates Inc. Google ScholarDigital Library
28. Talton, J. O., Gibson, D., Yang, L., Hanrahan, P., and Koltun, V. 2009. Exploratory modeling with collaborative design spaces. In SIGGRAPH Asia ’09: ACM SIGGRAPH Asia 2009 papers, ACM, New York, NY, USA, 1–10. Google ScholarDigital Library
29. Vangorp, P., Laurijssen, J., and Dutré, P. 2007. The influence of shape on the perception of material reflectance. ACM Transactions on Graphics 26, 3, 77:1–77:9. Google ScholarDigital Library
30. Ward, G. J. 1992. Measuring and modeling anisotropic reflection. In SIGGRAPH ’92: Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, 265–272. Google ScholarDigital Library
31. Westlund, H. B., and Meyer, G. W. 2001. Applying appearance standards to light reflection models. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 501–510. Google ScholarDigital Library
32. Wills, J., Agarwal, S., Kriegman, D., and Belongie, S. 2009. Toward a perceptual space for gloss. ACM Transactions on Graphics 28, 4 (Aug.), 103:1–103:15. Google ScholarDigital Library