“A psychophysically validated metric for bidirectional texture data reduction”
Conference:
Type(s):
Title:
- A psychophysically validated metric for bidirectional texture data reduction
Session/Category Title: Texture
Presenter(s)/Author(s):
Abstract:
Bidirectional Texture Functions (BTF) are commonly thought to provide the most realistic perceptual experience of materials from rendered images. The key to providing efficient compression of BTFs is the decision as to how much of the data should be preserved. We use psychophysical experiments to show that this decision depends critically upon the material concerned. Furthermore, we develop a BTF derived metric that enables us to automatically set a material’s compression parameters in such a way as to provide users with a predefined perceptual quality. We investigate the correlation of three different BTF metrics with psychophysically derived data. Eight materials were presented to eleven naive observers who were asked to judge the perceived quality of BTF renderings as the amount of preserved data was varied. The metric showing the highest correlation with the thresholds set by the observers was the mean variance of individual BTF images. This metric was then used to automatically determine the material-specific compression parameters used in a vector quantisation scheme. The results were successfully validated in an experiment with six additional materials and eighteen observers. We show that using the psychophysically reduced BTF data significantly improves performance of a PCA-based compression method. On average, we were able to increase the compression ratios, and decrease processing times, by a factor of four without any differences being perceived.
References:
1. Daly, S. 1993. The visible differences predictor: an algorithm for the assesment of image fidelity. Digital Images and Human Vision, 179–206. Google Scholar
2. Dana, K. J., van Ginneken, B., Nayar, S. K., and Koen-derink, J. J. 1999. Reflectance and texture of real-world surfaces. ACM Transactions on Graphics 18, 1, 1–34. Google ScholarDigital Library
3. Filip, J., Chantler, M., and Haindl, M. 2008. On optimal resampling of view and illumination dependent textures. In 5th Symposium on Applied Perception in Graphics and Visualization, 131–134. Google Scholar
4. Fleming, R. W., Dror, R. O., and Adelson, E. H. 2003. Real-world illumination and perception of surface reflectance properties. In Journal of Vision, vol. 3, 347–368.Google ScholarCross Ref
5. Haindl, M., and Filip, J. 2007. Extreme compression and modelling of bidirectional texture function. IEEE Trans. on Pattern Analysis and Machine Intelligence, 29, 10, 1859–1865. Google ScholarDigital Library
6. Havran, V., Smyk, M., Krawczyk, G., Myszkowski, K., and Seidel, H.-P. 2005. Interactive system for dynamic scene lighting using captured video environment maps. In Eurographics Symposium on Rendering, 31–42, 311. Google Scholar
7. Ho, Y. X., Landy, M. S., and Maloney, L. T. 2008. Conjoint measurement of gloss and surface texture. Psychological Science 19, 2, 196–204.Google ScholarCross Ref
8. Kautz, J., Boulos, S., and Durand, F. 2007. Interactive editing and modelling of bidirectional texture functions. ACM Transactions on Graphics 26, 3, 53. Google ScholarDigital Library
9. Khang, B.-G., Koenderink, J. J., and Kappers, A. M. L. 2006. Perception of illumination direction in images of 3-D convex objects: Influence of surface materials and light fields. Perception 35, 5, 625–645.Google ScholarCross Ref
10. Lawson, R., Bülthoff, H. H., and Dumbell, S. 2003. Interactions between view changes and shape changes in picture -picture matching. Perception 34, 12, 1465–1498.Google ScholarCross Ref
11. Leung, T., and Malik, J. 2001. Representing and recognizing the visual appearance of materials using three-dimensional textons. International Journal of Computer Vision 43, 1, 29–44. Google ScholarDigital Library
12. Matusik, W., Pfister, H. P. Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics 22, 3, 759–769. Google ScholarDigital Library
13. Meseth, J., Müller, G., Klein, R., Röder, F., and Arnold, M. 2006. Verification of rendering quality from measured BTFs. In 3rd Symposium on Applied perception in Graphics and Visualization, 127–134. Google Scholar
14. Müller, G., Meseth, J., and Klein, R. 2003. Compression and real-time rendering of measured BTFs using local PCA. In Vision, Modeling and Visualisation 2003, 271–280.Google Scholar
15. Müller, G., Meseth, J., Sattler, M., Sarlette, R., and Klein, R. 2005. Acquisition, synthesis and rendering of bidirectional texture functions. Computer Graphics Forum 24, 1, 83–110.Google ScholarCross Ref
16. Ostrovsky, Y., Cavanagh, P., and Sinha, P. 2005. Perceiving illumination inconsistences in scenes. Perception 34, 1301–1314.Google ScholarCross Ref
17. Padilla, S., Drbohlav, O., Green, P., Spence, A., and Chantler, M. 2008. Perceived roughness in 1/f
β noise surfaces. Vision Research 48, 1791–1797.Google ScholarCross Ref
18. Pellacini, F., Ferwerda, J. A., and Greenberg, D. P. 2000. Toward a psychophysically-based light reflection model for image synthesis. In 27th International Conference on computer Graphics and Interactive Techniques, 55–64. Google Scholar
19. Ramanarayanan, G., Ferwerda, J., Walter, B., and Bala, K. 2007. Visual equivalence: towards a new standard for image fidelity. ACM Trans. on Graphics 26, 3, 76:1–76:10. Google ScholarDigital Library
20. Somol, P., and Haindl, M. 2005. Novel path search algorithm for image stitching and advanced texture tiling. In Computer Graph., Visual. and Computer Vision, WSCG05, 155–162.Google Scholar
21. Suen, P., and Healey, G. 2000. The analysis and recognition of real-world textures in three dimensions. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 5, 491–503. Google ScholarDigital Library
22. te Pas, S. F., and Pont, S. C. 2005. A comparison of material and illumination discrimination performance for real rough, real smooth and computer generated smooth spheres. In 2nd Symp. on Applied Perception in Graphics and Visualization, 57–58. Google Scholar
23. te Pas, S. F., and Pont, S. C. 2005. Estimations of light-source direction depend critically on material BRDFs. Perception, ECVP Abstract Supplement 34, 212.Google Scholar
24. Vangorp, P., Laurijssen, J., and Dutre, P. 2007. The influence of shape on the perception of material reflectance. ACM Transactions on Graphics 26, 3, 77:1–77:10. Google ScholarDigital Library
25. Wichmann, F. A., and Hill, N. J. 2001. The psychometric function: I. fitting, sampling, and goodness of fit. Perception & Psychophysics 63, 8, 1293–1313.Google Scholar
