“A perceptually based physical error metric for realistic image synthesis” by Ramasubramanian, Pattanaik and Greenberg

We introduce a new concept for accelerating realistic image synthesis algorithms. At the core of this procedure is a novel physical error metric that correctly predicts the perceptual threshold for detecting artifacts in scene features. Built into this metric is a computational model of the human visual system’s loss of sensitivity at high background illumination levels, high spatial frequencies, and high contrast levels (visual masking). An important feature of our model is that it handles the luminance-dependent processing and spatially-dependent processing independently. This allows us to precompute the expensive spatially-dependent component, making our model extremely efficient. We illustrate the utility of our procedure with global illumination algorithms used for realistic image synthesis. The expense of global illumination computations is many orders of magnitude higher than the expense of direct illumination computations and can greatly benefit by applying our perceptually based technique. Results show our method preserves visual quality while achieving significant computational gains in areas of images with high frequency texture patterns, geometric details, and lighting variations.

1. Peter G. J. Barten. The Square Root Integral (SQRI): A New Metric to Describe the Effect of Various Display Parameters on Perceived Image Quality. In Human Vision, Visual Processing, and Digital Display, volume 1077, pages 73-82. Proc. of SPIE, 1989.
2. Mark R. Bolin and Gary W. Meyer. A Frequency Based Ray Tracer. In SIGGRAPH 95 Conference Proceedings, pages 409-418, Los Angeles, California, August 1995.
3. Mark R. Bolin and Gary W. Meyer. A Perceptually Based Adaptive Sampling Algorithm. In SIGGRAPH 98 Conference Proceedings, pages 299-310, Orlando, Florida, July 1998.
4. Peter J. Burt and Edward H. Adelson. The Laplacian Pyramid as a Compact Image Code. IEEE Transactions on Communications, 31 (4):532-540, April 1983.
5. Kenneth Chiu and Peter Shirley. Rendering, Complexity and Perception. In Proceedings of the Fifth Eurographics Workshop on Rendering, pages 19-33, Darmstadt, Germany, June 1994.
6. Michael Cohen, Donald P. Greenberg, Dave S. Immel, and Philip J. Brock. An Efficient Radiosity Approach for Realistic Image Synthesis. IEEE Computer Graphics and Applications, 6(3):26-35, March 1986.
7. Scott Daly. The Visible Differences Predictor: An Algorithm for the Assessment of Image Fidelity. In A. B. Watson, editor, Digital Images and Human Vision, pages 179-206. MIT Press, 1993.
8. George Drettakis and Eugene Fiume. A Fast Shadow Algorithm for Area Light Sources Using Backprojection. In SIG- GRAPH 94 Conference Proceedings, pages 223-30, Orlando, Florida, July 1994.
9. James A. Ferwerda, Sumanta N. Pattanaik, Peter Shirley, and Donald P. Greenberg. A Model of Visual Adaptation for Realistic Image Synthesis. In SIGGRAPH 96 Conference Proceedings, pages 249-258, New Orleans, Louisiana, August 1996.
10. James A. Ferwerda, Sumanta N. Pattanaik, Peter Shirley, and Donald P. Greenberg. A Model of Visual Masking for Computer Graphics. In SIGGRAPH 97 Conference Proceedings, pages 143-152, Los Angeles, California, August 1997.
11. S. Gibson and R. J. Hubbold. Perceptually-Driven Radiosity. Computer Graphics Forum, 16(2):129-141, 1997.
12. Donald P. Greenberg, Kenneth E. Torrance, Peter Shirley, James Arvo, James A. Ferwerda, Sumanta N. Pattanaik, Eric P. F. Lafortune, Bruce Walter, Sing-Choong Foo, and Ben Trumbore. A Framework for Realistic Image Synthesis. In SIGGRAPH 97 Conference Proceedings, pages 477-494, Los Angeles, California, August 1997.
13. David Hart, Philip Dutr6, and Donald Greenberg. Direct Illumination with Lazy Visibility Evaluation. In SIGGRAPH 99 Conference Proceedings, Los Angeles, California, August 1999.
14. David Hedley, Adam Worrall, and Derek Paddon. Selective Culling of Discontinuity Lines. In Proceedings of the Eighth Eurographics Workshop on Rendering, pages 69-80, St.Etienne, France, June 1997.
15. James T. Kajiya. The Rendering Equation. In Computer Graphics (SIGGRAPH 86 Proceedings), volume 20, pages 143-150, Dallas, Texas, August 1986.
16. Gregory Ward Larson, Holly Rushmeier, and Christine Piatko. A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes. IEEE Transactions on Visualization and Computer Graphics, 3(4):291-306, October 1997.
17. Jeffrey Lubin. A Visual Discrimination Model for Imaging System Design and Evaluation. In E. Peli, editor, Vision Models for Target Detection and Recognition, pages 245-283. World Scientific, 1995.
18. Gary W. Meyer and Aihua Liu. Color Spatial Acuity Control of a Screen Subdivision Image Synthesis Algorithm. In Bernice E. Rogowitz, editor, Human Vision, Visual Processing, and Digital Display III, volume 1666, pages 387-399. Proc. SPIE, 1992.
19. Don P. Mitchell. Generating Antialiased Images at Low Sampling Densities. In Computer Graphics (SIGGRAPH 87 Proceedings), volume 21, pages 65-72, Anaheim, California, July 1987.
20. Karol Myszkowski. The Visible Differences Predictor: Applications to Global Illumination Problems. In Proceedings of the Ninth Eurographics Workshop on Rendering, pages 223- 236, Vienna, Austria, June 1998.
21. Sumanta N. Pattanaik, James A. Ferwerda, Mark D. Fairchild, and Donald P. Greenberg. A Multiscale Model of Adaptation and Spatial Vision for Realistic Image Display. In SIGGRAPH 98 Conference Proceedings, pages 287-298, Orlando, Florida, July 1998.
22. Holly Rushmeier, Greg Ward, C. Piatko, P. Sanders, and B. Rust. Comparing Real and Synthetic Images: Some Ideas About Metrics. In Proceedings of the Sixth Eurographics Workshop on Rendering, pages 213-222, Dublin, Ireland, June 1995.
23. Peter Shirley, Chang Yaw Wang, and Kurt Zimmerman. Monte Carlo Techniques for Direct Lighting Calculations. ACM Transactions on Graphics, 15(1):1-36, January 1996.
24. Jay Torborg and Jim Kajiya. Talisman: Commodity Real-time 3D Graphics for the PC. In SIGGRAPH 96 Conference Proceedings, pages 353-364, New Orleans, Louisiana, August 1996.
25. F.L. van Nes and M. A. Bouman. Spatial Modulation Transfer in the Human Eye. J. Opt. Soc. Am., 57:401-406, 1967.
26. Andrew Woo, Pierre Poulin, and Alain Fournier. A Survey of Shadow Algorithms. IEEE Computer Graphics and Applications, 10(6):13-32, November 1990.