“Factored axis-aligned filtering for rendering multiple distribution effects” by Mehta, Yao, Ramamoorthi and Durand

  • ©Soham Uday Mehta, JiaXian Yao, Ravi Ramamoorthi, and Frédo Durand




    Factored axis-aligned filtering for rendering multiple distribution effects

Session/Category Title: Sampling & Spectra




    Monte Carlo (MC) ray-tracing for photo-realistic rendering often requires hours to render a single image due to the large sampling rates needed for convergence. Previous methods have attempted to filter sparsely sampled MC renders but these methods have high reconstruction overheads. Recent work has shown fast performance for individual effects, like soft shadows and indirect illumination, using axis-aligned filtering. While some components of light transport such as indirect or area illumination are smooth, they are often multiplied by high-frequency components such as texture, which prevents their sparse sampling and reconstruction.We propose an approach to adaptively sample and filter for simultaneously rendering primary (defocus blur) and secondary (soft shadows and indirect illumination) distribution effects, based on a multi-dimensional frequency analysis of the direct and indirect illumination light fields. We describe a novel approach of factoring texture and irradiance in the presence of defocus blur, which allows for pre-filtering noisy irradiance when the texture is not noisy. Our approach naturally allows for different sampling rates for primary and secondary effects, further reducing the overall ray count. While the theory considers only Lambertian surfaces, we obtain promising results for moderately glossy surfaces. We demonstrate 30x sampling rate reduction compared to equal quality noise-free MC. Combined with a GPU implementation and low filtering over-head, we can render scenes with complex geometry and diffuse and glossy BRDFs in a few seconds.


    1. Belcour, L., Soler, C., Subr, K., Holzschuch, N., and Durand, F. 2013. 5D covariance tracing for efficient defocus and motion blur. ACM Transanctions on Graphics 32, 3, 31:1–31:18. Google ScholarDigital Library
    2. Chai, J.-X., Tong, X., Chan, S.-C., and Shum, H.-Y. 2000. Plenoptic Sampling. In Proceedings of SIGGRAPH 00, 307–318. Google ScholarDigital Library
    3. Cook, R., Porter, T., and Carpenter, L. 1984. Distributed Ray Tracing. In Proceedings of SIGGRAPH 84, 137–145. Google ScholarDigital Library
    4. Dabov, K., Foi, A., Katkovnik, V., and Egiazarian, K. 2007. Image denoising by sparse 3D transform-domain collaborative filtering. IEEE Transactions on Image Processing 16, 8, 2080–2095. Google ScholarDigital Library
    5. Dammertz, H., Sewtz, D., Hanika, J., and Lensch, H. P. A. 2010. Edge-avoiding À-trous wavelet transform for fast global illumination filtering. In Proceedings of the Conference on High Performance Graphics, 67–75. Google ScholarDigital Library
    6. Delbracio, M., Musé, P., Buades, A., Chauvier, J., Phelps, N., and Morel, J.-M. 2014. Boosting monte carlo rendering by ray histogram fusion. ACM Transactions on Graphics 33, 1, 8:1–8:15. Google ScholarDigital Library
    7. Durand, F., Holzschuch, N., Soler, C., Chan, E., and Sillion, F. 2005. A Frequency Analysis of Light Transport. ACM Transactions on Graphics 24, 3, 1115–1126. Google ScholarDigital Library
    8. Egan, K., Tseng, Y., Holzschuch, N., Durand, F., and Ramamoorthi, R. 2009. Frequency analysis and sheared reconstruction for rendering motion blur. ACM Transactions on Graphics 28, 3, 93:1–93:13. Google ScholarDigital Library
    9. Egan, K., Hecht, F., Durand, F., and Ramamoorthi, R. 2011. Frequency analysis and sheared filtering for shadow light fields of complex occluders. ACM Transactions on Graphics 30, 2, 9:1–9:13. Google ScholarDigital Library
    10. Gershbein, R., Schröder, P., and Hanrahan, P. 1994. Textures and Radiosity: Controlling Emission and Reflection with Texture Maps. In Proceedings of SIGGRAPH 94, 51–58. Google ScholarDigital Library
    11. Hachisuka, T., Jarosz, W., Weistroffer, R., Dale, K., Humphreys, G., Zwicker, M., and Jensen, H. 2008. Multidimensional adaptive sampling and reconstruction for ray tracing. ACM Transactions on Graphics 27, 3, 33:1–33:10. Google ScholarDigital Library
    12. Kajiya, J. 1986. The Rendering Equation. In Proceedings of SIGGRAPH 86, 143–150. Google ScholarDigital Library
    13. Kalantari, N. K., and Sen, P. 2013. Removing the noise in Monte Carlo rendering with general image denoising algorithms. Computer Graphics Forum (Proc. of Eurographics 2013) 32, 2, 93–102.Google Scholar
    14. Lehtinen, J., Aila, T., Chen, J., Laine, S., and Durand, F. 2011. Temporal light field reconstruction for rendering distribution effects. ACM Transactions on Graphics 30, 4, 55:1–55:12. Google ScholarDigital Library
    15. Lehtinen, J., Aila, T., Laine, S., and Durand, F. 2012. Reconstructing the indirect light field for global illumination. ACM Transanctions on Graphics 31, 4, 51:1–51:10. Google ScholarDigital Library
    16. Li, T.-M., Wu, Y.-T., and Chuang, Y.-Y. 2012. SURE-based optimization for adaptive sampling and reconstruction. ACM Transactions on Graphics 31, 6, 186:1–186:9. Google ScholarDigital Library
    17. Max, N. L., and Lerner, D. M. 1985. A two-and-a-half-D motion-blur algorithm. In Proceedings of SIGGRAPH 85, 85–93. Google ScholarDigital Library
    18. Mehta, S., Wang, B., and Ramamoorthi, R. 2012. Axis-aligned filtering for interactive sampled soft shadows. ACM Transactions on Graphics 31, 6, 163:1–163:10. Google ScholarDigital Library
    19. Mehta, S. U., Wang, B., Ramamoorthi, R., and Durand, F. 2013. Axis-aligned filtering for interactive physically-based diffuse indirect lighting. ACM Transactions on Graphics 32, 4, 96:1–96:12. Google ScholarDigital Library
    20. Mitchell, D. 1991. Spectrally Optimal Sampling for Distribution Ray Tracing. In SIGGRAPH 91, 157–164. Google ScholarDigital Library
    21. Overbeck, R., Donner, C., and Ramamoorthi, R. 2009. Adaptive Wavelet Rendering. ACM Transactions on Graphics 28, 5. Google ScholarDigital Library
    22. Potmesil, M., and Chakravarty, I. 1981. A lens and aperture camera model for synthetic image generation. In Proceedings of SIGGRAPH 81, 297–305. Google ScholarDigital Library
    23. Ramamoorthi, R., and Hanrahan, P. 2001. A Signal-Processing Framework for Inverse Rendering. In Proceedings of SIGGRAPH 01, 117–128. Google ScholarDigital Library
    24. Ritschel, T., Engelhardt, T., Grosch, T., Seidel, H.-P., Kautz, J., and Dachsbacher, C. 2009. Micro-rendering for scalable, parallel final gathering. ACM Transactions on Graphics 28, 5, 132:1–132:8. Google ScholarDigital Library
    25. Rouselle, F., Knaus, C., and Zwicker, M. 2012. Adaptive rendering with non-local means filtering. ACM Transactions on Graphics 31, 6, 195:1–195:11. Google ScholarDigital Library
    26. Rousselle, F., Knaus, C., and Zwicker, M. 2011. Adaptive sampling and reconstruction using greedy error minimization. ACM Transactions on Graphics 30, 6, 159:1–159:12. Google ScholarDigital Library
    27. Sen, P., and Darabi, S. 2012. On filtering the noise from the random parameters in monte carlo rendering. ACM Transactions on Graphics 31, 3, 18:1–18:15. Google ScholarDigital Library
    28. Sen, P., Darabi, S., and Xiao, L. 2011. Compressive rendering of multidimensional scenes. In Proceedings of the 2010 International Conference on Video Processing and Computational Video, Springer-Verlag, Berlin, Heidelberg, 152–183. Google ScholarDigital Library
    29. Shirley, P., and Morley, R. K. 2003. Realistic Ray Tracing, 2 ed. A. K. Peters, Ltd., Natick, MA, USA. Google ScholarDigital Library
    30. Shirley, P., Aila, T., Cohen, J., Enderton, E., Laine, S., Luebke, D., and McGuire, M. 2011. A local image reconstruction algorithm for stochastic rendering. In ACM Symposium on Interactive 3D Graphics, 9–14. Google ScholarDigital Library
    31. Soler, C., Subr, K., Durand, F., Holzschuch, N., and Sillion, F. 2009. Fourier depth of field. ACM Transactions on Graphics 28, 2, 18:1–18:12. Google ScholarDigital Library
    32. Vaidyanathan, K., Munkberg, J., Clarberg, P., and Salvi, M. 2014. Layered Light Field Reconstruction for Defocus Blur. To appear in ACM Transactions on Graphics. http://software.intel.com/en-us/articles/layered-light-field-reconstruction-for-defocus-blur.Google Scholar
    33. Walter, B., Arbree, A., Bala, K., and Greenberg, D. 2006. Multidimensional lightcuts. ACM Transactions on Graphics 25, 3, 1081–1088. Google ScholarDigital Library
    34. Ward, G., and Heckbert, P. 1992. Irradiance Gradients. In Eurographics Rendering Workshop 92, 85–98.Google Scholar

ACM Digital Library Publication: