“Fast 4D Sheared Filtering for Interactive Rendering of Distribution Effects”

  • ©Ling-Qi Yan, Soham Uday Mehta, Ravi Ramamoorthi, and Frédo Durand

Conference:


Type:


Title:

    Fast 4D Sheared Filtering for Interactive Rendering of Distribution Effects

Session/Category Title: EFFICIENT SAMPLING & RENDERING

Presenter(s)/Author(s):


Moderator(s):


Abstract:


    Soft shadows, depth of field, and diffuse global illumination are common distribution effects, usually rendered by Monte Carlo ray tracing. Physically correct, noise-free images can require hundreds or thousands of ray samples per pixel, and take a long time to compute. Recent approaches have exploited sparse sampling and filtering; the filtering is either fast (axis-aligned), but requires more input samples, or needs fewer input samples but is very slow (sheared). We present a new approach for fast sheared filtering on the GPU. Our algorithm factors the 4D sheared filter into four 1D filters. We derive complexity bounds for our method, showing that the per-pixel complexity is reduced from O(n2 l2) to O(nl), where n is the linear filter width (filter size is O(n2)) and l is the (usually very small) number of samples for each dimension of the light or lens per pixel (spp is l2). We thus reduce sheared filtering overhead dramatically. We demonstrate rendering of depth of field, soft shadows and diffuse global illumination at interactive speeds. We reduce the number of samples needed by 5-8×, compared to axis-aligned filtering, and framerates are 4× faster for equal quality.

References:


    1. T. Annen, Z. Z. Dong, T. Mertens, P. Bekaert, and H. Seidel. 2008. Real-time all-frequency shadows in dynamic scenes. ACM Transactions on Graphics 27, 3, Article 34, 1–8. 
    2. U. Assarsson and T. Möller. 2003. A geometry-based soft shadow volume algorithm using graphics hardware. ACM Transactions on Graphics 22, 3, 511–520. 
    3. L. Belcour, C. Soler, K. Subr, N. Holzschuch, and F. Durand. 2013. 5D covariance tracing for efficient defocus and motion blur. ACM Transactions on Graphics 32, 3, 31:1–31:18. 
    4. J.-X. Chai, X. Tong, S.-C. Chan, and H.-Y. Shum. 2000. Plenoptic sampling. In Proceedings of SIGGRAPH’00. 307–318. 
    5. P. Clarberg and J. Munkberg. 2014. Deep shading buffers on commodity gpus. ACM Transactions on Graphics 33, 6, 227:1–227:12. 
    6. C. Crassin, F. Neyret, M. Sainz, S. Green, and E. Eiseman. 2011. Interative indirect illumination using voxel cone tracing. Computer Graphics Forum 30, 7, 1921–1930.
    7. F. Crow. 1977. Shadow algorithms for computer graphics. In Proceedings of SIGGRAPH’77. 242–248. 
    8. H. Dammertz, D. Sewtz, J. Hanika, and H. P. A. Lensch. 2010. Edge-avoiding Á-trous wavelet transform for fast global illumination filtering. In Proceedings of the Conference on High Performance Graphics. 67–75. 
    9. M. Delbracio, P. Musé, A. Buades, J. Chauvier, N. Phelps, and J.-M. Morel. 2014. Boosting Monte Carlo rendering by ray histogram fusion. ACM Transactions on Graphics 33, 1, 8:1–8:15. 
    10. F. Durand, N. Holzschuch, C. Soler, E. Chan, and F. Sillion. 2005. A frequency analysis of light transport. ACM Transactions on Graphics 24, 3, 1115–1126. 
    11. K. Egan, F. Durand, and R. Ramamoorthi. 2011a. Practical filtering for efficient ray-traced directional occlusion. ACM Transactions on Graphics 30, 6. 
    12. K. Egan, F. Hecht, F. Durand, and R. Ramamoorthi. 2011b. Frequency analysis and sheared filtering for shadow light fields of complex occluders. ACM Transactions on Graphics 30, 2, 9:1–9:13. 
    13. K. Egan, Y. Tseng, N. Holzschuch, F. Durand, and R. Ramamoorthi. 2009. Frequency analysis and sheared reconstruction for rendering motion blur. ACM Transactions on Graphics 28, 3, 93:1–93:13. 
    14. G. Guennebaud, L. Barthe, and M. Paulin. 2006. Real-time soft shadow mapping by backprojection. In Proceedings of EGSR’06. 227–234. 
    15. G. Guennebaud, L. Barthe, and M. Paulin. 2007. High-quality adaptive soft shadow mapping. Computer Graphics Forum 26, 3, 525–533.
    16. T. Hachisuka, W. Jarosz, R. Weistroffer, K. Dale, G. Humphreys, M. Zwicker, and H. Jensen. 2008. Multidimensional adaptive sampling and reconstruction for ray tracing. ACM Transactions on Graphics 27, 3, 33:1–33:10. 
    17. J. Hasenfratz, M. Lapierre, N. Holzschuch, and F. Sillion, 2003. A survey of real-time soft shadow algorithms. Computer Graphics Forum 22, 4, 753–774.
    18. G. Johnson, W. Hunt, A. Hux, W. Mark, C. Burns, and S. Junkins, 2009. Soft irregular shadow mapping: fast, high-quality, and robust soft shadows. In Proceedings of I3D’09. 57–66. 
    19. N. K. Kalantari and P. Sen. 2013. Removing the noise in Monte Carlo rendering with general image denoising algorithms. Computer Graphics Forum 32, 2, 93–102.
    20. S. Laine, T. Aila, U. Assarsson, J. Lehtinen, and T. Möller. 2005. Soft shadow volumes for ray tracing. ACM Transactions on Graphics 24, 3, 1156–1165. 
    21. S. S. Lee, E. Eisemann, and H.-P. Seidel. 2010. Real-time lens blur effects and focus control. ACM Transactions on Graphics 29, 4, 65:1–65:7. 
    22. J. Lehtinen, T. Aila, J. Chen, S. Laine, and F. Durand. 2011. Temporal light field reconstruction for rendering distribution effects. ACM Transactions on Graphics 30, 4, 55:1–55:12. 
    23. J. Lehtinen, T. Aila, S. Laine, and F. Durand. 2012. Reconstructing the indirect light field for global illumination. ACM Transactions on Graphics 31, 4, 51:1–51:10. 
    24. K. Lei and J. F. Hughes. 2013. Approximate depth of field effects using few samples per pixel. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. I3D’13. ACM, 119–128. 
    25. T.-M. Li, Y.-T. Wu, and Y.-Y. Chuang, 2012. SURE-based optimization for adaptive sampling and reconstruction. ACM Transactions on Graphics 31, 6, 186:1–186:9. 
    26. M. McCool. 1999. Anisotropic diffusion for Monte Carlo noise reduction. ACM Transactions on Graphics 18, 2, 171–194. 
    27. S. Mehta, B. Wang, and R. Ramamoorthi. 2012. Axis-aligned filtering for interactive sampled soft shadows. ACM Transactions on Graphics 31, 6, 163:1–163:10. 
    28. S. Mehta, YAO, J., R. Ramamoorthi, and F. Durand. 2014. Factored axis-aligned filtering for rendering multiple distribution effects. ACM Transactions on Graphics 33, 5. 
    29. S. Mehta, B. Wang, R. Ramamoorthi, and F. Durand. 2013. Axis-aligned filtering for interactive physically-based diffuse indirect lighting. ACM Transactions on Graphics 32, 4, 96:1–96:12. 
    30. D. Mitchell. 1991. Spectrally Optimal Sampling for Distribution Ray Tracing. In Proceedings of SIGGRAPH’91. 157–164. 
    31. J. Munkberg, K. Vaidyanathan, J. Hasselgren, P. P. Clarberg, and T. Akenine-Möller. 2014. Layered reconstruction for defocus and motion blur. In Computer Graphics Forum. Vol. 33. Wiley Online Library, 81–92. 
    32. R. Overbeck, C. C. Donner, and R. Ramamoorthi. 2009. Adaptive wavelet rendering. ACM Transactions on Graphics 28, 5. 
    33. S. Paris and F. Durand. 2006. A fast approximation of the bilateral filter using a signal processing approach. In Proceedings of the 9th European Conference on Computer Vision (ECCV’06). 568–580. 
    34. G. Petschnigg, R. Szeliski, M. Agrawala, M. Cohen, H. H. Hoppe, and K. Toyama. 2004. Digital photography with flash and no-flash image pairs. In SIGGRAPH’04: ACM SIGGRAPH 2004 Papers. ACM, New York, 664–672. 
    35. M. Potmesil and I. Chakravarty. 1981. A lens and aperture camera model for synthetic image generation. In Proceedings of SIGGRAPH’81. 297–305. 
    36. R. Ramamoorthi, J. Anderson, M. Meyer, and D. Nowrouzezahrai. 2012. A theory of Monte Carlo visibility sampling. ACM Transactions on Graphics 31, 5. 
    37. R. Ramamoorthi and P. Hanrahan. 2001. A signal-processing framework for inverse rendering. In Proceedings of SIGGRAPH’01. 117–128. 
    38. T. Ritschel, C. Dachsbacher, T. Grosch, and J. Kautz. 2012. The state of the art in interactive global illumination. Computer Graphics Forum 31, 1, 160–188. 
    39. T. Ritschel, T. Engelhardt, T. Grosch, H.-P. Seidel, J. Kautz, and C. Dachsbacher. 2009. Micro-rendering for scalable, parallel final gathering. ACM Transactions on Graphics 28, 5. 
    40. F. Rouselle, C. Knaus, and M. Zwicker. 2012. Adaptive rendering with non-local means filtering. ACM Transactions on Graphics 31, 6, 195:1–195:11. 
    41. H. Rushmeier and G. Ward. 1994. Energy preserving non-linear filters. 131–138. 
    42. P. Sen and S. Darabi. 2012. On filtering the noise from the random parameters in Monte Carlo rendering. ACM Transactions on Graphics 31, 3, 18:1–18:15. 
    43. P. Shirley, T. Aila, J. Cohen, E. Enderton, S. Laine, D. Luebke, and M. McGuire. 2011. A local image reconstruction algorithm for stochastic rendering. In Proceedings of the ACM Symposium on Interactive 3D Graphics. 9–14. 
    44. P. Sloan, J. Kautz, and J. Snyder. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. ACM Transactions on Graphics 21, 3, 527–536. 
    45. C. Soler and F. Sillion. 1998. Fast calculation of soft shadow textures using convolution. In Proceedings of SIGGRAPH’98. 321–332. 
    46. C. Soler, K. Subr, F. Durand, N. Holzschuch, and F. Sillion. 2009. Fourier depth of field. ACM Transactions on Graphics 28, 2, 18:1–18:12. 
    47. K. Vaidyanathan, J. Munkberg, P. Clarberg, and M. Salvi. 2015. Layered light field reconstruction for defocus blur. ACM Transactions on Graphics 34, 2, 23:1–23:12. 
    48. X. Yu, R. Wang, and J. Yu. 2010. Real-time depth of field rendering via dynamic light field generation and filtering. Computer Graphics Forum 29, 7, 2099–2107.

ACM Digital Library Publication:


Overview Page: