“Texture space caching and reconstruction for ray tracing”
Conference:
Type(s):
Title:
- Texture space caching and reconstruction for ray tracing
Session/Category Title: All About Sampling
Presenter(s)/Author(s):
Abstract:
We present a texture space caching and reconstruction system for Monte Carlo ray tracing. Our system gathers and filters shading on-demand, including querying secondary rays, directly within a filter footprint around the current shading point. We shade on local grids in texture space with primary visibility decoupled from shading. Unique filters can be applied per material, where any terms of the shader can be chosen to be included in each kernel. This is a departure from recent screen space image reconstruction techniques, which typically use a single, complex kernel with a set of large auxiliary guide images as input. We show a number of high-performance use cases for our system, including interactive denoising of Monte Carlo ray tracing with motion/defocus blur, spatial and temporal shading reuse, cached product importance sampling, and filters based on linear regression in texture space.
References:
1. Andersson, M., Hasselgren, J., Toth, R., and Akenine-Möller, T. 2014. Adaptive Texture Space Shading for Stochastic Rendering. Computer Graphics Forum, 33, 2, 341–350.
2. Bastos, R., Goslin, M., and Zhang, H. 1997. Efficient Radiosity Rendering using Textures and Bicubic Reconstruction. In Symposium on Interactive 3D Graphics, 71–74.
3. Bauszat, P., Eisemann, M., John, S., and Magnor, M. 2015. Sample-Based Manifold Filtering for Interactive Global Illumination and Depth of Field. Computer Graphics Forum, 34, 1, 265–276.
4. Belcour, L., Soler, C., Subr, K., Holzschuch, N., and Durand, F. 2013. 5D Covariance Tracing for Efficient Defocus and Motion Blur. ACM Transactions on Graphics, 32, 3, 31:1–31:18.
5. Burley, B., and Lacewell, D. 2008. Ptex: Per-Face Texture Mapping for Production Rendering. In Eurographics Symposium on Rendering, 1155–1164.
6. Burns, C. A., Fatahalian, K., and Mark, W. R. 2010. A Lazy Object-Space Shading Architecture with Decoupled Sampling. In High-Performance Graphics, 19–28.
7. Clarberg, P., and Akenine-Möller, T. 2008. Practical Product Importance Sampling for Direct Illumination. Computer Graphics Forum (Proceedings of Eurographics 2008) 27, 2, 681–690.
8. Clarberg, P., Jarosz, W., Akenine-Möller, T., and Jensen, H. W. 2005. Wavelet Importance Sampling: Efficiently Evaluating Products of Complex Functions. ACM Transactions on Graphics, 24, 3, 1166–1175.
9. Clarberg, P., Toth, R., Hasselgren, J., Nilsson, J., and Akenine-Möller, T. 2014. AMFS: Adaptive Multi-Frequency Shading for Future Graphics Processors. ACM Transactions on Graphics, 33, 4, 141:1–141:12.
10. Cook, R. L., Carpenter, L., and Catmull, E. 1987. The Reyes Image Rendering Architecture. In Computer Graphics (Proceedings of SIGGRAPH 87), ACM, vol. 21, 95–102.
11. Djeu, P., Hunt, W., Wang, R., Elhassan, I., Stoll, G., and Mark, W. R. 2011. Razor: An Architecture for Dynamic Multiresolution Ray Tracing. ACM Transactions on Graphics, 30, 5, 115:1–115:26.
12. Egan, K., Tseng, Y.-T., Holzschuch, N., Durand, F., and Ramamoorthi, R. 2009. Frequency Analysis and Sheared Reconstruction for Rendering Motion Blur. ACM Transactions on Graphics, 28, 3, 93:1–93:13.
13. Egan, K., Durand, F., and Ramamoorthi, R. 2011. Practical Filtering for Efficient Ray-Traced Directional Occlusion. ACM Transactions on Graphics, 30, 6, 180:1-180:10.
14. Egan, K., Hecht, F., Durand, F., and Ramamoorthi, R. 2011. Frequency Analysis and Sheared Filtering for Shadow Light Fields of Complex Occluders. ACM Transactions on Graphics, 30, 2, 9:1–9:13.
15. Eisenacher, C., Nichols, G., Selle, A., and Burley, B. 2013. Sorted Deferred Shading for Production Path Tracing. Computer Graphics Forum, 32, 4, 125–132.
16. Gastal, E. S. L., and Oliveira, M. M. 2012. Adaptive Manifolds for Real-Time High-Dimensional Filtering. ACM Transactions on Graphics, 31, 4, 33:1–33:13.
17. Gribel, C. J., Barringer, R., and Akenine-Möller, T. 2011. High-Quality Spatio-Temporal Rendering using Semi-Analytical Visibility. ACM Transactions on Graphics, 30, 4, 54:1–54:12.
18. Hasselgren, J., Munkberg, J., and Vaidyanathan, K. 2015. Practical Layered Reconstruction for Defocus and Motion Blur. Journal of Computer Graphics Techniques (JCGT), 4, 2, 45–58.
19. Heckbert, P. S. 1990. Adaptive Radiosity Textures for Bidirectional Ray Tracing. In Computer Graphics (Proceedings of SIGGRAPH 90), ACM, 145–154.
20. Hillesland, K. E., and Yang, J. C. 2016. Texel Shading. In Eurographics 2016 Short Papers.
21. Hou, Q., and Zhou, K. 2011. A Shading Reuse Method for Efficient Micropolygon Ray Tracing. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 30, 6, 151:1–151:8.
22. Hou, Q., Qin, H., Li, W., Guo, B., and Zhou, K. 2010. Micropolygon Ray Tracing with Defocus and Motion Blur. ACM Transactions on Graphics, 29, 4, 64:1–64:10.
23. Igehy, H. 1999. Tracing Ray Differentials. In Proceedings of SIGGRAPH 1999, ACM Press, 179–186.
24. Jensen, H. W. 2001. Realistic Image Synthesis Using Photon Mapping. AK Peters Ltd.
25. Kalantari, N. K., Bako, S., and Sen, P. 2015. A Machine Learning Approach for Filtering Monte Carlo Noise. ACM Transactions on Graphics, 34, 4, 122:1–122:12.
26. Keller, A., Dahm, K., and Binder, N. 2014. Path Space Filtering for Integro-Approximation Problems. In Eleventh International Conference on Monte Carlo and Quasi-Monte Carlo Methods in Scientific Computing.
27. Lehtinen, J., Aila, T., Chen, J., Laine, S., and Durand, F. 2011. Temporal Light Field Reconstruction for Rendering Distribution Effects. ACM Transactions on Graphics, 30, 4, 55:1–55:12.
28. Luksch, C., Tobler, R. F., Habel, R., Schwärzler, M., and Wimmer, M. 2013. Fast Light-Map Computation with Virtual Polygon Lights. In Proceedings of I3D, 87–94.
29. Mehta, S., Wang, B., and Ramamoorthi, R. 2012. Axis-Aligned Filtering for Interactive Sampled Soft Shadows. ACM Transactions on Graphics, 31, 6, 163:1–163:10.
30. Mehta, S. U., Wang, B., Ramamoorthi, R., and Durand, F. 2013. Axis-Aligned Filtering for Interactive Physically-based Diffuse Indirect Lighting. ACM Transactions on Graphics, 32, 4, 96:1–96:12.
31. Mehta, S. U., Yao, J., Ramamoorthi, R., and Durand, F. 2014. Factored Axis-aligned Filtering for Rendering Multiple Distribution Effects. ACM Transactions on Graphics, 33, 4, 57:1–57:12.
32. Mehta, S. U., Kim, K., Pajak, D., Pulli, K., Kautz, J., and Ramamoorthi, R. 2015. Filtering Environment Illumination for Interactive Physically-Based Rendering in Mixed Reality. In Eurographics Symposium on Rendering (EI&I).
33. Meyer, M., and Anderson, J. 2006. Statistical Acceleration for Animated Global Illumination. ACM Transactions on Graphics, 25, 3, 1075–1080.
34. Moon, B., Carr, N., and Yoon, S.-E. 2014. Adaptive Rendering Based on Weighted Local Regression. ACM Transactions on Graphics, 33, 5, 170:1–170:14.
35. Moon, B., Iglesias-Guitian, J. A., Yoon, S.-E., and Mitchell, K. 2015. Adaptive Rendering with Linear Predictions. ACM Transactions on Graphics, 34, 4, 121:1–121:11.
36. Munkberg, J., Vaidyanathan, K., Hasselgren, J., Clarberg, P., and Akenine-Möller, T. 2014. Layered Light Field Reconstruction for Defocus and Motion Blur. Computer Graphics Forum, 33, 4, 81–92.
37. Parker, S. G., Bigler, J., Dietrich, A., Friedrich, H., Hoberock, J., Luebke, D., McAllister, D., McGuire, M., Morley, K., Robison, A., and Stich, M. 2010. OptiX: A General Purpose Ray Tracing Engine. ACM Transactions on Graphics, 29, 4, 66:1–66:13.
38. Pharr, M., and Humphreys, G. 2010. Physically Based Rendering: From Theory to Implementation, 2nd ed. Morgan Kaufmann.
39. Ragan-Kelley, J., Lehtinen, J., Chen, J., Doggett, M., and Durand, F. 2011. Decoupled Sampling for Graphics Pipelines. ACM Transactions on Graphics, 30, 3, 17:1–17:17.
40. Ray, N., Ulysse, J.-C., Cavin, X., and Lévy, B. 2003. Generation of Radiosity Texture Atlas for Realistic Real-Time Rendering. In Eurographics Short Papers.
41. Rousselle, F., Knaus, C., and Zwicker, M. 2011. Adaptive Sampling and Reconstruction Using Greedy Error Minimization. ACM Transactions on Graphics, 30, 6, 159:1–159:12.
42. Rousselle, F., Manzi, M., and Zwicker, M. 2013. Robust Denoising using Feature and Color Information. Computer Graphics Forum 32, 7, 121–130. Cross Ref
43. Vaidyanathan, K., Munkberg, J., Clarberg, P., and Salvi, M. 2015. Layered Light Field Reconstruction for Defocus Blur. ACM Transactions on Graphics, 34, 2, 23:1–23:12.
44. Veach, E. 1998. Robust Monte Carlo Methods for Light Transport Simulation. PhD thesis.
45. Wald, I., Woop, S., Benthin, C., Johnson, G. S., and Ernst, M. 2014. Embree: A Kernel Framework for Efficient CPU Ray Tracing. ACM Transactions on Graphics, 33, 4, 143:1–143:8.
46. Ward, G. J., Rubinstein, F. M., and Clear, R. D. 1988. A Ray Tracing Solution for Diffuse Interreflection. In Computer Graphics (Proceedings of SIGGRAPH 88), ACM, 85–92.
47. Yan, L.-Q., Mehta, S. U., Ramamoorthi, R., and Durand, F. 2015. Fast 4D Sheared Filtering for Interactive Rendering of Distribution Effects. ACM Transactions on Graphics 35, 1, 7:1–7:13.
48. Yuksel, C., Keyser, J., and House, D. H. 2010. Mesh Colors. ACM Transactions on Graphics, 29, 2, 15:1–15:11.
49. Zimmer, H., Rousselle, F., Jakob, W., Wang, O., Adler, D., Jarosz, W., Sorkine-Hornung, O., and Sorkine-Hornung, A. 2015. Path-space Motion Estimation and Decomposition for Robust Animation Filtering. Computer Graphics Forum, 34, 4, 131–142.
50. Zwicker, M., Jarosz, W., Lehtinen, J., Moon, B., Ramamoorthi, R., Rousselle, F., Sen, P., Soler, C., and Yoon, S.-E. 2015. Recent Advances in Adaptive Sampling and Reconstruction for Monte Carlo Rendering. Computer Graphics Forum (Proceedings of Eurographics), 34, 2, 667–681.
