“A Case Study on Raytracing-in-the-Loop Optimization:Focal Surface Displays” by Matsuda, Fix and Lanman

  • ©Nathan Matsuda, Alexander Fix, and Douglas Lanman

  • ©Nathan Matsuda, Alexander Fix, and Douglas Lanman

  • ©Nathan Matsuda, Alexander Fix, and Douglas Lanman

  • ©Nathan Matsuda, Alexander Fix, and Douglas Lanman

  • ©Nathan Matsuda, Alexander Fix, and Douglas Lanman



Entry Number: 78


    A Case Study on Raytracing-in-the-Loop Optimization:Focal Surface Displays



    Optimization-based design of optical systems can yield configurations that would be impractical to achieve with manual parameter adjustment. Nonetheless, most approaches are geared toward one-time, offline generation of static configurations to be fabricated physically. Recently, challenging computational imaging problems, such as seeing around corners or through scattering media, have utilized dynamically addressable optical elements to probe scene light transport. A new class of optimization techniques targeted at these dynamic applications has emerged in which stochastic raytracing replaces the fixed operators applied with conventional optimization methods. By modeling optical systems as raytracing operators, more complex non-linear phenomena and larger problem sizes can be considered.

    We introduce a simple raytracing-in-the-loop optimization model for a head-mounted display (HMD) containing a spatial light modulator (SLM). Using this approach, we are able to compute color images to be displayed in concert with spatially varying SLM phase maps at a resolution that would otherwise be computationally in-feasible. We also consider extensions of this model that may further enhance the performance of the target system.


    Ioannis Gkioulekas, Shuang Zhao, Kavita Bala, Todd Zickler, and Anat Levin. 2013. Inverse volume rendering with material dictionaries. ACM Transactions on Graphics (TOG) 32, 6 (2013), 162.Google ScholarDigital Library
    Jonathan Klein, Christoph Peters, Jaime Martín, Martin Laurenzis, and Matthias B Hullin. 2016. Tracking objects outside the line of sight using 2D intensity images. Scientific Reports 6 (2016).Google Scholar
    Nathan Matsuda, Alexander Fix, and Douglas Lanman. 2017. Focal Surface Displays. ACM Trans. Graph. 36, 4 (2017). Google ScholarDigital Library
    Shree K Nayar, Katsushi Ikeuchi, and Takeo Kanade. 1991. Shape from interreflections. International Journal of Computer Vision 6, 3 (1991), 173–195.Google ScholarDigital Library
    Steven G. Parker, James Bigler, Andreas Dietrich, Heiko Friedrich, Jared Hoberock, David Luebke, David McAllister, Morgan McGuire, Keith Morley, Austin Robison, and Martin Stich. 2010. OptiX: A General Purpose Ray Tracing Engine. ACM Transactions on Graphics (2010).Google Scholar
    David George Voelz. 2011. Computational Fourier Optics: A MATLAB Tutorial. SPIE Press.



ACM Digital Library Publication:

Overview Page: