“The diffractive achromat full spectrum computational imaging with diffractive optics”

  • ©Yifan (Evan) Peng, Qiang Fu, Felix Heide, and Wolfgang Heidrich

Conference:


Type:


Title:

    The diffractive achromat full spectrum computational imaging with diffractive optics

Session/Category Title: COMPUTATIONAL CAMERAS

Presenter(s)/Author(s):


Moderator(s):


Abstract:


    Diffractive optical elements (DOEs) have recently drawn great attention in computational imaging because they can drastically reduce the size and weight of imaging devices compared to their refractive counterparts. However, the inherent strong dispersion is a tremendous obstacle that limits the use of DOEs in full spectrum imaging, causing unacceptable loss of color fidelity in the images. In particular, metamerism introduces a data dependency in the image blur, which has been neglected in computational imaging methods so far. We introduce both a diffractive achromat based on computational optimization, as well as a corresponding algorithm for correction of residual aberrations. Using this approach, we demonstrate high fidelity color diffractive-only imaging over the full visible spectrum. In the optical design, the height profile of a diffractive lens is optimized to balance the focusing contributions of different wavelengths for a specific focal length. The spectral point spread functions (PSFs) become nearly identical to each other, creating approximately spectrally invariant blur kernels. This property guarantees good color preservation in the captured image and facilitates the correction of residual aberrations in our fast two-step deconvolution without additional color priors. We demonstrate our design of diffractive achromat on a 0.5mm ultrathin substrate by photolithography techniques. Experimental results show that our achromatic diffractive lens produces high color fidelity and better image quality in the full visible spectrum.

References:


    1. Aieta, F., Genevet, P., Kats, M. A., Yu, N., Blanchard, R., Gaburro, Z., and Capasso, F. 2012. Aberration-free ultrathin flat lenses and axicons at telecom wavelengths based on plasmonic metasurfaces. Nano letters 12, 9, 4932–4936.Google Scholar
    2. Aieta, F., Kats, M. A., Genevet, P., and Capasso, F. 2015. Multiwavelength achromatic metasurfaces by dispersive phase compensation. Science 347, 6228, 1342–1345.Google Scholar
    3. Boyd, S., Parikh, N., Chu, E., Peleato, B., and Eckstein, J. 2011. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine Learning 3, 1, 1–122. Google ScholarDigital Library
    4. Chakrabarti, A., and Zickler, T. 2011. Statistics of real-world hyperspectral images. In Proc. CVPR, IEEE, 193–200. Google ScholarDigital Library
    5. Chan, S. H., Khoshabeh, R., Gibson, K. B., Gill, P. E., and Nguyen, T. Q. 2011. An augmented lagrangian method for total variation video restoration. IEEE Trans. Image Process. 20, 11, 3097–3111. Google ScholarDigital Library
    6. Eberhart, R. C., and Shi, Y. 2001. Particle swarm optimization: developments, applications and resources. In Proc. of 2001 Congress on Evolutionary Computation, IEEE, 81–86.Google Scholar
    7. Fischer, R. E., Tadic-Galeb, B., Yoder, P. R., and Galeb, R. 2008. Optical system design. McGraw Hill. Google ScholarDigital Library
    8. Gill, P. R., and Stork, D. G. 2013. Lensless ultra-miniature imagers using odd-symmetry spiral phase gratings. In Computational Optical Sensing and Imaging, OSA, CW4C-3.Google Scholar
    9. Goodman, J. 2008. Introduction to Fourier optics. McGraw-hill.Google Scholar
    10. Heide, F., Rouf, M., Hullin, M. B., Labitzke, B., Heidrich, W., and Kolb, A. 2013. High-quality computational imaging through simple lenses. ACM Trans. Graph. 32, 5, 149. Google ScholarDigital Library
    11. Jiang, W., Wang, J., and Dong, X. 2013. A novel hybrid algorithm for the design of the phase diffractive optical elements for beam shaping. Opt. Laser Tech. 45, 37–41.Google ScholarCross Ref
    12. Joshi, N., Szeliski, R., and Kriegman, D. 2008. Psf estimation using sharp edge prediction. In Proc. CVPR, IEEE, 1–8.Google Scholar
    13. Kang, G., Tan, Q., Wang, X., and Jin, G. 2010. Achromatic phase retarder applied to mwir & lwir dual-band. Opt. Express 18, 2, 1695–1703.Google ScholarCross Ref
    14. Kim, G., Domínguez-Caballero, J. A., and Menon, R. 2012. Design and analysis of multi-wavelength diffractive optics. Opt. Express 20, 3, 2814–2823.Google ScholarCross Ref
    15. Krishnan, D., and Fergus, R. 2009. Fast image deconvolution using hyper-laplacian priors. In Advances in Neural Information Processing Systems, NIPS, 1033–1041.Google Scholar
    16. Krishnan, D., Tay, T., and Fergus, R. 2011. Blind deconvolution using a normalized sparsity measure. In Proc. CVPR, IEEE, 233–240. Google ScholarDigital Library
    17. Meyers, M. M., 1998. Hybrid refractive/diffractive achromatic camera lens, Feb. 3. US Patent 5,715,091.Google Scholar
    18. Monjur, M., Spinoulas, L., Gill, P. R., and Stork, D. G. 2015. Ultra-miniature, computationally efficient diffractive visual-bar-position sensor. In Proc. SensorComm, IEIFSA.Google Scholar
    19. Muzychenko, Y. B., Zinchik, A., Stafeev, S., and Tomilin, M. 2011. Fractal diffraction elements with variable transmittance and phase shift. In International Commission for Optics (ICO 22), International Society for Optics and Photonics, 80112F–80112F.Google Scholar
    20. Nakai, T., and Ogawa, H. 2002. Research on multi-layer diffractive optical elements and their application to camera lenses. In Diffractive Optics and Micro-Optics, OSA, DMA2.Google Scholar
    21. Nikonorov, A., Skidanov, R., Fursov, V., Petrov, M., Bibikov, S., and Yuzifovich, Y. 2015. Fresnel lens imaging with post-capture image processing. In Proc. CVPR Workshops, IEEE, 33–41.Google Scholar
    22. Peng, Y., Fu, Q., Amata, H., Su, S., Heide, F., and Heidrich, W. 2015. Computational imaging using lightweight diffractive-refractive optics. Opt. Express 23, 24, 31393–31407.Google ScholarCross Ref
    23. Quirin, S., and Piestun, R. 2013. Depth estimation and image recovery using broadband, incoherent illumination with engineered point spread functions {invited}. Applied optics 52, 1, A367–A376.Google Scholar
    24. Samei, E., Flynn, M. J., and Reimann, D. A. 1998. A method for measuring the presampled mtf of digital radiographic systems using an edge test device. Medical physics 25, 1, 102–113.Google Scholar
    25. Schuler, C. J., Hirsch, M., Harmeling, S., and Scholkopf, B. 2011. Non-stationary correction of optical aberrations. In Proc. ICCV, IEEE, 659–666. Google ScholarDigital Library
    26. Schuler, C. J., Burger, H. C., Harmeling, S., and Scholkopf, B. 2013. A machine learning approach for non-blind image deconvolution. In Proc. CVPR, IEEE, 1067–1074. Google ScholarDigital Library
    27. Schwartzburg, Y., Testuz, R., Tagliasacchi, A., and Pauly, M. 2014. High-contrast computational caustic design. ACM Trans. Graph. 33, 4, 74. Google ScholarDigital Library
    28. Shan, Q., Jia, J., and Agarwala, A. 2008. High-quality motion deblurring from a single image. ACM Trans. Graph. 27, 3, 73. Google ScholarDigital Library
    29. Singh, M., Tervo, J., and Turunen, J. 2014. Broadband beam shaping with harmonic diffractive optics. Opt. Express 22, 19, 22680–22688.Google ScholarCross Ref
    30. Skauli, T., and Farrell, J. 2013. A collection of hyperspectral images for imaging systems research. In Proc. IS&T/SPIE Electronic Imaging, SPIE, 86600C–86600C.Google Scholar
    31. Smith, W. J. 2005. Modern lens design. McGraw-Hill.Google Scholar
    32. Stork, D. G., and Gill, P. R. 2014. Optical, mathematical, and computational foundations of lensless ultra-miniature diffractive imagers and sensors. International Journal on Advances in Systems and Measurements 7, 3, 4.Google Scholar
    33. Su, Z., Zeng, K., Liu, L., Li, B., and Luo, X. 2014. Corruptive artifacts suppression for example-based color transfer. IEEE Trans. Multimedia 16, 4, 988–999. Google ScholarDigital Library
    34. Wang, Y., Yun, W., and Jacobsen, C. 2003. Achromatic fresnel optics for wideband extreme-ultraviolet and x-ray imaging. Nature 424, 6944, 50–53.Google Scholar
    35. Wang, P., Mohammad, N., and Menon, R. 2016. Chromaticaberration-corrected diffractive lenses for ultra-broadband focusing. Scientific reports 6.Google Scholar
    36. Yamaguchi, M., Haneishi, H., and Ohyama, N. 2008. Beyond red–green–blue (rgb): Spectrum-based color imaging technology. JIST 52, 1, 10201–1.Google ScholarCross Ref
    37. Ye, G., Jolly, S., Bove Jr, V. M., Dai, Q., Raskar, R., and Wetzstein, G. 2014. Toward bxdf display using multilayer diffraction. ACM Trans. Graph. 33, 6, 191. Google ScholarDigital Library
    38. Yuan, L., Sun, J., Quan, L., and Shum, H.-Y. 2008. Progressive inter-scale and intra-scale non-blind image deconvolution. ACM Trans. Graph. 27, 3, 74. Google ScholarDigital Library
    39. Yue, T., Suo, J., Wang, J., Cao, X., and Dai, Q. 2015. Blind optical aberration correction by exploring geometric and visual priors. In Proc. CVPR, IEEE, 1684–1692.Google Scholar
    40. Zhou, G., Chen, Y., Wang, Z., and Song, H. 1999. Genetic local search algorithm for optimization design of diffractive optical elements. Appl. Opt. 38, 20, 4281–4290.Google ScholarCross Ref

ACM Digital Library Publication:


Overview Page: