“A versatile HDR video production system” by Tocci, Kiser, Tocci and Sen

  • ©Michael D. Tocci, Chris Kiser, Nora Tocci, and Pradeep Sen




    A versatile HDR video production system



    Although High Dynamic Range (HDR) imaging has been the subject of significant research over the past fifteen years, the goal of acquiring cinema-quality HDR images of fast-moving scenes using available components has not yet been achieved. In this work, we present an optical architecture for HDR imaging that allows simultaneous capture of high, medium, and low-exposure images on three sensors at high fidelity with efficient use of the available light. We also present an HDR merging algorithm to complement this architecture, which avoids undesired artifacts when there is a large exposure difference between the images. We implemented a prototype high-definition HDR-video system and we present still frames from the acquired HDR video, tonemapped with various techniques.


    1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Trans. Graph. 23 (August), 294–302. Google ScholarDigital Library
    2. Aggarwal, M., and Ahuja, N. 2001. Split aperture imaging for high dynamic range. In Proceedings of ICCV 2001, 10–17.Google Scholar
    3. Aggarwal, M., and Ahuja, N. 2004. Split aperture imaging for high dynamic range. International Journal of Computer Vision 58, 7–17. Google ScholarDigital Library
    4. Ajdin, B., Hullin, M., Fuchs, C., Seidel, H.-P., and Lensch, H. 2008. Demosaicing by smoothing along 1D features. In Proceedings of CVPR 2008, 1–8.Google Scholar
    5. Brajovic, V., and Kanade, T. 1996. A sorting image sensor: an example of massively parallel intensity-to-time processing for low-latency computational sensors. In Proceedings of ICRA, 1996, vol. 2, 1638–1643.Google Scholar
    6. Cole, A., and Safai, M., 2010. Soviet Montage Productions. http://www.sovietmontage.com/.Google Scholar
    7. Debevec, P. E., and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. In Proceedings of ACM SIGGRAPH 1997, 369–378. Google ScholarDigital Library
    8. Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Trans. Graph. 21 (July), 249–256. Google ScholarDigital Library
    9. Ginosar, R., Hilsenrath, O., and Zeevi, Y., 1992. Wide dynamic range camera. United States Patent #5,144,442.Google Scholar
    10. Granados, M., Ajdin, B., Wand, M., Theobalt, C., Seidel, H.-P., and Lensch, H. 2010. Optimal HDR reconstruction with linear digital cameras. In Proceedings of CVPR 2010.Google Scholar
    11. Harvey, R., 1998. Optical beam splitter and electronic high speed camera incorporating such a beam splitter. United States Patent #5,734,507.Google Scholar
    12. Hasinoff, S. W., Durand, F., and Freeman, W. T. 2010. Noise-optimal capture for high dynamic range photography. In Proceedings of CVPR 2010.Google Scholar
    13. Jai. 2009. Using image fusion to capture high-dynamic range (HDR) scenes. Tech. Rep. TN-0903. JAI, Inc., Japan.Google Scholar
    14. Kang, S. B., Uyttendaele, M., Winder, S., and Szeliski, R. 2003. High dynamic range video. In Proceedings of ACM SIGGRAPH 2003, ACM, 319–325. Google Scholar
    15. Kao, W.-C. 2008. High dynamic range imaging by fusing multiple raw images and tone reproduction. IEEE Transactions on Consumer Electronics 54, 1 (Feb.), 10–15. Google Scholar
    16. Kell, R., and Sziklai, G., 1951. Simultaneous color television. United States Patent #2,560,351.Google Scholar
    17. Krymski, A., 2008. High dynamic range imager with a rolling shutter. United States Patent #7,397,509.Google Scholar
    18. Malvar, H., wei He, L., and Cutler, R. 2004. High-quality linear interpolation for demosaicing of Bayer-patterned color images. In Proceedings of ICASSP 2004, vol. 3, 485–488.Google Scholar
    19. Mann, S., and Picard, R. W. 1995. On being ‘undigital’ with digital cameras: Extending dynamic range by combining differently exposed pictures. In Proceedings of Society for Imaging Science and Technology’s 48th Annual Conference, 442–448.Google Scholar
    20. McCann, J., and Rizzi, A. 2007. Veiling glare: the dynamic range limit of HDR images. In Human Vision and Electronic Imaging XII, SPIE.Google Scholar
    21. McGuire, M., Matusik, W., Pfister, H., Chen, B., Hughes, J., and Nayar, S. 2007. Optical splitting trees for high-precision monocular imaging. IEEE Computer Graphics and Applications 27, 2 (march-april), 32–42. Google ScholarDigital Library
    22. Mertens, T., Kautz, J., and Reeth, F. V. 2008. Exposure fusion: A simple and practical alternative to high dynamic range photography. Computer Graphics Forum 28, 1, 161–171.Google ScholarCross Ref
    23. Mitsunaga, T., and Nayar, S. 1999. Radiometric self calibration. In Proceedings of CVPR 1999, vol. 1, 374–380.Google Scholar
    24. Myszkowski, K., Mantiuk, R., and Krawczyk, G. 2008. High Dynamic Range Video. Morgan & Claypool. Google Scholar
    25. Nayar, S., and Branzoi, V. 2003. Adaptive dynamic range imaging: optical control of pixel exposures over space and time. In Proceedings of ICCV 2003, 1168–1175. Google ScholarDigital Library
    26. Nayar, S., and Mitsunaga, T. 2000. High dynamic range imaging: spatially varying pixel exposures. In Proceedings of CVPR 2000, 472–479.Google Scholar
    27. Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a hand-held plenoptic camera. Tech. Rep. CSTR 2005-02, Stanford University.Google Scholar
    28. Robertson, M. A., Borman, S., and Stevenson, R. L. 2003. Estimation-theoretic approach to dynamic range enhancement using multiple exposures. Journal of Electronic Imaging 12, 2 (april), 219–228.Google ScholarCross Ref
    29. Seger, U., Apel, U., and Höfflinger, B. 1999. HDRC-Imagers for natural visual perception. In Handbook of Computer Vision and Application, B. Jähne, H. Haußecker, and P. Geißler, Eds., vol. 1. Academic Press, 223–235.Google Scholar
    30. Smith, K., Krawczyk, G., Myszkowski, K., and Seidel, H.-P. 2006. Beyond tone mapping: Enhanced depiction of tone mapped HDR images. Computer Graphics Forum 25, 3, 427–438.Google ScholarCross Ref
    31. SpheronVR, 2011. http://www.spheron.com/.Google Scholar
    32. Unger, J., and Gustavson, S. 2007. High-dynamic-range video for photometric measurement of illumination. SPIE, vol. 6501, 65010E.Google Scholar
    33. Wang, H., Raskar, R., and Ahuja, N. 2005. High dynamic range video using split aperture camera. In Proceedings of OMNIVIS 2005.Google Scholar
    34. ZEMAX, 2011. Optical design software. http://www.zemax.com/.Google Scholar

ACM Digital Library Publication: