“A versatile HDR video production system” by Tocci, Kiser, Tocci and Sen

Although High Dynamic Range (HDR) imaging has been the subject of significant research over the past fifteen years, the goal of acquiring cinema-quality HDR images of fast-moving scenes using available components has not yet been achieved. In this work, we present an optical architecture for HDR imaging that allows simultaneous capture of high, medium, and low-exposure images on three sensors at high fidelity with efficient use of the available light. We also present an HDR merging algorithm to complement this architecture, which avoids undesired artifacts when there is a large exposure difference between the images. We implemented a prototype high-definition HDR-video system and we present still frames from the acquired HDR video, tonemapped with various techniques.

1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Trans. Graph. 23 (August), 294–302. Google ScholarDigital Library
2. Aggarwal, M., and Ahuja, N. 2001. Split aperture imaging for high dynamic range. In Proceedings of ICCV 2001, 10–17.Google Scholar
3. Aggarwal, M., and Ahuja, N. 2004. Split aperture imaging for high dynamic range. International Journal of Computer Vision 58, 7–17. Google ScholarDigital Library
4. Ajdin, B., Hullin, M., Fuchs, C., Seidel, H.-P., and Lensch, H. 2008. Demosaicing by smoothing along 1D features. In Proceedings of CVPR 2008, 1–8.Google Scholar
5. Brajovic, V., and Kanade, T. 1996. A sorting image sensor: an example of massively parallel intensity-to-time processing for low-latency computational sensors. In Proceedings of ICRA, 1996, vol. 2, 1638–1643.Google Scholar
6. Cole, A., and Safai, M., 2010. Soviet Montage Productions. http://www.sovietmontage.com/.Google Scholar
7. Debevec, P. E., and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. In Proceedings of ACM SIGGRAPH 1997, 369–378. Google ScholarDigital Library
8. Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Trans. Graph. 21 (July), 249–256. Google ScholarDigital Library
9. Ginosar, R., Hilsenrath, O., and Zeevi, Y., 1992. Wide dynamic range camera. United States Patent #5,144,442.Google Scholar
10. Granados, M., Ajdin, B., Wand, M., Theobalt, C., Seidel, H.-P., and Lensch, H. 2010. Optimal HDR reconstruction with linear digital cameras. In Proceedings of CVPR 2010.Google Scholar
11. Harvey, R., 1998. Optical beam splitter and electronic high speed camera incorporating such a beam splitter. United States Patent #5,734,507.Google Scholar
12. Hasinoff, S. W., Durand, F., and Freeman, W. T. 2010. Noise-optimal capture for high dynamic range photography. In Proceedings of CVPR 2010.Google Scholar
13. Jai. 2009. Using image fusion to capture high-dynamic range (HDR) scenes. Tech. Rep. TN-0903. JAI, Inc., Japan.Google Scholar
14. Kang, S. B., Uyttendaele, M., Winder, S., and Szeliski, R. 2003. High dynamic range video. In Proceedings of ACM SIGGRAPH 2003, ACM, 319–325. Google Scholar
15. Kao, W.-C. 2008. High dynamic range imaging by fusing multiple raw images and tone reproduction. IEEE Transactions on Consumer Electronics 54, 1 (Feb.), 10–15. Google Scholar
16. Kell, R., and Sziklai, G., 1951. Simultaneous color television. United States Patent #2,560,351.Google Scholar
17. Krymski, A., 2008. High dynamic range imager with a rolling shutter. United States Patent #7,397,509.Google Scholar
18. Malvar, H., wei He, L., and Cutler, R. 2004. High-quality linear interpolation for demosaicing of Bayer-patterned color images. In Proceedings of ICASSP 2004, vol. 3, 485–488.Google Scholar
19. Mann, S., and Picard, R. W. 1995. On being ‘undigital’ with digital cameras: Extending dynamic range by combining differently exposed pictures. In Proceedings of Society for Imaging Science and Technology’s 48th Annual Conference, 442–448.Google Scholar
20. McCann, J., and Rizzi, A. 2007. Veiling glare: the dynamic range limit of HDR images. In Human Vision and Electronic Imaging XII, SPIE.Google Scholar
21. McGuire, M., Matusik, W., Pfister, H., Chen, B., Hughes, J., and Nayar, S. 2007. Optical splitting trees for high-precision monocular imaging. IEEE Computer Graphics and Applications 27, 2 (march-april), 32–42. Google ScholarDigital Library
22. Mertens, T., Kautz, J., and Reeth, F. V. 2008. Exposure fusion: A simple and practical alternative to high dynamic range photography. Computer Graphics Forum 28, 1, 161–171.Google ScholarCross Ref
23. Mitsunaga, T., and Nayar, S. 1999. Radiometric self calibration. In Proceedings of CVPR 1999, vol. 1, 374–380.Google Scholar
24. Myszkowski, K., Mantiuk, R., and Krawczyk, G. 2008. High Dynamic Range Video. Morgan & Claypool. Google Scholar
25. Nayar, S., and Branzoi, V. 2003. Adaptive dynamic range imaging: optical control of pixel exposures over space and time. In Proceedings of ICCV 2003, 1168–1175. Google ScholarDigital Library
26. Nayar, S., and Mitsunaga, T. 2000. High dynamic range imaging: spatially varying pixel exposures. In Proceedings of CVPR 2000, 472–479.Google Scholar
27. Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a hand-held plenoptic camera. Tech. Rep. CSTR 2005-02, Stanford University.Google Scholar
28. Robertson, M. A., Borman, S., and Stevenson, R. L. 2003. Estimation-theoretic approach to dynamic range enhancement using multiple exposures. Journal of Electronic Imaging 12, 2 (april), 219–228.Google ScholarCross Ref
29. Seger, U., Apel, U., and Höfflinger, B. 1999. HDRC-Imagers for natural visual perception. In Handbook of Computer Vision and Application, B. Jähne, H. Haußecker, and P. Geißler, Eds., vol. 1. Academic Press, 223–235.Google Scholar
30. Smith, K., Krawczyk, G., Myszkowski, K., and Seidel, H.-P. 2006. Beyond tone mapping: Enhanced depiction of tone mapped HDR images. Computer Graphics Forum 25, 3, 427–438.Google ScholarCross Ref
31. SpheronVR, 2011. http://www.spheron.com/.Google Scholar
32. Unger, J., and Gustavson, S. 2007. High-dynamic-range video for photometric measurement of illumination. SPIE, vol. 6501, 65010E.Google Scholar
33. Wang, H., Raskar, R., and Ahuja, N. 2005. High dynamic range video using split aperture camera. In Proceedings of OMNIVIS 2005.Google Scholar
34. ZEMAX, 2011. Optical design software. http://www.zemax.com/.Google Scholar