“Evaluation of reverse tone mapping through varying exposure conditions”
Conference:
Type(s):
Title:
- Evaluation of reverse tone mapping through varying exposure conditions
Session/Category Title: Perception
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Most existing image content has low dynamic range (LDR), which necessitates effective methods to display such legacy content on high dynamic range (HDR) devices. Reverse tone mapping operators (rTMOs) aim to take LDR content as input and adjust the contrast intelligently to yield output that recreates the HDR experience. In this paper we show that current rTMO approaches fall short when the input image is not exposed properly. More specifically, we report a series of perceptual experiments using a Brightside HDR display and show that, while existing rTMOs perform well for under-exposed input data, the perceived quality degrades substantially with over-exposure, to the extent that in some cases subjects prefer the LDR originals to images that have been treated with rTMOs. We show that, in these cases, a simple rTMO based on gamma expansion avoids the errors introduced by other methods, and propose a method to automatically set a suitable gamma value for each image, based on the image key and empirical data. We validate the results both by means of perceptual experiments and using a recent image quality metric, and show that this approach enhances visible details without causing artifacts in incorrectly-exposed regions. Additionally, we perform another set of experiments which suggest that spatial artifacts introduced by rTMOs are more disturbing than inaccuracies in the expanded intensities. Together, these findings suggest that when the quality of the input data is unknown, reverse tone mapping should be handled with simple, non-aggressive methods to achieve the desired effect.
References:
1. Akyüz, A. O., and Reinhard, E. 2006. Color appearance in high dynamic range imaging. SPIE Journal of Electronic Imaging 15, 3.Google Scholar
2. Akyüz, A. O., Fleming, R., Riecke, B. E., Reinhard, E., and Bülthoff, H. H. 2007. Do HDR displays support LDR content?: a psychophysical evaluation. ACM Trans. Graph. 26, 3, 38. Google ScholarDigital Library
3. Aydin, T. O., Mantiuk, R., Myszkowski, K., and Seidel, H.-P. 2008. Dynamic range independent image quality assessment. ACM Trans. Graph 27, 3, 69. Google ScholarDigital Library
4. Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. ACM Trans. Graph. 25, 3, 637–645. Google ScholarDigital Library
5. Banterle, F., Ledda, P., Debattista, K., and Chalmers, A. 2006. Inverse tone mapping. In GRAPHITE ’06, ACM, New York, NY, USA, 349–356. Google ScholarDigital Library
6. Banterle, F., Ledda, P., Debattista, K., Chalmers, A., and Bloj, M. 2007. A framework for inverse tone mapping. Vis. Comput. 23, 7, 467–478. Google ScholarDigital Library
7. Banterle, F., Ledda, P., Debattista, K., and Chalmers, A. 2008. Expanding low dynamic range videos for high dynamic range applications. In Proc. of the Spring Conference on Computer Graphics, ACM, New York, NY, USA.Google Scholar
8. Banterle, F., Debattista, K., Artusi, A., Pattanaik, S., Myszkowski, K., Ledda, P., Bloj, M., and Chalmers, A., 2009. High dynamic range imaging and LDR expansion for generating HDR content. Annex Eurographics 2009, April.Google Scholar
9. Banterle, F., Ledda, P., Debattista, K., Bloj, M., Artusi, A., and Chalmers, A. 2009. A psychophysical evaluation of inverse tone mapping techniques. Computer Graphics Forum 28, 1, 13–25.Google ScholarCross Ref
10. Daly, S., and Feng, X. 2003. Bit-depth extension using spatiotemporal microdither based on models of the equivalent input noise of the visual system. In Proc. of Color Imaging VIII: Processing, Hardcopy, and Applications, SPIE, vol. 5008, 455.Google Scholar
11. Daly, S., and Feng, X. 2004. Decontouring: prevention and removal of false contour artifacts. In Proc. of Human Vision and Electronic Imaging IX, SPIE, vol. 5292, 130.Google Scholar
12. Didyk, P., Mantiuk, R., Hein, M., and Seidel, H.-P. 2008. Enhancement of bright video features for HDR displays. Computer Graphics Forum 27, 4, 1265–1274. Google ScholarDigital Library
13. Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27, 3, 67. Google ScholarDigital Library
14. Kovaleski, R. P., and Oliveira, M. M. 2009. High-quality brightness enhancement functions for real-time reverse tone mapping. The Visual Computer 25, 5–7 (April), 539–547. Google ScholarDigital Library
15. Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. Graph. 25, 3, 646–653. Google ScholarDigital Library
16. Martin, M., Fleming, R., Sorkine, O., and Gutierrez, D. 2008. Understanding exposure for reverse tone mapping. In Congreso Español de Informática Gráfica, 189–198.Google Scholar
17. Meylan, L., Daly, S., and Süsstrunk, S. 2006. The reproduction of specular highlights on high dynamic range displays. In IS&T/SID 14th Color Imaging Conference.Google Scholar
18. Meylan, L., Daly, S., and Süsstrunk, S. 2007. Tone mapping for high dynamic range displays. In Proc. IS&T/SPIE Electronic Imaging: Human Vision and Electronic Imaging XII, vol. 6492.Google Scholar
19. Reinhard, E., Stark, M., Shirley, P., and Ferwerda, J. 2002. Photographic tone reproduction for digital images. ACM Trans. Graph. 21, 3, 267–276. Google ScholarDigital Library
20. Rempel, A. G., Trentacoste, M., Seetzen, H., Young, H. D., Heidrich, W., Whitehead, L., and Ward, G. 2007. Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs. ACM Trans. Graph. 26, 3, 39. Google ScholarDigital Library
21. Seetzen, H., Heidrich, W., Stuerzlinger, W., Ward, G., Whitehead, L., Trentacoste, M., Ghosh, A., and Vorozcovs, A. 2004. High dynamic range display systems. ACM Trans. Graph. 23, 3, 760–768. Google ScholarDigital Library
22. Seetzen, H., Li, H., Ye, L., Ward, G., Whitehead, L., and Heidrich, W. 2006. Guidelines for contrast, brightness, and amplitude resolution of displays. In Society for Information Display (SID) Digest, 1229–1233.Google Scholar
23. Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In ICCV, 839–846. Google ScholarDigital Library
24. Tumblin, J., and Rushmeier, H. E. 1993. Tone reproduction for realistic images. IEEE Computer Graphics and Applications 13, 6, 42–48. Google ScholarDigital Library
25. Wang, L., Wei, L.-Y., Zhou, K., Guo, B., and Shum, H.-Y. 2007. High dynamic range image hallucination. In Eurographics Symposium on Rendering, 321–326. Google ScholarCross Ref
26. Ward, G., Rushmeier, H., and Piatko, C. 1997. A visibility matching tone reproduction operator for high dynamic range scenes. IEEE Trans. on Visualization and Computer Graphics 3, 4, 291–306. Google ScholarDigital Library
27. Yoshida, A., Mantiuk, R., Myszkowski, K., and Seidel, H.-P. 2006. Analysis of reproducing real-world appearance on displays of varying dynamic range. Computer Graphics Forum 25, 3, 415–426.Google ScholarCross Ref
