“User-guided white balance for mixed lighting conditions”
Conference:
Type(s):
Title:
- User-guided white balance for mixed lighting conditions
Session/Category Title: Color and Photos
Presenter(s)/Author(s):
Abstract:
Proper white balance is essential in photographs to eliminate color casts due to illumination. The single-light case is hard to solve automatically but relatively easy for humans. Unfortunately, many scenes contain multiple light sources such as an indoor scene with a window, or when a flash is used in a tungsten-lit room. The light color can then vary on a per-pixel basis and the problem becomes challenging at best, even with advanced image editing tools.We propose a solution to the ill-posed mixed light white balance problem, based on user guidance. Users scribble on a few regions that should have the same color, indicate one or more regions of neutral color, and select regions where the current color looks correct. We first expand the provided scribble groups to more regions using pixel similarity and a robust voting scheme. We formulate the spatially varying white balance problem as a sparse data interpolation problem in which the user scribbles and their extensions form constraints. We demonstrate that our approach can produce satisfying results on a variety of scenes with intuitive scribbles and without any knowledge about the lights.
References:
1. An, X., and Pellacini, F. 2008. Appprop:All-pairs appearance-space edit propagation. ACM Trans. on Graphics 27, 3.
2. Bleier, M., Riess, C., Beigpour, S., Eibenberger, E., Angelopoulou, E., Tröger, T., and Kaup, A. 2011. Color constancy and non-uniform illumination: Can existing algorithms work? In IEEE Color and Photometry in Comp. Vision Workshop.
3. Bousseau, A., Paris, S., and Durand, F. 2009. User-assisted intrinsic images. ACM Trans. on Graphics 28, 5.
4. Carroll, R., Ramamoorthi, R., and Agrawala, M. 2011. Illumination decomposition for material recoloring with consistent interreflections. ACM Trans. on Graphics 30, 3.
5. Chen, J., Paris, S., and Durand, F. 2007. Real-time edge-aware image processing with the bilateral grid. ACM Trans. on Graphics 26, 3.
6. Chen, Q., Li, D., and Tang, C. 2012. KNN matting. In IEEE Conf. on Computer Vision and Pattern Recognition.
7. Chong, H., Gortler, S., and Zickler, T. 2007. The von Kries hypothesis and a basis for color constancy. In IEEE International Conf. on Computer Vision.
8. Ebner, M. 2004. Color constancy using local color shifts. In European Conf. on Computer Vision.
9. Ebner, M. 2009. Color constancy based on local space average color. Machine Vision and Applications Journal 20, 5.
10. Finlayson, G. D., Hordley, S. D., and Tastl, I. 2006. Gamut constrained illuminant estimation. International Journal of Computer Vision 67, 1.
11. Gehler, P. V., Rother, C., Blake, A., Minka, T., and Sharp, T. 2008. Bayesian color constancy revisited. In IEEE Conf. on Computer Vision and Pattern Recognition.
12. Gijsenij, A., Lu, R., and Gevers, T. 2011. Color constancy for multiple light sources. IEEE Trans. on Image Processing.
13. Hedgecoe, J. 2009. New Manual of Photography. Dorling Kindersley.
14. Hsu, E., Mertens, T., Paris, S., Avidan, S., and Durand, F. 2008. Light mixture estimation for spatially varying white balance. ACM Trans. on Graphics 27, 3.
15. Jacobson, R. 2000. The manual of photography: photographic and digital imaging. Media Manual Series. Focal Press.
16. Kopf, J., Cohen, M. F., Lischinski, D., and Uyttendaele, M. 2007. Joint bilateral upsampling. ACM Transactions on Graphics 26, 3.
17. Lee, P., and Wu, Y. 2011. Nonlocal matting. In Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, Washington, DC, USA, CVPR ’11, 2193–2200.
18. Levin, A., Lischinski, D., and Weiss, Y. 2006. A closed form solution to natural image matting. In IEEE Conf. on Computer Vision and Pattern Recognition.
19. Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. on Graphics 25, 3.
20. Riess, C., Eibenberger, E., and Angelopoulou, E. 2011. Illuminant color estimation for real-world mixed-illuminant scenes. In IEEE Color and Photometry in Computer Vision Workshop.
21. Shen, L., Tan, P., and Lin, S. 2008. Intrinsic image decomposition with non-local texture cues. In IEEE Conf. on Computer Vision and Patten Recognition.
22. Shen, J., Yang, X., Jia, Y., and Li, X. 2011. Intrinsic images using optimization. In IEEE Conf. on Computer Vision and Pattern Recognition.
23. Vedaldi, A., and Soatto, S. 2008. Quick shift and kernel methods for mode seeking. In European Conf. on Comp. Vision.
