“Dark flash photography” by Krishnan and Fergus

Camera flashes produce intrusive bursts of light that disturb or dazzle. We present a prototype camera and flash that uses infra-red and ultra-violet light mostly outside the visible range to capture pictures in low-light conditions. This “dark” flash is at least two orders of magnitude dimmer than conventional flashes for a comparable exposure. Building on ideas from flash/no-flash photography, we capture a pair of images, one using the dark flash, other using the dim ambient illumination alone. We then exploit the correlations between images recorded at different wavelengths to denoise the ambient image and restore fine details to give a high quality result, even in very weak illumination. The processing techniques can also be used to denoise images captured with conventional cameras.

1. Agrawal, A., Raskar, R., Nayar, S., and Li, Y. 2005. Removing photography artifacts using gradient projection and flash-exposure sampling. In ACM Transactions on Graphics (Proc. SIGGRAPH), vol. 24, 828–835. Google ScholarDigital Library
2. Aharon, M., Elad, M., and Bruckstein, A. 2006. The KSVD: An algorithm for designing of overcomplete dictionaries for sparse representation. IEEE Trans. Signal Processing 54, 11 (November), 4311–4322. Google ScholarDigital Library
3. Baker, S., Gross, R., and Matthews, I. 2004. Lucas-kanade 20 years on: A unifying framework. International Journal of Computer Vision 56, 221–255. Google ScholarDigital Library
4. Bennett, E., Mason, J., and McMillan, L. 2007. Multispectral bilateral video fusion. IEEE Trans. Image Processing 16, 5, 1185–1194. Google ScholarDigital Library
5. Chakrabarti, A., Hirakawa, K., and Zickler, T. 2008. Color constancy beyond bags of pixels. In CVPR, 1–6.Google Scholar
6. Christian, J., and Zapata, F., 2008. Noise Ninja, Photoshop denoising plugin. http://www.picturecode.com/.Google Scholar
7. Debevec, P. E., and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. ACM Transactions on Graphics (Proc. SIGGRAPH) 31, 3, 369–378. Google ScholarDigital Library
8. Eisemann, E., and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. In ACM Transactions on Graphics (Proc. SIGGRAPH), vol. 23, 673–678. Google ScholarDigital Library
9. Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. In ACM Transactions on Graphics (Proc. SIGGRAPH), vol. 27, 671–680. Google ScholarDigital Library
10. Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., and Freeman, W. 2006. Removing camera shake from a single photograph. ACM Transactions on Graphics (Proc. SIGGRAPH) 25, 787–794. Google ScholarDigital Library
11. Jiaya, J. 2007. Single image motion deblurring using transparency. In CVPR, 1–8.Google Scholar
12. Levin, A., and Weiss, Y. 2007. User assisted separation of reflections from a single image using a sparsity prior. IEEE Trans. Pattern Analysis and Machine Intelligence 29, 9 (Sept), 1647–1654. Google ScholarDigital Library
13. Levin, A., Fergus, R., Durand, F., and Freeman, W. 2007. Image and depth from a conventional camera with a coded aperture. ACM Transactions on Graphics (Proc. SIGGRAPH) 26, 3, 70. Google ScholarDigital Library
14. McAuley, J. J., Caetano, T. S., Smola, A. J., and Franz, M. O. 2006. Learning high-order MRF priors of color images. In ICML ’06, 617–624. Google ScholarDigital Library
15. Mohan, A., Raskar, R., and Tumblin, J. 2008. Agile spectrum imaging: Programmable wavelength modulation for cameras and projectors. Computer Graphics Forum 27, 2, 709–717.Google ScholarCross Ref
16. Morris, N., Avidan, S., Matusik, W., and Pfister, H. 2007. Statistics of infrared images. In CVPR, 1–7.Google Scholar
17. Park, J., Lee, M., Grossberg, M. D., and Nayar, S. K. 2007. Multispectral Imaging Using Multiplexed Illumination. In ICCV, 1–8.Google Scholar
18. Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. ACM Transactions on Graphics (Proc. SIGGRAPH) 23, 3, 664–672. Google ScholarDigital Library
19. Portilla, J., Strela, V., Wainwright, M. J., and Simoncelli, E. P. 2003. Image denoising using a scale mixture of Gaussians in the wavelet domain. IEEE Trans. Image Processing 12, 11 (November), 1338–1351. Google ScholarDigital Library
20. Rorslett, B., 2008. http://www.naturfotograf.com/UV\_flowers_list.html.Google Scholar
21. Roth, S., and Black, M. J. 2005. Fields of Experts: A Framework for Learning Image Priors. In CVPR, vol. 2, 860–867. Google ScholarDigital Library
22. Singh, B., Freeman, W. T., and Brainard, D. H. 2003. Exploiting spatial and spectral image regularities for color constancy. In Workshop on Statistical and Computational Theories of Vision.Google Scholar
23. Telleen, J., Sullivan, A., Yee, J., Wang, O., Gunawardane, P., Collins, I., and Davis, J. 2007. Synthetic shutter speed imaging. Computer Graphics Forum 26, 3 (Sept.), 591–598.Google ScholarCross Ref
24. TLVs. 2001. TLVs and BEIs: threshold limit values for chemical substances and physical agents. American Conference of Governmental Industrial Hygienists.Google Scholar
25. Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In ICCV, 839–846. Google ScholarDigital Library
26. Vos, J. 1978. Colorimetric and photometric properties of a 2-deg fundamental observer. Color Research and Application, 125–128.Google Scholar
27. Wandell, B. A. 1995. Foundations of Vision. Sinauer Associates.Google Scholar
28. Wang, O., Davis, J., Chuang, E., Rickard, I. and de Mesa, K., and Chirag, D. 2008. Video relighting using infrared illumination. Computer Graphics Forum 27.Google Scholar
29. Wang, Y., Yang, J., Yin, W., and Zhang, Y. 2008. A new alternating minimization algorithm for total variation image reconstruction. SIAM J. Imaging Sciences 1, 3, 248–272. Google ScholarDigital Library
30. Yuan, L., Sun, J., Quan, L., and Shum, H.-Y. 2007. Image deblurring with blurred/noisy image pairs. In ACM Transactions on Graphics (Proc. SIGGRAPH), vol. 26, 1–10. Google ScholarDigital Library