“Digital photography with flash and no-flash image pairs” by Petschnigg, Szeliski, Agrawala, Cohen, Hoppe, et al. …

Digital photography has made it possible to quickly and easily take a pair of images of low-light environments: one with flash to capture detail and one without flash to capture ambient illumination. We present a variety of applications that analyze and combine the strengths of such flash/no-flash image pairs. Our applications include denoising and detail transfer (to merge the ambient qualities of the no-flash image with the high-frequency flash detail), white-balancing (to change the color tone of the ambient image), continuous flash (to interactively adjust flash intensity), and red-eye removal (to repair artifacts in the flash image). We demonstrate how these applications can synthesize new images that are of higher quality than either of the originals.

1. ADAMS, J., PARULSKI, K. AND SPAULDING, K., 1998. Color processing in digital cameras. IEEE Micro, 18(6), pp. 20–30. Google ScholarDigital Library
2. AGARWALA, A., DONTCHEVA, M., AGRAWALA, M., DRUCKER, S., COLBURN, A., CURLESS, B., SALESIN, D. H., AND COHEN, M., 2003. Interactive Digital Photomontage. ACM Transaction on Graphics, 23(3), in this volume. Google ScholarDigital Library
3. AKERS, D., LOSASSO, F., KLINGER, J., AGRAWALA, M., RICK, J., AND HANRAHAN, P., 2003. Conveying shape and features with image-based relighting. IEEE Visualization 2003, pp. 349–354. Google ScholarDigital Library
4. CHOUDHURY, P., AND TUMBLIN, J., 2003. The trilateral filter for high contrast images and meshes. In Eurographics Rendering Symposium, pp. 186–196. Google ScholarDigital Library
5. DEBEVEC, P. E., AND MALIK, J., 1997. Recovering high dynamic range radiance maps from photographs. ACM SIGGRAPH 97, pp. 369–378. Google ScholarDigital Library
6. DEBEVEC, P., HAWKINS, T., TCHOU, C., DUIKER, H., SAROKIN, W. AND SAGAR, M., 2000. Acquiring the reflectance field of the human face. ACM SIGGRAPH 2000, pp. 145–156. Google ScholarDigital Library
7. DICARLO, J. M., XIAO, F., AND WANDELL, B. A., 2001. Illuminating illumination. Ninth Color Imaging Conference, pp. 27–34.Google Scholar
8. DURAND, F., AND DORSEY, J., 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics, 21(3), pp. 257–266. Google ScholarDigital Library
9. EISEMANN, E., AND DURAND, F., 2004. Flash photography enhancement via intrinsic relighting. ACM Transactions on Graphics, 23(3), in this volume. Google ScholarDigital Library
10. FLEISHMAN, S., DRORI, I. AND COHEN-OR, D., 2003. Bilateral mesh denoising. ACM Transaction on Graphics, 22(3), pp. 950–953. Google ScholarDigital Library
11. FUNKA-LEA, G., AND BAJCSY, R., 1995. Active color and geometry for the active, visual recognition of shadows. International Conference on Computer Vision, pp. 203–209. Google ScholarDigital Library
12. GAUBATZ, M., AND ULICHNEY, R., 2002. Automatic red-eye detection and correction. IEEE International Conference on Image Processing, pp. 804–807.Google ScholarCross Ref
13. HAEBERLI, P., 1992. Synthetic lighting for photography. Grafica Obscura, http://www.sgi.com/grafica/synth.Google Scholar
14. JIA, J., SUN, J., TANG, C.-K., AND SHUM, H., 2004. Bayesian correction of image intensity with spatial consideration. ECCV 2004, LNCS 3023, pp. 342–354.Google ScholarCross Ref
15. JONES, T. R., DURAND, F. AND DESBRUN, M., 2003. Non-iterative feature preserving mesh smoothing. ACM Transactions on Graphics, 22(3), pp. 943–949. Google ScholarDigital Library
16. KANG, S. B., UYTTENDAELE, M., WINDER, S., AND SZELISKI, R., 2003. High dynamic range video. ACM Transactions on Graphics, 22(3), pp. 319–325. Google ScholarDigital Library
17. KODAK, 2001. CCD Image Sensor Noise Sources. Application Note MPT/PS-0233.Google Scholar
18. LEE, S. W., AND BAJCSY, R., 1992. Detection of specularity using color and multiple views. European Conference on Computer Vision, pp. 99–114. Google ScholarDigital Library
19. LIU, Z., SHAN., Y., AND ZHANG, Z., 2001. Expressive expression mapping with ratio images. ACM SIGGRAPH 2001. pp. 271–276. Google ScholarDigital Library
20. MASSELUS, V., DUTRE, P., ANRYS, F., 2002. The free-form light stage. In Eurographics Rendering Symposium, pp. 247–256. Google ScholarDigital Library
21. OH, B. M., CHEN, M., DORSEY, J. AND DURAND, F., 2001. Image-based modeling and photo editing. ACM SIGGRAPH 2001, pp. 433–442. Google ScholarDigital Library
22. PATTI, A., KONSTANTINIDES, K., TRETTER, D. AND LIN, Q., 1998. Automatic digital redeye reduction. IEEE International Conference on Image Processing, pp. 55–59.Google ScholarCross Ref
23. PERONA, P., AND MALIK, J., 1990. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(7), pp. 629–639. Google ScholarDigital Library
24. RASKAR, R., YU, J. AND ILIE, A., 2003. A non-photorealistic camera: Detecting silhouettes with multi-flash. ACM SIGGRAPH 2003 Technical Sketch. Google ScholarDigital Library
25. SCHROEDER, M., AND MOSER, S., 2001. Automatic color correction based on generic content-based image analysis. Ninth Color Imaging Conference, pp. 41–45.Google Scholar
26. SHASHUA, A., AND RIKLIN-RAVIV, T., 2001. The quotient image: class based re-rendering and recognition with varying illuminations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(2), pp. 129–139. Google ScholarDigital Library
27. SWAMINATHAN, R., KANG, S. B., SZELISKI, R., CRIMINISI, A. AND NAYAR, S. K., 2002. On the motion and appearance of specularities in image sequences. European Conference on Computer Vision, pp. 1:508–523 Google ScholarDigital Library
28. SZELISKI, R., AND SHUM, H., 1997. Creating full view panoramic image mosaics and environment maps. ACM SIGGRAPH 97, pp. 251–258. Google ScholarDigital Library
29. TOMASI, C., AND MANDUCHI, R., 1998. Bilateral filtering for gray and color images. IEEE International Conference on Computer Vision, pp. 839–846. Google ScholarDigital Library