“Flash matting” by Sun, Li, Kang and Shum

In this paper, we propose a novel approach to extract mattes using a pair of flash/no-flash images. Our approach, which we call flash matting, was inspired by the simple observation that the most noticeable difference between the flash and no-flash images is the foreground object if the background scene is sufficiently distant. We apply a new matting algorithm called joint Bayesian flash matting to robustly recover the matte from flash/no-flash images, even for scenes in which the foreground and the background are similar or the background is complex. Experimental results involving a variety of complex indoors and outdoors scenes show that it is easy to extract high-quality mattes using an off-the-shelf, flash-equipped camera. We also describe extensions to flash matting for handling more general scenes.

1. Agrawal, A., Raskar, R., Nayar, S. K., and Li, Y. 2005. Removing photography artifacts using gradient projection and flash-exposure sampling. In Proceedings of ACM SIGGRAPH 2005, 828–835. Google ScholarDigital Library
2. Berman, A., Vlahos, P., and Dadourian, A. 2000. Comprehensive method for removing from an image the background surrounding a selected object. U.S. Patent 6,134,345.Google Scholar
3. Bolle, R. M., Connell, J. H., Haas, N., Mohan, R., and Taubin, G. 1994. Object imaging system. U. S. Patent 5,631,976.Google Scholar
4. Canny, J. 1986. A computational approach to edge detection. IEEE Trans. on PAMI. 8, 6, 679–698. Google ScholarDigital Library
5. Chuang, Y.-Y., Curless, B., Salesin, D. H., and Szeliski, R. 2001. A bayesian approach to digital matting. In Proceedings of CVPR 2001, vol. II, 264–271.Google Scholar
6. Chuang, Y.-Y., Agarwala, A., Curless, B., Salesin, D. H., and Szeliski, R. 2002. Video matting of complex scenes. In Proceedings of ACM SIGGRAPH 2002, 243–248. Google ScholarDigital Library
7. Eisemann, E., and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. In Proceedings of ACM SIGGRAPH 2004, 673–678. Google ScholarDigital Library
8. Feris, R., Raskar, R., Chen, L., Tan, K., and Turk, M. 2005. Discontinuity preserving stereo with small baseline multi-flash illumination. In Proceedings of ICCV 2005, vol. I, 412–419. Google ScholarDigital Library
9. Fielding, R. 1972. The technique of special effects cinematography. In Focal/Hastings House, London, 3rd edition, 220–243.Google Scholar
10. Hillman, P., Hannah, J., and Renshaw, D. 2001. Alpha channel estimation in high resolution images and image sequences. In Proceedings of CVPR 2001, Vol. I, 1063–1068.Google Scholar
11. McGuire, M., Matusik, W., Pfister, H., Hughes, J. F., and Durand, F. 2005. Defocus video matting. In Proceedings of ACM SIGGRAPH, 567–576. Google ScholarDigital Library
12. Nayar, S. K., and Narasimhan, S. G. 2002. Assorted pixels: Multi-sampled imaging with structural models. In Proceedings of ECCV 2002, vol. IV, 636–652. Google ScholarDigital Library
13. Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., and Toyama., K. 2004. Digital photography with flash and no-flash image pairs. In Proceedings of ACM SIGGRAPH 2004, 664–672. Google ScholarDigital Library
14. Raskar, R., Han Tan, K., Feris, R., Yu, J., and Turk, M. 2004. Non-photorealistic camera: Depth edge detection and stylized rendering using multi-flash imaging. In Proceedings of ACM SIGGRAPH 2004, 673–678. Google ScholarDigital Library
15. Ruzon, M. A., and Tomasi, C. 2000. Alpha estimation in natural images. In Proceedings of CVPR 2000, 18–25.Google Scholar
16. Smith, A. R., and Blinn, J. F. 1996. Blue screen matting. In Proceedings of ACM SIGGRAPH 1996, 259–268. Google ScholarDigital Library
17. Sun, J., Jia, J., Tang, C.-K., and Shum, H.-Y. 2004. Poisson matting. In Proceedings of ACM SIGGRAPH, 315–321. Google ScholarDigital Library
18. Vlahos, P. 1958. Composite photography utilizing sodium vapor illumination. U. S. Patent 3,095,304.Google Scholar
19. Wang, J., and Cohen, M. 2005. An iterative optimization approach for unified image segmentation and matting. In Proceedings of ICCV 2005, vol. II, 936–943. Google ScholarDigital Library