“Exposing Photo Manipulation With Inconsistent Shadows” by Kee, O’Brien and Farid
Conference:
Type(s):
Title:
- Exposing Photo Manipulation With Inconsistent Shadows
Session/Category Title: Perception
Presenter(s)/Author(s):
Moderator(s):
Abstract:
We describe a geometric technique to detect physically inconsistent arrangements of shadows in an image. This technique combines multiple constraints from cast and attached shadows to constrain the projected location of a point light source. The consistency of the shadows is posed as a linear programming problem. A feasible solution indicates that the collection of shadows is physically plausible, while a failure to find a solution provides evidence of photo tampering.
References:
- Farid, H. 2009. A survey of image forgery detection. IEEE Signal Process. Mag. 2, 26, 16–25.
- Farid, H. and Bravo, M. J. 2010. Image forensic analyses that elude the human visual system. In Proceedings of the SPIE Conference on Media Forensics and Security.
- Jacobson, J. and Werner, S. 2004. Why cast shadows are expendable: Insensitivity of human observers and the inherent ambiguity of cast shadows in pictorial art. Percept. 33, 11, 1369–1383.
- Johnson, M. K. and Farid, H. 2005. Exposing digital forgeries by detecting inconsistencies in lighting. In Proceedings of the 7th Multimedia and Security Workshop. 1–10.
- Johnson, M. K. and Farid, H. 2007. Exposing digital forgeries in complex lighting environments. IEEE Trans. Inf. Forensics Security 3, 2, 450–461.
- Karsch, K., Hedau, V., Forsyth, D., and Hoiem, D. 2011. Rendering synthetic objects into legacy photographs. In Proceedings of the SIGGRAPH Asia Conference. 157:1–157:12.
- Kee, E. and Farid, H. 2010. Exposing digital forgeries from 3-D lighting environments. In Proceedings of the Workshop on Information Forensics and Security.
- Khang, B.-G., Koenderink, J. J., and Kappers, A. 2006. Perception of illumination direction in images of 3-D convex objects: Influence of surface materials and light fields. Percept. 35, 5, 625–645.
- Koenderink, J. J., Pont, S., Van Doorn, A., Kappers, A., and Todd, J. 2007. The visual light field. Percept. 36, 11, 1595–1610.
- Koenderink, J. J., Van Doorn, A., and Pont, S. 2004. Light direction from shad(ow)ed random Gaussian surfaces. Percept. 33, 12, 1405–1420.
- Lalonde, J.-F., Efros, A. A., and Narasimhan, S. G. 2011. Estimating the natural illumination conditions from a single outdoor image. In Proceedings of the International Conference on Computer Vision.
- Liu, Q., Cao, X., Deng, C., and Guo, X. 2011. Identifying image composites through shadow matte consistency. IEEE Trans. Inf. Forensics Secur. 6, 3, 1111–1122.
- Mamassian, P. 2004. Impossible shadows and the shadow correspondence problem. Percept. 33, 11, 1279–1290.
- Nillius, P. and Eklundh, J.-O. 2001. Automatic estimation of the projected light source direction. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
- Okabe, T., Sato, I., and Sato, Y. 2004. Spherical harmonics vs. haar wavelets: Basis for recovering illumination from cast shadows. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1. 50–57.
- O’Shea, J. P., Agrawala, M., and Banks, M. S. 2010. The influence of shape cues on the perception of lighting directions. J. Vis. 12, 10, 21:1–21.
- Ostrovsky, Y., Cavanagh, P., and Sinha, P. 2005. Perceiving illumination inconsistencies in scenes. Percept. 34, 1301–1314.
- Pont, S. and Koenderink, J. 2007. Matching illumination of solid objects. Attent. Percept. Psychophys. 69, 459–468.
- Ramamoorthi, R. and Hanrahan, P. 2001. An efficient representation for irradiance environment maps. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’01). ACM Press, New York, 497–500.
- Sato, I., Sato, Y., and Ikeuchi, K. 2003. Illumination from shadows. IEEE Trans. Pattern Anal. Mach. Intell. 25, 3, 290–300.
- Shesh, A., Criminisi, A., Rother, C., and Smyth, G. 2009. 3Daware image editing for out of bounds photography. In Proceedings of the Graphics Interface Conference. 47–54.
- Stork, D. G. and Johnson, M. K. 2006. Estimating the location of illuminants in realist master paintings: Computer image analysis addresses a debate in art history of the baroque. In Proceedings of the International Conference on Pattern Recognition. 255–258.
- Zhang, W., Cao, X., Zhang, J., Zhu, J., and Wang, P. 2009. Detecting photographic composites using shadows. In Proceedings of the IEEE International Conference on Multimedia and Expo. 1042–1045.