“Shadow Harmonization for Realistic Compositing” by Valença, Zhang, Gharbi, Hold-Geoffroy and Lalonde – ACM SIGGRAPH HISTORY ARCHIVES

“Shadow Harmonization for Realistic Compositing” by Valença, Zhang, Gharbi, Hold-Geoffroy and Lalonde

  • 2023 SA_Technical_Papers_Valença_Shadow Harmonization for Realistic Compositing

Conference:


Type(s):


Title:

    Shadow Harmonization for Realistic Compositing

Session/Category Title:   Light, Shadows & Curves


Presenter(s)/Author(s):



Abstract:


    Compositing virtual objects into real background images requires one to carefully match the scene’s camera parameters, surface geometry, textures, and lighting to obtain plausible renderings. Recent learning approaches have shown many scene properties can be estimated from images, resulting in robust automatic single-image compositing systems, but many challenges remain. In particular, interactions between real and synthetic shadows are not handled gracefully by existing methods, which typically assume a shadow-free background. As a result, they tend to generate double shadows when the synthetic object’s cast shadow overlaps a background shadow, and ignore shadows from the background that should be cast onto the synthetic object. In this paper, we present a compositing method for outdoor scenes that addresses these issues and produces realistic cast shadows. This requires identifying existing shadows, including soft shadow boundaries, then reasoning about the ambiguity of unknown ground albedo and scene lighting to match the color and intensity of shaded areas. Using supervision from shadow removal and detection datasets, we propose a generative adversarial pipeline and improved composition equations that simultaneously handle both shadow interaction scenarios. We evaluate our method on challenging, real outdoor images from multiple distributions and datasets. Quantitative and qualitative comparisons show our approach produces more realistic results than existing alternatives.

References:


    [1]
    Samaneh Azadi, Deepak Pathak, Sayna Ebrahimi, and Trevor Darrell. 2020. Compositional GAN: Learning Image-Conditional Binary Composition. Int. J. Comput. Vis. 128, 10 (2020), 2570–2585. https://doi.org/10.1007/s11263-020-01336-9

    [2]
    Tiago J. Carvalho, Hany Farid, and Eric Kee. 2015. Exposing photo manipulation from user-guided 3D lighting analysis. In Media Watermarking, Security, and Forensics(SPIE Proceedings, Vol. 9409), Adnan M. Alattar, Nasir D. Memon, and Chad Heitzenrater (Eds.). SPIE, San Francisco, CA, USA, 940902. https://doi.org/10.1117/12.2075544

    [3]
    Bor-Chun Chen and Andrew Kae. 2019. Toward Realistic Image Compositing With Adversarial Learning. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, 2019, Long Beach, CA, USA, 8415–8424. https://doi.org/10.1109/CVPR.2019.00861

    [4]
    Zhihao Chen, Lei Zhu, Liang Wan, Song Wang, Wei Feng, and Pheng-Ann Heng. 2020. A Multi-Task Mean Teacher for Semi-Supervised Shadow Detection. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Seattle, WA, USA, 5610–5619. https://doi.org/10.1109/CVPR42600.2020.00565

    [5]
    Yung-Yu Chuang, Dan B. Goldman, Brian Curless, David Salesin, and Richard Szeliski. 2003. Shadow matting and compositing. ACM Trans. Graph. 22, 3 (2003), 494–500. https://doi.org/10.1145/882262.882298

    [6]
    Arnaud Couturier. 2023. SceneCity blender plugin. https://www.cgchan.com/store/scenecity.

    [7]
    Xiaodong Cun, Chi-Man Pun, and Cheng Shi. 2020. Towards Ghost-Free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GAN. In The Thirty-Fourth AAAI Conference on Artificial Intelligence. AAAI Press, New York, NY, USA, 10680–10687. https://doi.org/10.1609/aaai.v34i07.6695

    [8]
    Paul E. Debevec. 1998. Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-based Graphics with Global Illumination and High Dynamic Range Photography. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH, Steve Cunningham, Walt Bransford, and Michael F. Cohen (Eds.). ACM, Orlando, FL, USA, 189–198. https://doi.org/10.1145/280814.280864

    [9]
    Cycles Developers. 2023. Cycles Open Source Production Rendering. https://www.cycles-renderer.org.

    [10]
    Sylvain Duchêne, Clément Riant, Gaurav Chaurasia, Jorge Lopez-Moreno, Pierre-Yves Laffont, Stefan Popov, Adrien Bousseau, and George Drettakis. 2015. Multiview Intrinsic Images of Outdoors Scenes with an Application to Relighting. ACM Trans. Graph. 34, 5 (2015), 164:1–164:16. https://doi.org/10.1145/2756549

    [11]
    David Futschik, Kelvin Ritland, James Vecore, Sean Fanello, Sergio Orts-Escolano, Brian Curless, Daniel Sýkora, and Rohit Pandey. 2023. Controllable Light Diffusion for Portraits. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR. IEEE, Vancouver, BC, Canada, 8412–8421. https://doi.org/10.1109/CVPR52729.2023.00813

    [12]
    David Griffiths, Tobias Ritschel, and Julien Philip. 2022. OutCast: Outdoor Single-image Relighting with Cast Shadows. Comput. Graph. Forum 41, 2 (2022), 179–193. https://doi.org/10.1111/cgf.14467

    [13]
    Ruiqi Guo, Qieyun Dai, and Derek Hoiem. 2013. Paired Regions for Shadow Detection and Removal. IEEE Trans. Pattern Anal. Mach. Intell. 35, 12 (2013), 2956–2967. https://doi.org/10.1109/TPAMI.2012.214

    [14]
    Yannick Hold-Geoffroy, Akshaya Athawale, and Jean-François Lalonde. 2019. Deep Sky Modeling for Single Image Outdoor Lighting Estimation. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Long Beach, CA, USA, 6927–6935. https://doi.org/10.1109/CVPR.2019.00709

    [15]
    Yannick Hold-Geoffroy, Kalyan Sunkavalli, Jonathan Eisenmann, Matt Fisher, Emiliano Gambaretto, Sunil Hadap, and Jean-François Lalonde. 2018. A Perceptual Measure for Deep Single Image Camera Calibration. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE Computer Society, Salt Lake City, UT, USA, 2354–2363. https://doi.org/10.1109/CVPR.2018.00250

    [16]
    Yannick Hold-Geoffroy, Kalyan Sunkavalli, Sunil Hadap, Emiliano Gambaretto, and Jean-François Lalonde. 2017. Deep Outdoor Illumination Estimation. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. IEEE Computer Society, Honolulu, HI, USA, 2373–2382. https://doi.org/10.1109/CVPR.2017.255

    [17]
    Yan Hong, Li Niu, and Jianfu Zhang. 2022. Shadow Generation for Composite Image in Real-World Scenes. In Thirty-Sixth AAAI Conference on Artificial Intelligence. AAAI Press, Virtual Event, 914–922. https://doi.org/10.1609/aaai.v36i1.19974

    [18]
    Lukáš Hošek and Alexander Wilkie. 2012. An analytic model for full spectral sky-dome radiance. ACM Trans. Graph. 31, 4 (2012), 95:1–95:9. https://doi.org/10.1145/2185520.2185591

    [19]
    Lukáš Hošek and Alexander Wilkie. 2013. Adding a Solar-Radiance Function to the Hošek-Wilkie Skylight Model. IEEE Computer Graphics and Applications 33, 3 (2013), 44–52. https://doi.org/10.1109/MCG.2013.18

    [20]
    Xiaowei Hu, Tianyu Wang, Chi-Wing Fu, Yitong Jiang, Qiong Wang, and Pheng-Ann Heng. 2021. Revisiting Shadow Detection: A New Benchmark Dataset for Complex World. IEEE Trans. Image Process. 30 (2021), 1925–1934. https://doi.org/10.1109/TIP.2021.3049331

    [21]
    Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. 2017. Image-to-Image Translation with Conditional Adversarial Networks. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. IEEE Computer Society, Honolulu, HI, USA, 5967–5976. https://doi.org/10.1109/CVPR.2017.632

    [22]
    Jean-François Lalonde, Alexei A. Efros, and Srinivasa G. Narasimhan. 2009. Estimating natural illumination from a single outdoor image. In IEEE 12th International Conference on Computer Vision, ICCV. IEEE Computer Society, Kyoto, Japan, 183–190. https://doi.org/10.1109/ICCV.2009.5459163

    [23]
    Jean-François Lalonde, Alexei A. Efros, and Srinivasa G. Narasimhan. 2010. Detecting Ground Shadows in Outdoor Consumer Photographs. In 11th European Conference on Computer Vision, ECCV Proceedings, Part II(Lecture Notes in Computer Science, Vol. 6312), Kostas Daniilidis, Petros Maragos, and Nikos Paragios (Eds.). Springer, Heraklion, Crete, Greece, 322–335. https://doi.org/10.1007/978-3-642-15552-9_24

    [24]
    Jean-François Lalonde and Iain A. Matthews. 2014. Lighting Estimation in Outdoor Image Collections. In 2nd International Conference on 3D Vision, 3DV, Volume 1. IEEE Computer Society, Tokyo, Japan, 131–138. https://doi.org/10.1109/3DV.2014.112

    [25]
    Hieu Le and Dimitris Samaras. 2022. Physics-Based Shadow Image Decomposition for Shadow Removal. IEEE Trans. Pattern Anal. Mach. Intell. 44, 12 (2022), 9088–9101. https://doi.org/10.1109/TPAMI.2021.3124934

    [26]
    Hieu M. Le and Dimitris Samaras. 2019. Shadow Removal via Shadow Image Decomposition. In IEEE/CVF International Conference on Computer Vision, ICCV. IEEE, Seoul, Korea (South), 8577–8586. https://doi.org/10.1109/ICCV.2019.00867

    [27]
    Hieu M. Le, Tomas F. Yago Vicente, Vu Nguyen, Minh Hoai, and Dimitris Samaras. 2018. A+D Net: Training a Shadow Detector with Adversarial Shadow Attenuation. In 15th European Conference on Computer Vision, ECCV Proceedings, Part II(Lecture Notes in Computer Science, Vol. 11206), Vittorio Ferrari, Martial Hebert, Cristian Sminchisescu, and Yair Weiss (Eds.). Springer, Munich, Germany, 680–696. https://doi.org/10.1007/978-3-030-01216-8_41

    [28]
    Chloe LeGendre, Wan-Chun Ma, Graham Fyffe, John Flynn, Laurent Charbonnel, Jay Busch, and Paul E. Debevec. 2019. DeepLight: Learning Illumination for Unconstrained Mobile Mixed Reality. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Long Beach, CA, USA, 5918–5928. https://doi.org/10.1109/CVPR.2019.00607

    [29]
    Chen-Hsuan Lin, Ersin Yumer, Oliver Wang, Eli Shechtman, and Simon Lucey. 2018. ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositing. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE Computer Society, Salt Lake City, UT, USA, 9455–9464. https://doi.org/10.1109/CVPR.2018.00985

    [30]
    Daquan Liu, Chengjiang Long, Hongpan Zhang, Hanning Yu, Xinzhi Dong, and Chunxia Xiao. 2020. ARShadowGAN: Shadow Generative Adversarial Network for Augmented Reality in Single Light Scenes. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Seattle, WA, USA, 8136–8145. https://doi.org/10.1109/CVPR42600.2020.00816

    [31]
    Zhihao Liu, Hui Yin, Xinyi Wu, Zhenyao Wu, Yang Mi, and Song Wang. 2021. From Shadow Generation To Shadow Removal. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Virtual, 4927–4936. https://doi.org/10.1109/CVPR46437.2021.00489

    [32]
    Eihachiro Nakamae, Koichi Harada, Takao Ishizaki, and Tomoyuki Nishita. 1986. A montage method: the overlaying of the computer generated images onto a background photograph. In Proceedings of the 13th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH, David C. Evans and Russell J. Athay (Eds.). ACM, Dallas, Texas, USA, 207–214. https://doi.org/10.1145/15922.15909

    [33]
    Oliver Nalbach, Elena Arabadzhiyska, Dushyant Mehta, Hans-Peter Seidel, and Tobias Ritschel. 2017. Deep Shading: Convolutional Neural Networks for Screen Space Shading. Comput. Graph. Forum 36, 4 (2017), 65–78. https://doi.org/10.1111/cgf.13225

    [34]
    Thomas Nestmeyer, Jean-François Lalonde, Iain A. Matthews, and Andreas M. Lehrmann. 2020. Learning Physics-Guided Face Relighting Under Directional Light. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Seattle, WA, USA, 5123–5132. https://doi.org/10.1109/CVPR42600.2020.00517

    [35]
    Baptiste Nicolet, Julien Philip, and George Drettakis. 2020. Repurposing a Relighting Network for Realistic Compositions of Captured Scenes. In Symposium on Interactive 3D Graphics and Games, I3D, Dan Casas, Eric Haines, Sheldon Andrews, Natalya Tatarchuk, and Zdravko Velinov (Eds.). ACM, San Francisco, CA, USA, 4:1–4:9. https://doi.org/10.1145/3384382.3384523

    [36]
    Alexandros Panagopoulos, Chaohui Wang, Dimitris Samaras, and Nikos Paragios. 2011. Illumination estimation and cast shadow detection through a higher-order graphical model. In The 24th IEEE Conference on Computer Vision and Pattern Recognition, CVPR. IEEE Computer Society, Colorado Springs, CO, USA, 673–680. https://doi.org/10.1109/CVPR.2011.5995585

    [37]
    Rohit Pandey, Sergio Orts-Escolano, Chloe LeGendre, Christian Häne, Sofien Bouaziz, Christoph Rhemann, Paul E. Debevec, and Sean Ryan Fanello. 2021. Total relighting: learning to relight portraits for background replacement. ACM Trans. Graph. 40, 4 (2021), 43:1–43:21. https://doi.org/10.1145/3450626.3459872

    [38]
    Julien Philip, Michaël Gharbi, Tinghui Zhou, Alexei A. Efros, and George Drettakis. 2019. Multi-view relighting using a geometry-aware network. ACM Trans. Graph. 38, 4 (2019), 78:1–78:14. https://doi.org/10.1145/3306346.3323013

    [39]
    Julien Philip, Sébastien Morgenthaler, Michaël Gharbi, and George Drettakis. 2021. Free-viewpoint Indoor Neural Relighting from Multi-view Stereo. ACM Trans. Graph. 40, 5 (2021), 194:1–194:18. https://doi.org/10.1145/3469842

    [40]
    Liangqiong Qu, Jiandong Tian, Shengfeng He, Yandong Tang, and Rynson W. H. Lau. 2017. DeshadowNet: A Multi-context Embedding Deep Network for Shadow Removal. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. IEEE Computer Society, Honolulu, HI, USA, 2308–2316. https://doi.org/10.1109/CVPR.2017.248

    [41]
    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-Net: Convolutional Networks for Biomedical Image Segmentation. In 18th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI Proceedings, Part III(Lecture Notes in Computer Science, Vol. 9351), Nassir Navab, Joachim Hornegger, William M. Wells III, and Alejandro F. Frangi (Eds.). Springer, Munich, Germany, 234–241. https://doi.org/10.1007/978-3-319-24574-4_28

    [42]
    Andres Sanin, Conrad Sanderson, and Brian C. Lovell. 2012. Shadow detection: A survey and comparative evaluation of recent methods. Pattern Recognit. 45, 4 (2012), 1684–1695. https://doi.org/10.1016/j.patcog.2011.10.001

    [43]
    Yichen Sheng, Yifan Liu, Jianming Zhang, Wei Yin, A. Cengiz Öztireli, He Zhang, Zhe Lin, Eli Shechtman, and Bedrich Benes. 2022. Controllable Shadow Generation Using Pixel Height Maps. In 17th European Conference on Computer Vision, ECCV Proceedings, Part XXIII(Lecture Notes in Computer Science, Vol. 13683), Shai Avidan, Gabriel J. Brostow, Moustapha Cissé, Giovanni Maria Farinella, and Tal Hassner (Eds.). Springer, Tel Aviv, Israel, 240–256. https://doi.org/10.1007/978-3-031-20050-2_15

    [44]
    Yichen Sheng, Jianming Zhang, and Bedrich Benes. 2021. SSN: Soft Shadow Network for Image Compositing. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Virtual, 4380–4390. https://doi.org/10.1109/CVPR46437.2021.00436

    [45]
    Yichen Sheng, Jianming Zhang, Julien Philip, Yannick Hold-Geoffroy, Xin Sun, He Zhang, Lu Ling, and Bedrich Benes. 2023. PixHt-Lab: Pixel Height Based Light Effect Generation for Image Compositing. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR. IEEE, Vancouver, BC, Canada, 16643–16653. https://doi.org/10.1109/CVPR52729.2023.01597

    [46]
    Tiancheng Sun, Jonathan T. Barron, Yun-Ta Tsai, Zexiang Xu, Xueming Yu, Graham Fyffe, Christoph Rhemann, Jay Busch, Paul E. Debevec, and Ravi Ramamoorthi. 2019. Single image portrait relighting. ACM Trans. Graph. 38, 4 (2019), 79:1–79:12. https://doi.org/10.1145/3306346.3323008

    [47]
    Yi-Hsuan Tsai, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Xin Lu, and Ming-Hsuan Yang. 2017. Deep Image Harmonization. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. IEEE Computer Society, Honolulu, HI, USA, 2799–2807. https://doi.org/10.1109/CVPR.2017.299

    [48]
    Rob Tuytel, Rico Cilliers, Dario Barresi, and Dimitrios Savva. 2023. Poly Haven textures library. https://polyhaven.com/textures.

    [49]
    Tomás F. Yago Vicente, Le Hou, Chen-Ping Yu, Minh Hoai, and Dimitris Samaras. 2016. Large-Scale Training of Shadow Detectors with Noisily-Annotated Shadow Examples. In 14th European Conference on Computer Vision, ECCV Proceedings, Part VI(Lecture Notes in Computer Science, Vol. 9910), Bastian Leibe, Jiri Matas, Nicu Sebe, and Max Welling (Eds.). Springer, Amsterdam, The Netherlands, 816–832. https://doi.org/10.1007/978-3-319-46466-4_49

    [50]
    Jifeng Wang, Xiang Li, and Jian Yang. 2018. Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removal. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE Computer Society, Salt Lake City, UT, USA, 1788–1797. https://doi.org/10.1109/CVPR.2018.00192

    [51]
    Tianyu Wang, Xiaowei Hu, Chi-Wing Fu, and Pheng-Ann Heng. 2021. Single-Stage Instance Shadow Detection With Bidirectional Relation Learning. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Virtual, 1–11. https://doi.org/10.1109/CVPR46437.2021.00007

    [52]
    Tianyu Wang, Xiaowei Hu, Qiong Wang, Pheng-Ann Heng, and Chi-Wing Fu. 2020a. Instance Shadow Detection. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Seattle, WA, USA, 1877–1886. https://doi.org/10.1109/CVPR42600.2020.00195

    [53]
    Yang Wang, Lei Zhang, Zicheng Liu, Gang Hua, Zhen Wen, Zhengyou Zhang, and Dimitris Samaras. 2009. Face Relighting from a Single Image under Arbitrary Unknown Lighting Conditions. IEEE Trans. Pattern Anal. Mach. Intell. 31, 11 (2009), 1968–1984. https://doi.org/10.1109/TPAMI.2008.244

    [54]
    Zian Wang, Wenzheng Chen, David Acuna, Jan Kautz, and Sanja Fidler. 2022. Neural Light Field Estimation for Street Scenes with Differentiable Virtual Object Insertion. In 17th European Conference on Computer Vision, ECCV Proceedings, Part II(Lecture Notes in Computer Science, Vol. 13662), Shai Avidan, Gabriel J. Brostow, Moustapha Cissé, Giovanni Maria Farinella, and Tal Hassner (Eds.). Springer, Tel Aviv, Israel, 380–397. https://doi.org/10.1007/978-3-031-20086-1_22

    [55]
    Zhibo Wang, Xin Yu, Ming Lu, Quan Wang, Chen Qian, and Feng Xu. 2020b. Single image portrait relighting via explicit multiple reflectance channel modeling. ACM Trans. Graph. 39, 6 (2020), 220:1–220:13. https://doi.org/10.1145/3414685.3417824

    [56]
    Piaopiao Yu, Jie Guo, Fan Huang, Cheng Zhou, Hongwei Che, Xiao Ling, and Yanwen Guo. 2021. Hierarchical Disentangled Representation Learning for Outdoor Illumination Estimation and Editing. In IEEE/CVF International Conference on Computer Vision, ICCV. IEEE, Montreal, QC, Canada, 15293–15302. https://doi.org/10.1109/ICCV48922.2021.01503

    [57]
    Fangneng Zhan, Shijian Lu, Changgong Zhang, Feiying Ma, and Xuansong Xie. 2020. Adversarial Image Composition with Auxiliary Illumination. In 15th Asian Conference on Computer Vision, ACCV Revised Selected Papers, Part II(Lecture Notes in Computer Science, Vol. 12623), Hiroshi Ishikawa, Cheng-Lin Liu, Tomás Pajdla, and Jianbo Shi (Eds.). Springer, Kyoto, Japan, 234–250. https://doi.org/10.1007/978-3-030-69532-3_15

    [58]
    Hongyi Zhang, Yann N. Dauphin, and Tengyu Ma. 2019a. Fixup Initialization: Residual Learning Without Normalization. arXiv. arXiv:1901.09321http://arxiv.org/abs/1901.09321

    [59]
    Jinsong Zhang, Kalyan Sunkavalli, Yannick Hold-Geoffroy, Sunil Hadap, Jonathan Eisenmann, and Jean-François Lalonde. 2019b. All-Weather Deep Outdoor Lighting Estimation. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Long Beach, CA, USA, 10158–10166. https://doi.org/10.1109/CVPR.2019.01040

    [60]
    Xuaner Cecilia Zhang, Jonathan T. Barron, Yun-Ta Tsai, Rohit Pandey, Xiuming Zhang, Ren Ng, and David E. Jacobs. 2020. Portrait shadow manipulation. ACM Trans. Graph. 39, 4 (2020), 78. https://doi.org/10.1145/3386569.3392390

    [61]
    Hao Zhou, Sunil Hadap, Kalyan Sunkavalli, and David Jacobs. 2019. Deep Single-Image Portrait Relighting. In IEEE/CVF International Conference on Computer Vision, ICCV. IEEE, Seoul, Korea (South), 7193–7201. https://doi.org/10.1109/ICCV.2019.00729

    [62]
    Jun-Yan Zhu, Philipp Krähenbühl, Eli Shechtman, and Alexei A. Efros. 2015. Learning a Discriminative Model for the Perception of Realism in Composite Images. In IEEE International Conference on Computer Vision, ICCV. IEEE Computer Society, Santiago, Chile, 3943–3951. https://doi.org/10.1109/ICCV.2015.449

    [63]
    Jiejie Zhu, Kegan G. G. Samuel, Syed Zain Masood, and Marshall F. Tappen. 2010. Learning to recognize shadows in monochromatic natural images. In The Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition, CVPR. IEEE Computer Society, San Francisco, CA, USA, 223–230. https://doi.org/10.1109/CVPR.2010.5540209

    [64]
    Lei Zhu, Zijun Deng, Xiaowei Hu, Chi-Wing Fu, Xuemiao Xu, Jing Qin, and Pheng-Ann Heng. 2018. Bidirectional Feature Pyramid Network with Recurrent Attention Residual Modules for Shadow Detection. In 15th European Conference on Computer Vision, ECCV Proceedings, Part VI(Lecture Notes in Computer Science, Vol. 11210), Vittorio Ferrari, Martial Hebert, Cristian Sminchisescu, and Yair Weiss (Eds.). Springer, Munich, Germany, 122–137. https://doi.org/10.1007/978-3-030-01231-1_8

    [65]
    Lei Zhu, Ke Xu, Zhanghan Ke, and Rynson W. H. Lau. 2021a. Mitigating Intensity Bias in Shadow Detection via Feature Decomposition and Reweighting. In IEEE/CVF International Conference on Computer Vision, ICCV. IEEE, Montreal, QC, Canada, 4682–4691. https://doi.org/10.1109/ICCV48922.2021.00466

    [66]
    Yurui Zhu, Xueyang Fu, Chengzhi Cao, Xi Wang, Qibin Sun, and Zheng-Jun Zha. 2022. Single Image Shadow Detection via Complementary Mechanism. In The 30th ACM International Conference on Multimedia, MM, João Magalhães, Alberto Del Bimbo, Shin’ichi Satoh, Nicu Sebe, Xavier Alameda-Pineda, Qin Jin, Vincent Oria, and Laura Toni (Eds.). ACM, Lisbon, Portugal, 6717–6726. https://doi.org/10.1145/3503161.3547904

    [67]
    Yongjie Zhu, Yinda Zhang, Si Li, and Boxin Shi. 2021b. Spatially-Varying Outdoor Lighting Estimation From Intrinsics. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. Computer Vision Foundation / IEEE, Virtual, 12834–12842. https://doi.org/10.1109/CVPR46437.2021.01264


ACM Digital Library Publication:



Overview Page:



Submit a story:

If you would like to submit a story about this presentation, please contact us: historyarchives@siggraph.org