“Nonuniform Spatial Deformation of Light Fields by Locally Linear Transformations” by Birklbauer, Schedl and Bimber
Conference:
Type:
Title:
- Nonuniform Spatial Deformation of Light Fields by Locally Linear Transformations
Session/Category Title: Image and Light Field Manipulation
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Light-field cameras offer new imaging possibilities compared to conventional digital cameras. However, the additional angular domain of light fields prohibits direct application of frequently used image processing algorithms, such as warping, retargeting, or stitching. We present a general and efficient framework for nonuniform light-field warping, which forms the basis for extending many of these image processing techniques to light fields. It propagates arbitrary spatial deformations defined in one light-field perspective consistently to all other perspectives by means of 4D patch matching instead of relying on explicit depth reconstruction. This allows processing light-field recordings of complex scenes with non-Lambertian properties such as transparency and refraction. We show application examples of our framework in panorama light-field imaging, light-field retargeting, and artistic manipulation of light fields.
References:
1. Aseem Agarwala, Mira Dontcheva, Maneesh Agrawala, Steven Drucker, Alex Colburn, Brian Curless, David Salesin, and Michael Cohen. 2004. Interactive digital photomontage. ACM Transactions on Graphics 23, 3, 294–302. DOI:http://dx.doi.org/10.1145/1015706.1015718 Google ScholarDigital Library
2. Clemens Birklbauer and Oliver Bimber. 2012. Light-field retargeting. Computer Graphics Forum 31, 2, 295–303. DOI:http://dx.doi.org/10.1111/j.1467-8659.2012.03008.x Google ScholarDigital Library
3. Clemens Birklbauer and Oliver Bimber. 2014. Panorama light-field imaging. Computer Graphics Forum 33, 2, 43–52. DOI:http://dx.doi.org/10.1111/cgf.12289 Google ScholarDigital Library
4. Clemens Birklbauer, Simon Opelt, and Oliver Bimber. 2013. Rendering gigaray light fields. Computer Graphics Forum 32, 2, 469–478. DOI:http://dx.doi.org/10.1111/cgf.12067Google ScholarCross Ref
5. Matthew Brown and David G. Lowe. 2007. Automatic panoramic image stitching using invariant features. International Journal of Computer Vision 74, 1, 59–73. DOI:http://dx.doi.org/10.1007/s11263-006-0002-3 Google ScholarDigital Library
6. Billy Chen, Eyal Ofek, Heung-Yeung Shum, and Marc Levoy. 2005. Interactive deformation of light fields. In Proceedings on the Symposium on Interactive 3D Graphics and Games. 139–146. DOI:http://dx.doi.org/10.1145/1053427.1053450 Google ScholarDigital Library
7. Steven J. Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F. Cohen. 1996. The lumigraph. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’96). 43–54. DOI:http://dx.doi.org/10.1145/237170.237200 Google ScholarDigital Library
8. X. Guo, Z. Yu, S. Kang, H. Lin, and J. Yu. 2015. Enhancing light fields through ray-space stitching. IEEE Transactions on Visualization and Computer Graphics PP, 99, 1. DOI:http://dx.doi.org/10.1109/TVCG.2015.2476805Google Scholar
9. Aaron Isaksen, Leonard McMillan, and Steven J. Gortler. 2000. Dynamically reparameterized light fields. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’00). 297–306. DOI:http://dx.doi.org/10.1145/344779.344929 Google ScholarDigital Library
10. Adrian Jarabo, Belen Masia, Adrien Bousseau, Fabio Pellacini, and Diego Gutierrez. 2014. How do people edit light fields? ACM Transactions on Graphics 33, 4, 146:1–146:10. DOI:http://dx.doi.org/10.1145/2601097.2601125 Google ScholarDigital Library
11. Adrian Jarabo, Belen Masia, and Diego Gutierrez. 2011. Efficient propagation of light field edits. In Proceedings of the Ibero-American Symposium on Computer Graphics (SIACG’11). 75–80.Google Scholar
12. Hae-Gon Jeon, Jaesik Park, Gyeongmin Choe, Jinsun Park, Yunsu Bok, Yu-Wing Tai, and In So Kweon. 2015. Accurate depth map estimation from a lenslet light field camera. In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’15). 1547–1555. DOI:http://dx.doi.org/10.1109/CVPR.2015.7298762Google ScholarCross Ref
13. Eunhee Jeong, Mincheol Yoon, Seungyong Lee, Minsu Ahn, Seungyong Lee, and Baining Guo. 2003. Feature-based surface light field morphing. In Proceedings of the 11th Pacific Conference on Computer Graphics and Applications. 215–223. DOI:http://dx.doi.org/10.1109/PCCGA.2003.1238263 Google ScholarDigital Library
14. O. Johannsen, A. Sulc, and B. Goldluecke. 2015. On linear structure from motion for light field cameras. In Proceedings of the IEEE International Conference on Computer Vision (ICCV’15). 720–728. DOI:http://dx.doi.org/10.1109/ICCV.2015.89 Google ScholarDigital Library
15. Akira Kubota, Kazuya Kodama, and Yoshinori Hatori. 2007. Image-based refocusing by 3D filtering. In Proceedings of the Pacific Rim Symposium on Image and Video Technology. 385–398. DOI:http://dx.doi.org/10.1007/978-3-540-77129-6_35 Google ScholarDigital Library
16. Steven M. Seitz and Kiriakos N. Kutulakos. 2002. Plenoptic image editing. International Journal of Computer Vision 48, 2, 115–129. DOI:http://dx.doi.org/10.1023/A:1016046923611. Google ScholarDigital Library
17. Ariel Shamir and Olga Sorkine. 2009. Visual media retargeting. In Proceedings of the ACM SIGGRAPH ASIA 2009 Courses. Article No. 11. DOI:http://dx.doi.org/10.1145/1665817.1665828 Google ScholarDigital Library
18. Richard Szeliski. 2006. Image alignment and stitching: A tutorial. Foundations and Trends in Computer Graphics and Vision 2, 1, 1–104. Google ScholarDigital Library
19. Lifeng Wang, Stephen Lin, Seungyong Lee, Baining Guo, and Heung-Yeung Shum. 2005. Light field morphing using 2D features. IEEE Transactions on Visualization and Computer Graphics 11, 1, 25–34. DOI:http://dx.doi.org/10.1109/TVCG.2005.11 Google ScholarDigital Library
20. Zhou Wang, Alan C. Bovik, Hamid R. Sheikh, and Eero P. Simoncelli. 2004. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4, 600–612. DOI:http://dx.doi.org/10.1109/TIP.2003.819861 Google ScholarDigital Library
21. Tim Weyrich, Hanspeter Pfister, and Markus H. Gross. 2005. Rendering deformable surface reflectance fields. IEEE Transactions on Visualization and Computer Graphics 11, 1, 48–58. DOI:http://dx.doi.org/10.1109/TVCG.2005.14 Google ScholarDigital Library
22. Daniel N. Wood, Daniel I. Azuma, Ken Aldinger, Brian Curless, Tom Duchamp, David H. Salesin, and Werner Stuetzle. 2000. Surface light fields for 3D photography. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’00). 287–296. DOI:http://dx.doi.org/10.1145/344779.344925 Google ScholarDigital Library
23. Zhou Xue, Loic Baboulaz, Paolo Prandoni, and Martin Vetterli. 2014. Light field panorama by a plenoptic camera. In Proceedings of SPIE 9020: Computational Imaging XII. 90200S–90200S–11. DOI:http://dx.doi.org/10.1117/12.2038254Google Scholar
24. L. Yatziv, G. Sapiro, and M. Levoy. 2004. Lightfield completion. In Proceedings of the 2004 International Conference on Image Processing (ICIP’04), Vol. 3. 1787–1790. DOI:http://dx.doi.org/10.1109/ICIP.2004.1421421Google Scholar
25. J. Zaragoza, T. J. Chin, Q. Tran, M. S. Brown, and D. Suter. 2014. As-projective-as-possible image stitching with moving DLT. IEEE Transactions on Pattern Analysis and Machine Intelligence 36, 7, 1285–1298. DOI:http://dx.doi.org/10.1109/TPAMI.2013.247 Google ScholarDigital Library
26. Julio Zaragoza, Tat-Jun Chin, Michael S. Brown, and David Suter. 2013. As-projective-as-possible image stitching with moving DLT. In Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’13). 2339–2346. DOI:http://dx.doi.org/10.1109/CVPR.2013.303 Google ScholarDigital Library
27. Guo-Xin Zhang, Ming-Ming Cheng, Shi-Min Hu, and Ralph R. Martin. 2009. A shape-preserving approach to image resizing. Computer Graphics Forum 28, 7, 1897–1906. DOI:http://dx.doi.org/10.1111/j.1467-8659.2009.01568.xGoogle ScholarCross Ref
