“Birefractive stereo imaging for single-shot depth acquisition” by Baek, Gutierrez and Kim
Conference:
Type(s):
Title:
- Birefractive stereo imaging for single-shot depth acquisition
Session/Category Title: Computational Photography
Presenter(s)/Author(s):
Abstract:
We propose a novel birefractive depth acquisition method, which allows for single-shot depth imaging by just placing a birefringent material in front of the lens. While most transmissive materials present a single refractive index per wavelength, birefringent crystals like calcite posses two, resulting in a double refraction effect. We develop an imaging model that leverages this phenomenon and the information contained in the ordinary and the extraordinary refracted rays, providing an effective formulation of the geometric relationship between scene depth and double refraction. To handle the inherent ambiguity of having two sources of information overlapped in a single image, we define and combine two different cost volume functions. We additionally present a novel calibration technique for birefringence, carefully analyze and validate our model, and demonstrate the usefulness of our approach with several image-editing applications.
References:
1. Avendaño-Alejo, M., Stavroudis, O. N., and y Goitia, A. R. B. 2002. Huygenss principle and rays in uniaxial anisotropic media. i. crystal axis normal to refracting surface. JOSA A 19, 8, 1668–1673. Cross Ref
2. Baek, S.-H., and Kim, M. H. 2015. Stereo fusion using a refractive medium on a binocular base. In Proc. Asian Conference on Computer Vision (ACCV 2014), Springer, Singapore, Singapore, vol. 9004 of LNCS, 503–518.
3. Baek, S.-H., and Kim, M. H. 2016. Stereo fusion: Combining refractive and binocular disparity. Computer Vision and Image Understanding 146, 52–66.
4. Bando, Y., Chen, B.-Y., and Nishita, T. 2008. Extracting depth and matte using a color-filtered aperture. In ACM Transactions on Graphics (TOG), vol. 27, ACM, 134.
5. Barron, J. T., and Malik, J. 2013. Intrinsic scene properties from a single rgb-d image. In Proc. Comput. Vision and Pattern Recognition (CVPR), 17–24.
6. Burns, P. D. 2000. Slanted-edge MTF for digital camera and scanner analysis. In Proc. the Conference on Image Processing, Image Quality, Image Capture Systems (PICS-00), 135–138.
7. Chakrabarti, A., and Zickler, T. 2012. Depth and deblurring from a spectrally-varying depth-of-field. In European Conference on Computer Vision (ECCV), 2012, Springer, 648–661.
8. Chen, Z., Wong, K.-Y. K., Matsushita, Y., and Zhu, X. 2013. Depth from refraction using a transparent medium with unknown pose and refractive index. Int. J. Comput. Vision (ICJV), 1–15.
9. Gao, C., and Ahuja, N. 2006. A refractive camera for acquiring stereo and super-resolution images. In Proc. Comput. Vision and Pattern Recognition (CVPR), 2316–2323.
10. Guy, S., and Soler, C. 2004. Graphics gems revisited: Fast and physically-based rendering of gemstones. ACM Trans. Graph. 23, 3 (Aug.), 231–238.
11. Hecht, E. 2002. Optics, 4th. International edition, Addison-Wesley, San Francisco 3.
12. Hirschmuller, H. 2005. Accurate and efficient stereo processing by semi-global matching and mutual information. In Proc. Comput. Vision and Pattern Recognition (CVPR), 807–814.
13. Latorre, P., Seron, F. J., and Gutierrez, D. 2012. Birefringence: calculation of refracted ray paths in biaxial crystals. The Visual Computer 28, 4, 341–356.
14. Lee, D., and Kweon, I. 2000. A novel stereo camera system by a biprism. IEEE Trans. Robotics and Automation 16, 5, 528–541. Cross Ref
15. Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Trans. Graph. (TOG) 23, 3, 689–694.
16. Levin, A., Fergus, R., Durand, F., and Freeman, W. T. 2007. Image and depth from a conventional camera with a coded aperture. In ACM Transactions on Graphics (TOG), vol. 26, ACM, 70.
17. Li, X., and Wang, R. 2009. Analysis and optimization of the stereo system with a biprism adapter. In International Conference on Optical Instrumentation and Technology, International Society for Optics and Photonics, 75061V1–75061V8.
18. Liang, Q.-T. 1990. Simple ray tracing formulas for uniaxial optical crystals. Applied Optics 29, 7, 1008–1010. Cross Ref
19. Rother, C., Kolmogorov, V., and Blake, A. 2004. “grab-cut”: Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23, 3 (Aug.), 309–314.
20. Shestak, S., Kim, D.-S., and Cha, K.-H. 2015. Stereoscopic three-dimensional television using active glasses with switchable refraction. Journal of Electronic Imaging 24, 3, 033006–033006. Cross Ref
21. Shi, J., Tao, X., Xu, L., and Jia, J. 2015. Break ames room illusion: Depth from general single images. ACM Trans. Graph. 34, 6 (Oct.), 225:1–225:11.
22. Shimizu, M., and Okutomi, M. 2006. Reflection stereo-novel monocular stereo using a transparent plate. In Proc. Canadian Conf. Computer and Robot Vision (CRV), IEEE, 14–14.
23. Tannenbaum, D., Tannenbaum, P., and Wozny, M. 1994. Polarization and birefringency considerations in rendering. In Computer Graphics. Proceedings, Annual Conference Series, SIGGRAPH, ACM, 221–222.
24. Tsai, T.-H., and Brady, D. J. 2013. Coded aperture snapshot spectral polarization imaging. Applied optics 52, 10, 2153–2161.
25. Waltz, R. A., Morales, J. L., Nocedal, J., and Orban, D. 2006. An interior algorithm for nonlinear optimization that combines line search and trust region steps. Mathematical programming 107, 3, 391–408.
26. Weidlich, A., and Wilkie, A. 2008. Realistic rendering of birefringency in uniaxial crystals. ACM Transactions on Graphics (TOG) 27, 1, 6.
27. Yang, Q. 2012. A non-local cost aggregation method for stereo matching. In Proc. Comput. Vision and Pattern Recognition (CVPR), 1402–1409.
28. Yano, T., Shimizu, M., and Okutomi, M. 2010. Image restoration and disparity estimation from an uncalibrated multi-layered image. In Proc. Comput. Vision and Pattern Recognition (CVPR), IEEE, 247–254.
29. Zalevsky, Z., and Ben-Yaish, S. 2007. Extended depth of focus imaging with birefringent plate. Optics express 15, 12, 7202–7210.
30. Zhang, L., and Nayar, S. K. 2006. Projection Defocus Analysis for Scene Capture and Image Display. ACM Trans. on Graphics (Jul).
31. Zhang, Z. 2000. A flexible new technique for camera calibration. Pattern Analysis and Machine Intelligence, IEEE Transactions on 22, 11, 1330–1334.
