“Axial-cones: modeling spherical catadioptric cameras for wide-angle light field rendering”
Conference:
Type(s):
Title:
- Axial-cones: modeling spherical catadioptric cameras for wide-angle light field rendering
Session/Category Title: Computational imagery
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Catadioptric imaging systems are commonly used for wide-angle imaging, but lead to multi-perspective images which do not allow algorithms designed for perspective cameras to be used. Efficient use of such systems requires accurate geometric ray modeling as well as fast algorithms. We present accurate geometric modeling of the multi-perspective photo captured with a spherical catadioptric imaging system using axial-cone cameras: multiple perspective cameras lying on an axis each with a different viewpoint and a different cone of rays. This modeling avoids geometric approximations and allows several algorithms developed for perspective cameras to be applied to multi-perspective catadioptric cameras.We demonstrate axial-cone modeling in the context of rendering wide-angle light fields, captured using a spherical mirror array. We present several applications such as spherical distortion correction, digital refocusing for artistic depth of field effects in wide-angle scenes, and wide-angle dense depth estimation. Our GPU implementation using axial-cone modeling achieves up to three orders of magnitude speed up over ray tracing for these applications.
References:
1. Agrawal, A., Taguchi, Y., and Ramalingam, S. 2010. Analytical forward projection for axial non-central dioptric and catadioptric cameras. In ECCV. Google ScholarDigital Library
2. Baker, S., and Nayar, S. K. 1999. A theory of single-viewpoint catadioptric image formation. IJCV 35, 2, 175–196. Google ScholarDigital Library
3. Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. PAMI 23, 11, 1222–1239. Google ScholarDigital Library
4. Camahort, E., Lerios, A., and Fussell, D. 1998. Uniformly sampled light fields. In Proc. 9th Eurographics Workshop on Rendering, 117–130.Google Scholar
5. Collins, R. 1996. A space-sweep approach to true multi-image matching. In CVPR, 358–363. Google ScholarDigital Library
6. Ding, Y., Yu, J., and Sturm, P. 2009. Multi-perspective stereo matching and volumetric reconstruction. In ICCV.Google Scholar
7. Georgiev, T., Zheng, C., Nayar, S., Curless, B., Salasin, D., and Intwala, C. 2006. Spatio-angular resolution tradeoffs in integral photography. In EGSR, 263–272. Google ScholarDigital Library
8. Gortler, S., Grzeszczuk, R., Szeliski, R., and Cohen, M. 1996. The lumigraph. In SIGGRAPH, 43–54. Google ScholarDigital Library
9. Grossberg, M., and Nayar, S. 2001. A general imaging model and a method for finding its parameters. In ICCV, vol. 2, 108–115.Google Scholar
10. Heidrich, W. 1999. High-Quality Shading and Lighting for Hardware-Accelerated Rendering. PhD thesis, University of Erlangen.Google Scholar
11. Isaksen, A., McMillan, L., and Gortler, S. 2000. Dynamically reparameterized light fields. In SIGGRAPH, 297–306. Google ScholarDigital Library
12. Kanbara, M., Ukita, N., Kidode, M., and Yokoya, N. 2006. 3D scene reconstruction from reflection images in a spherical mirror. In ICPR, vol. 4, 874–879. Google ScholarDigital Library
13. Kojima, Y., Sagawa, R., Echigo, T., and Yagi, Y. 2005. Calibration and performance evaluation of omnidirectional sensor with compound spherical mirrors. In OMNIVIS.Google Scholar
14. Kuthirummal, S., and Nayar, S. 2006. Multiview radial catadioptric imaging for scene capture. ACM Trans. Graph. 25, 3, 916–923. Google ScholarDigital Library
15. Lanman, D., Crispell, D., Wachs, M., and Taubin, G. 2006. Spherical catadioptric arrays: Construction, multi-view geometry, and calibration. In 3DPVT, 81–88. Google ScholarDigital Library
16. Lensch, H. P. A., Kautz, J., Goesele, M., Heidrich, W., and Seidel, H.-P. 2003. Image-based reconstruction of spatial appearance and geometric detail. ACM Trans. Graph. 22, 2, 234–257. Google ScholarDigital Library
17. Levoy, M., and Hanrahan, P. 1996. Light field rendering. In SIGGRAPH, 31–42. Google ScholarDigital Library
18. Levoy, M., Chen, B., Vaish, V., Horowitz, M., McDowall, I., and Bolas, M. 2004. Synthetic aperture confocal imaging. ACM Trans. Graph. 23, 3, 825–834. Google ScholarDigital Library
19. Micusik, B., and Pajdla, T. 2004. Autocalibration and 3D reconstruction with non-central catadioptric cameras. In CVPR.Google Scholar
20. Nalwa, V. 1996. A true omnidirectional viewer. Tech. rep., Bell Laboratories.Google Scholar
21. Nene, S. A., and Nayar, S. K. 1998. Stereo with mirrors. In ICCV, 1087–1094. Google ScholarDigital Library
22. Ng, R., Levoy, M., Brdif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a hand-held plenoptic camera. Tech. rep., Stanford Univ.Google Scholar
23. Ramalingam, S., Sturm, P., and Lodha, S. 2006. Theory and calibration algorithms for axial cameras. In ACCV. Google ScholarDigital Library
24. Sturm, P., and Ramalingam, S. 2004. A generic concept for camera calibration. In ECCV, vol. 2, 1–13.Google Scholar
25. Swaminathan, R., Grossberg, M., and Nayar, S. 2001. Caustics of catadioptric cameras. In ICCV, vol. 2, 2–9.Google Scholar
26. Swaminathan, R. 2007. Focus in catadioptric imaging systems. In ICCV, 1–7.Google Scholar
27. Taguchi, Y., Agrawal, A., Ramalingam, S., and Veeraraghavan, A. 2010. Axial light field for curved mirrors: Reflect your perspective, widen your view. In CVPR.Google Scholar
28. Tardif, J.-P., Sturm, P., Trudeau, M., and Roy, S. 2009. Calibration of cameras with radially symmetric distortion. PAMI 31, 9, 1552–1566. Google ScholarDigital Library
29. Unger, J., Wenger, A., Hawkins, T., Gardner, A., and Debevec, P. 2003. Capturing and rendering with incident light fields. In EGSR, 141–149. Google ScholarDigital Library
30. Vaish, V., Wilburn, B., Joshi, N., and Levoy, M. 2004. Using plane + parallax for calibrating dense camera arrays. In CVPR, 2–9.Google Scholar
31. Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., and Tumblin, J. 2007. Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph. 26, 3, 69:1–69:12. Google ScholarDigital Library
32. Yang, R., Welch, G., and Bishop, G. 2002. Real-time consensus-based scene reconstruction using commodity graphics hardware. In Pacific Graphics, 225–234. Google ScholarDigital Library
33. Yu, J., and McMillan, L. 2004. General linear cameras. In ECCV, vol. 2, 14–27.Google Scholar
