“Multiview radial catadioptric imaging for scene capture” by Kuthirummal and Nayar

  • ©Sujit Kuthirummal and Shree K. Nayar




    Multiview radial catadioptric imaging for scene capture



    In this paper, we present a class of imaging systems, called radial imaging systems, that capture a scene from a large number of view-points within a single image, using a camera and a curved mirror. These systems can recover scene properties such as geometry, reflectance, and texture. We derive analytic expressions that describe the properties of a complete family of radial imaging systems, including their loci of viewpoints, fields of view, and resolution characteristics. We have built radial imaging systems that, from a single image, recover the frontal 3D structure of an object, generate the complete texture map of a convex object, and estimate the parameters of an analytic BRDF model for an isotropic material. In addition, one of our systems can recover the complete geometry of a convex object by capturing only two images. These results show that radial imaging systems are simple, effective, and convenient devices for a wide range of applications in computer graphics and computer vision.


    1. Dana, K. J. 2001. BRDF/BTF Measurement Device. In Proc. of ICCV, 460–466.Google ScholarCross Ref
    2. Davidhazy, A. 1987. Peripheral Photography: Shooting full circle. Industrial Photography 36, 28–31.Google Scholar
    3. Efros, A. A., and Freeman, W. T. 2001. Image Quilting for Texture Synthesis and Transfer. In Proc. of SIGGRAPH, 341–346. Google ScholarDigital Library
    4. Efros, A. A., and Leung, T. K. 1999. Texture Synthesis by Non-parametric Sampling. In Proc. of ICCV, 1033–1038. Google ScholarDigital Library
    5. Gluckman, J., and Nayar, S. K. 1999. Planar Catadioptric Stereo: Geometry and Calibration. In Proc. of CVPR, 1022–1028.Google Scholar
    6. Gluckman, J., Thorek, K., and Nayar, S. K. 1998. Real time panoramic stereo. In Proc. of Image Understanding Workshop.Google Scholar
    7. Gortler, S., Grzeszczuk, R., Szeliski, R., and Cohen, M. 1996. The Lumigraph. In Proc. SIGGRAPH, 43–54. Google ScholarDigital Library
    8. Han, J. Y., and Perlin, K. 2003. Measuring bidirectional texture reflectance with a kaleidoscope. In Proc. of SIGGRAPH, 741–748. Google ScholarDigital Library
    9. Hawkins, T., Einarsson, P., and Debevec, P. 2005. Acquisition of time-varying participating media. In Proc. of SIGGRAPH, 812–815. Google ScholarDigital Library
    10. Kanade, T., Yoshida, A., Oda, K., Kano, H., and Tanaka, M. 1996. A Stereo Machine for Video-rate Dense Depth Mapping and its New Applications. In Proc. of CVPR, 196–202. Google ScholarDigital Library
    11. Kanade, T., Rander, P., and Narayanan, P. 1997. Virtualized Reality: Constructing Virtual Worlds from Real Scenes. In IEEE Multimedia, 34–47. Google ScholarDigital Library
    12. Kwatra, V., Schdl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut Textures: Image and Video Synthesis Using Graph Cuts. In Proc. of SIGGRAPH, 277–286. Google ScholarDigital Library
    13. Levoy, M., and Hanrahan, P. 1996. Light Field Rendering. In Proc. of SIGGRAPH, 31–42. Google ScholarDigital Library
    14. Levoy, M., Chen, B., Vaish, V., Horowitz, M., Mcdowall, I., and Bolas, M. 2004. Synthetic aperture confocal imaging. In Proc. of SIGGRAPH, 825–834. Google ScholarDigital Library
    15. Lin, S.-S., and Bajcsy, R. 2003. High Resolution Catadioptric Omni-Directional Stereo Sensor for Robot Vision. In Proc. of ICRA, 1694–1699.Google Scholar
    16. Liu, X., Yu, Y., and Shum, H.-Y. 2001. Synthesizing Bidirectional Texture Functions for Real-World Surfaces. In Proc. of SIGGRAPH, 97–106. Google ScholarDigital Library
    17. Nene, S., and Nayar, S. K. 1998. Stereo with Mirrors. In Proc. of ICCV, 1087–1094. Google ScholarDigital Library
    18. Peleg, S., and Herman, J. 1997. Panoramic Mosaics by Manifold Projection. In Proc. of CVPR, 338–343. Google ScholarDigital Library
    19. Scharstein, D., and Szeliski, R. 2002. A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms. IJCV 47, 7–42. Google ScholarDigital Library
    20. Seitz, S. M., and Kim, J. 2002. The Space of All Stereo Images. IJCV 48, 21–38. Google ScholarDigital Library
    21. Shum, H.-Y., and He, L.-W. 1999. Rendering with Concentric Mosaics. In Proc. of SIGGRAPH, 299 — 306. Google ScholarDigital Library
    22. Southwell, D., Basu, A., Fiala, M., and Reyda, J. 1996. Panoramic Stereo. In Proc. of ICPR, 378–382. Google ScholarDigital Library
    23. Unger, J., Wenger, A., Hawkins, T., Gardner, A., and Debevec, P. 2003. Capturing and Rendering with Incident Light Fields. In Proc. of EGSR, 141–149. Google ScholarDigital Library
    24. Ward, G. J. 1992. Measuring and Modeling Anisotropic Reflection. In Proc. of SIGGRAPH, 265–272. Google ScholarDigital Library

ACM Digital Library Publication: