“Creating full view panoramic image mosaics and environment maps” by Szeliski and Shum

  • ©Richard Szeliski and Heung-Yeung Shum

Conference:


Type:


Title:

    Creating full view panoramic image mosaics and environment maps

Presenter(s)/Author(s):


Abstract:


    This paper presents a novel approach to creating full view panoramic mosaics from image sequences. Unlike current panoramic stitching methods, which usually require pure horizontal camera panning, our system does not require any controlled motions or constraints on how the images are taken (as long as there is no strong motion parallax). For example, images taken from a hand-held digital camera can be stitched seamlessly into panoramic mosaics. Because we represent our image mosaics using a set of transforms, there are no singularity problems such as those existing at the top and bottom of cylindrical or spherical maps. Our algorithm is fast and robust because it directly recovers 3D rotations instead of general 8 parameter planar perspective transforms. Methods to recover camera focal length are also presented. We also present an algorithm for efficiently extracting environment maps from our image mosaics. By mapping the mosaic onto an artibrary texture-mapped polyhedron surrounding the origin, we can explore the virtual environment using standard 3D graphics viewers and hardware without requiring special-purpose players.

References:


    1. N. Ayache. Vision St~r~oscopique et Perception Multisensorielle. InterEditions., Paris, 1989.
    2. J.R. Bergen, P. Anandan, K. J. Hanna, and R. Hingorani. Hierarchical model-based motion estimation. In Second European Conference on Computer Vision (ECCV’92), pages 237-252, Santa Margherita Liguere, Italy, May 1992. Springer-Verlag.
    3. S. Chen and L. Williams. View interpolation for image synthesis. Computer Graphics (SIGGRAPH’93), pages 279-288, August 1993.
    4. S. E. Chen. QuickTime VR- an image-based approach to virtual environment navigation. Computer Graphics (SIG- GRAPH’95), pages 29-38, August 1995.
    5. O. Faugeras. Three-dimensional computervision: A geometric viewpoint. MIT Press, Cambridge, Massachusetts, 1993.
    6. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen. The lumigraph. In Computer Graphics Proceedings, Annual Conference Series, pages 43-54, Proc. SIGGRAPH’96 (New Orleans), August 1996. ACM SIGGRAPH.
    7. N. Greene. Environment mapping and other applications of world projections. IEEE Computer Graphics and Applications, 6(11):21-29, November 1986.
    8. R.I. Hartley. Self-calibration from multiple views of a rotating camera. In Third European Conference on Computer Vision (ECCV’94), volume 1, pages 471-478, Stockholm, Sweden, May 1994. Springer-Veflag.
    9. M. Irani, P. Anandan, and S. Hsu. Mosaic based representations of video sequences and their applications. In Fifth International Conference on Computer Vision (ICCV’ 95), pages 605-611, Cambridge, Massachusetts, June 1995.
    10. S. B. Kang and R Weiss. Characterization of errors in cornpositing panoramic images. Technical Report 96/2, Digital Equipment Corporation, Cambridge Research Lab, June 1996.
    11. M. Levoy and E Hanrahan. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, pages 31- 42, Proc. SIGGRAPH’96 (New Orleans), August 1996. ACM SIGGRAPH.
    12. S. Mann and R. W. Picard. Virtual bellows: Constructing high-quality images from video. In First IEEE International Conference on Image Processing (ICIP-94), volume I, pages 363-367, Austin, Texas, November 1994.
    13. L. McMillan and G. Bishop. Plenoptic modeling: An image-based rendering system. Computer Graphics (SIG- GRAPH’95), pages 39-46, August 1995.
    14. J. Meehan. Panoramic Photography. Watson-Guptill, 1990.
    15. H.-Y. Shum and R. Szeliski. Construction and refinement of panoramic mosaics with global and local alignment. Submitted for review, April 1997.
    16. G. Stein. Accurate internal camera calibration using rotation, with analysis of sources of error. In Fifth International Conference on Computer Vision (ICCV’95), pages 230-236, Cambridge, Massachusetts, June 1995.
    17. R. Szeliski. Image mosaicing for tele-reality applications. In IEEE Workshop on Applications of Computer Vision (WACV’94), pages 44-53, Sarasota, Florida, December 1994. IEEE Computer Society.
    18. R. Szeliski. Video mosaics for virtual environments. IEEE Computer Graphics and Applications, pages 22-30, March 1996.
    19. R. Y. Tsai. A versatile camera calibration technique for highaccuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Journal of Robotics and Automation, RA-3(4):323-344, August 1987.
    20. H. Weghorst, G. Hooper, and D. E Greenberg. Improved computational methods for ray tracing. ACM Transactions on Graphics, 3(1):52069, January 1984.
    21. L. Williams. Pyramidal parametrics. Computer Graphics, 17(3):1-11, July 1983.
    22. http://qtvr.quicktime.apple.com.
    23. http://www.bdiamon.com.
    24. http://www.omniview.com.
    25. http://www, smoothmove.com.
    26. http://www.rlspace.com.
    27. http://www.behere.com.
    28. http://www.cs.columbia.edu/cave/omnicam.

ACM Digital Library Publication:


Overview Page: