“Multiresolution video” by Finkelstein, Jacobs and Salesin

  • ©Adam Finkelstein, Charles Jacobs, and David Salesin




    Multiresolution video



    We present a new representation for time-varying image data that allows for varying—and arbitrarily high—spatial and temporal resolutions in different parts of a video sequence. The representation, called multiresolution video, is based on a sparse, hierarchical encoding of the video data. We describe a number of operations for creating, viewing, and editing multiresolution sequences. These operations support a variety of applications: multiresolution playback, including motion-blurred “fast-forward” and “reverse”; constant speed display; enhanced video scrubbing; and “video clip-art” editing and compositing. The multiresolution representation requires little storage overhead, and the algorithms using the representation are both simple and efficient.


    1. J. Adams, R. Garcia, B. Gross, J. Hack, D. Haidvogel, and V. Pizzo. Applications of multigrid software in the atmospheric sciences. Monthly Weather Review, 120(7):1447- 1458, July 1992.
    2. Deborah E Berman, Jason T. Bartell, and David H. Salesin. Multiresolution painting and compositing. In Proceedings of SIGGRAPH ’94, Computer Graphics Proceedings, Annual Conference Series, pages 85-90, July 1994.
    3. Shenchang Eric Chen. Quicktime VRian image-based approach to virtual environment navigation. In Proceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, pages 29-38, August 1995.
    4. James D. Foley, Andries van Dam, Steven K. Feiner, and John E Hughes. Computer Graphics: Principles and Practice. Prentice-Hall, 1990.
    5. D. Le Gall. MPEG: A video compression standard for multimedia applications. CACM, 34(4):46-58, April 1991.
    6. Randy LeVeque and Marsha Berger. AMRCLAW: adaptive mesh refinement + CLAWPACK. http ://www. amath, washington, edu/~rjl/amrclaw/
    7. A. S. Lewis and G. Knowles. Video compression using 3D wavelet transforms. Electronics Letters, 26(6):396-398, 15 March 1990.
    8. S. McCormick and U. Rude. A finite volume convergence theory for the fast adaptive composite grid methods. Applied Numerical Mathematics, 14(1-3):91-103, May 1994.
    9. Leonard McMillan and Gary Bishop. Plenoptic modeling: An image-based rendering system. InProceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, pages 39-46, August 1995.
    10. Arun N. Netravali and Barry G. Haskell. Digital Pictures. Plenum Press, New York, 1988.
    11. Ken Perlin and Luiz Velho. Live paint: Painting with procedural multiscale textures. In Proceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, pages 153-160, August 1995.
    12. Thomas Porter and Tom Duff. Compositing digital images. In Hank Christiansen, editor, Computer Graphics (SIGGRAPH ’84 Proceedings), volume 18, pages 253-259, July 1984.
    13. Steven Radecki. Multimedia With Quicktime. Academic Press, 1993. ISBN 0-12-574750-0.
    14. Hanan Samet. Applications of Spatial Data Structures. Addison-Wesley, Reading, Massachusetts, 1990.
    15. E S. Sathyamurthy and S. V. Patankar. Block-correction-based multigrid method for fluid flow problems. Numerical Heat Transfer, Part B (Fundamentals), 25(4):375-94, June 1994.
    16. I. Suisalu and E. Saar. An adaptive multigrid solver for highresolution cosmological simulations. Monthly Notices of the Royal Astronomical Society, 274(1):287-299, May 1995.
    17. Jonathan Swartz and Brian C. Smith. A resolution independent video language. InACM Multimedia 95, pages 179-188. ACM, Addison-Wesley, November 1995.
    18. S.L. Tanimoto and Theo Pavlidis. A hierarchical data structure for picture processing. Computer Graphics and Image Processing, 4(2):104-119, June 1975.
    19. Lance Williams. Pyramidal parametrics. In Computer Graphics (SIGGRAPH ’83 Proceedings), volume 17, pages 1-11, July 1983.
    20. L. Ziv and A. Lempel. A universal algorithm for sequential data compression. IEEE Trans. Inform.Theory, Vol.IT-23, (3), May 1977.

ACM Digital Library Publication:

Overview Page: