“Multiresolution video” by Finkelstein, Jacobs and Salesin

  • ©Adam Finkelstein, Charles Jacobs, and David Salesin

Conference:


Type:


Title:

    Multiresolution video

Presenter(s)/Author(s):



Abstract:


    We present a new representation for time-varying image data that allows for varying—and arbitrarily high—spatial and temporal resolutions in different parts of a video sequence. The representation, called multiresolution video, is based on a sparse, hierarchical encoding of the video data. We describe a number of operations for creating, viewing, and editing multiresolution sequences. These operations support a variety of applications: multiresolution playback, including motion-blurred “fast-forward” and “reverse”; constant speed display; enhanced video scrubbing; and “video clip-art” editing and compositing. The multiresolution representation requires little storage overhead, and the algorithms using the representation are both simple and efficient.

References:


    1. J. Adams, R. Garcia, B. Gross, J. Hack, D. Haidvogel, and V. Pizzo. Applications of multigrid software in the atmospheric sciences. Monthly Weather Review, 120(7):1447- 1458, July 1992.
    2. Deborah E Berman, Jason T. Bartell, and David H. Salesin. Multiresolution painting and compositing. In Proceedings of SIGGRAPH ’94, Computer Graphics Proceedings, Annual Conference Series, pages 85-90, July 1994.
    3. Shenchang Eric Chen. Quicktime VRian image-based approach to virtual environment navigation. In Proceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, pages 29-38, August 1995.
    4. James D. Foley, Andries van Dam, Steven K. Feiner, and John E Hughes. Computer Graphics: Principles and Practice. Prentice-Hall, 1990.
    5. D. Le Gall. MPEG: A video compression standard for multimedia applications. CACM, 34(4):46-58, April 1991.
    6. Randy LeVeque and Marsha Berger. AMRCLAW: adaptive mesh refinement + CLAWPACK. http ://www. amath, washington, edu/~rjl/amrclaw/
    7. A. S. Lewis and G. Knowles. Video compression using 3D wavelet transforms. Electronics Letters, 26(6):396-398, 15 March 1990.
    8. S. McCormick and U. Rude. A finite volume convergence theory for the fast adaptive composite grid methods. Applied Numerical Mathematics, 14(1-3):91-103, May 1994.
    9. Leonard McMillan and Gary Bishop. Plenoptic modeling: An image-based rendering system. InProceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, pages 39-46, August 1995.
    10. Arun N. Netravali and Barry G. Haskell. Digital Pictures. Plenum Press, New York, 1988.
    11. Ken Perlin and Luiz Velho. Live paint: Painting with procedural multiscale textures. In Proceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, pages 153-160, August 1995.
    12. Thomas Porter and Tom Duff. Compositing digital images. In Hank Christiansen, editor, Computer Graphics (SIGGRAPH ’84 Proceedings), volume 18, pages 253-259, July 1984.
    13. Steven Radecki. Multimedia With Quicktime. Academic Press, 1993. ISBN 0-12-574750-0.
    14. Hanan Samet. Applications of Spatial Data Structures. Addison-Wesley, Reading, Massachusetts, 1990.
    15. E S. Sathyamurthy and S. V. Patankar. Block-correction-based multigrid method for fluid flow problems. Numerical Heat Transfer, Part B (Fundamentals), 25(4):375-94, June 1994.
    16. I. Suisalu and E. Saar. An adaptive multigrid solver for highresolution cosmological simulations. Monthly Notices of the Royal Astronomical Society, 274(1):287-299, May 1995.
    17. Jonathan Swartz and Brian C. Smith. A resolution independent video language. InACM Multimedia 95, pages 179-188. ACM, Addison-Wesley, November 1995.
    18. S.L. Tanimoto and Theo Pavlidis. A hierarchical data structure for picture processing. Computer Graphics and Image Processing, 4(2):104-119, June 1975.
    19. Lance Williams. Pyramidal parametrics. In Computer Graphics (SIGGRAPH ’83 Proceedings), volume 17, pages 1-11, July 1983.
    20. L. Ziv and A. Lempel. A universal algorithm for sequential data compression. IEEE Trans. Inform.Theory, Vol.IT-23, (3), May 1977.


ACM Digital Library Publication:



Overview Page: