“Optimizing continuity in multiscale imagery”
Conference:
Type(s):
Title:
- Optimizing continuity in multiscale imagery
Session/Category Title: Computational imagery
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Multiscale imagery often combines several sources with differing appearance. For instance, Internet-based maps contain satellite and aerial photography. Zooming within these maps may reveal jarring transitions. We present a scheme that creates a visually smooth mipmap pyramid from stitched imagery at several scales. The scheme involves two new techniques. The first, structure transfer, is a nonlinear operator that combines the detail of one image with the local appearance of another. We use this operator to inject detail from the fine image into the coarse one while retaining color consistency. The improved structural similarity greatly reduces inter-level ghosting artifacts. The second, clipped Laplacian blending, is an efficient construction to minimize blur when creating intermediate levels. It considers the sum of all inter-level image differences within the pyramid. We demonstrate continuous zooming of map imagery from space to ground level.
References:
1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., And Cohen, M. 2004. Interactive digital photomontage. ACM Trans. on Graphics, 23, 3. Google ScholarDigital Library
2. Antonini, M., Barlaud, M., Mathieu, P., and Daubechies, I. 1992. Image coding using wavelet transform. IEEE Trans. on Image processing, 1, 2.Google ScholarDigital Library
3. Belady, L. 1966. A study of replacement algorithms for a virtual-storage computer. IBM Systems Journal, 5, 2. Google ScholarDigital Library
4. Burt, P., and Adelson, E. 1983. The Laplacian pyramid as a compact image code. IEEE Trans. on Communications, 31, 4.Google ScholarCross Ref
5. Burt, P., and Adelson, E. 1983. A multiresolution spline with application to image mosaics, ACM Trans. on Graphics, 2, 4. Google ScholarDigital Library
6. Chavez, P., Sides, S., and Anderson, J. 1991. Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic. Photogrammetric Engineering & Remote Sensing, 57, 3.Google Scholar
7. Crum, W., Hartkens, T., and Hill, D. 2004. Non-rigid image registration: theory and practice. British Journal of Radiology.Google Scholar
8. Gonzalez, R., and Woods, R. 1992. Digital Image Processing. Addison Wesley. Google ScholarDigital Library
9. Keys, R. 1981. Cubic convolution interpolation for digital image processing. IEEE Trans. on Acoustics, Speech, and Signal Processing, 29, 6.Google ScholarCross Ref
10. Kopf, J., Cohen, M., Lischinski, D., And Uyttendaele, M. 2007. Joint bilateral upsampling. ACM Trans. on Graphics, 26, 3. Google ScholarDigital Library
11. Krishnan, D., and Fergus, R. 2009. Dark flash photography. ACM Trans. on Graphics, 28, 3. Google ScholarDigital Library
12. Liu, Z., Shan, Y., and Zhang, Z. 2001. Expressive expression mapping with ratio images. ACM SIGGRAPH Proceedings. Google ScholarDigital Library
13. Mitchell, D., and Netravali, A. 1988. Reconstruction filters in computer graphics. ACM SIGGRAPH Proceedings. Google ScholarDigital Library
14. Oliva, A., Torralba, A., and Schyns, P. 2006. Hybrid images. ACM Trans. on Graphics, 25, 3. Google ScholarDigital Library
15. Pang, W.-M., Qu, Y., Wong, T.-T., Cohen-Or, D., and Heng, P.-A. 2008. Structure-aware halftoning. ACM Trans. on Graphics, 27, 3. Google ScholarDigital Library
16. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. on Graphics, 22, 3. Google ScholarDigital Library
17. Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., Toyama, K. 2004. Digital photography with flash and no-flash image pairs. ACM Trans. on Graphics, 23, 3. Google ScholarDigital Library
18. Pitié, F., Kokaram, A., and Dahyot, R. 2007. Automated color grading using color distribution transfer. Computer Vision and Image Understanding, 107, 1–2. Google ScholarDigital Library
19. Pizer, S., Amburn, E., Austin, J., Cromartie, R., Geselowitz, A., Greer, T., Romeny, B., Zimmerman, J., and Zuiderveld, K. 1987. Adaptive histogram equalization and its variations. Computer Vision, Graphics, and Image Processing, 39. Google ScholarDigital Library
20. Pohl, C., and Van Genderen, J. L. 1998. Multisensor image fusion in remote sensing: concepts, methods and applications. Int. J. Remote Sensing, 19, 5.Google ScholarCross Ref
21. Reinhard, E., Ashikhmin, M., Gooch, B, and Shirley, P. 2001. Color transfer between images. IEEE CG&A, 21, 5. Google ScholarDigital Library
22. Stathaki, T. 2008. Image Fusion: Algorithms and Applications. Academic Press. Google ScholarDigital Library
23. Szeliski, R. 2006. Image alignment and stitching: A tutorial. Foundations and Trends in Comp. Graphics and Vision, 2(1). Google ScholarDigital Library
24. Wang, Z., Bovik, A., Sheikh, H., and Simoncelli, E. 2004. Image quality assessment: From error visibility to structural similarity. IEEE Trans. on Image Processing, 13, 4. Google ScholarDigital Library
25. Williams, L. 1983. Pyramidal parametrics. ACM SIGGRAPH Proceedings. Google ScholarDigital Library
26. Witkin, A. 1983. Scale-space filtering: A new approach to multi-scale description. Proc. 8th Int. Joint Conf. Art. Intell. Google ScholarDigital Library
27. Zarbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. on Graphics, 27, 3. Google ScholarDigital Library
