“Sparse PDF maps for non-linear multi-resolution image operations” by Hadwiger, Sicat, Beyer, Krüger and Möller – ACM SIGGRAPH HISTORY ARCHIVES

“Sparse PDF maps for non-linear multi-resolution image operations” by Hadwiger, Sicat, Beyer, Krüger and Möller

  • 2012 SA Technical Papers_Hadwiger_Sparse PDF Maps for Non Linear Multi Resolution Image Operations

Conference:


Type(s):


Title:

    Sparse PDF maps for non-linear multi-resolution image operations

Session/Category Title:   Operating on Images

Presenter(s)/Author(s):


Abstract:


    We introduce a new type of multi-resolution image pyramid for high-resolution images called sparse pdf maps (sPDF-maps). Each pyramid level consists of a sparse encoding of continuous probability density functions (pdfs) of pixel neighborhoods in the original image. The encoded pdfs enable the accurate computation of non-linear image operations directly in any pyramid level with proper pre-filtering for anti-aliasing, without accessing higher or lower resolutions. The sparsity of sPDF-maps makes them feasible for gigapixel images, while enabling direct evaluation of a variety of non-linear operators from the same representation. We illustrate this versatility for antialiased color mapping, O(n) local Laplacian filters, smoothed local histogram filters (e.g., median or mode filters), and bilateral filters.

References:


    1. Aubry, M., Paris, S., Hasinoff, S. W., Kautz, J., and Durand, F. 2011. Fast and Robust Pyramid-based Image Processing. Tech. rep., MIT. MIT-CSAIL-TR-2011-049.
    2. Burt, P., and Adelson, T. 1983. The Laplacian pyramid as a compact image code. IEEE Transactions on Communications 9, 4, 532–540.
    3. Carpenter, L. 1983. The A-buffer, an antialiased hidden surface method. In Proceedings of SIGGRAPH 1983, ACM Press/ACM SIGGRAPH, 1–11.
    4. Chen, J., Paris, S., and Durand, F. 2007. Real-time edge-aware image processing with the bilateral grid. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 103:1–103:9.
    5. Crow, F. C. 1977. The aliasing problem in computer-generated shaded images. In Proceedings of SIGGRAPH 1977, ACM Press/ACM SIGGRAPH, 799–805.
    6. Donnelly, W., and Lauritzen, A. 2006. Variance shadow maps. In Proceedings of 2006 Symposium On Interactive 3D Graphics and Games, ACM Press, 161–165.
    7. Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 51:1–51:9.
    8. Fattal, R. 2009. Edge-avoiding wavelets and their applications. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2009) 28, 3, 22:1–22:10.
    9. Felsberg, M., Forssen, P.-E., and Scharr, H. 2006. Channel smoothing: Efficient robust smoothing of low-level signal features. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 2, 209–222.
    10. Greene, N., and Heckbert, P. 1986. Creating raster omni-max images from multiple perspective views using the elliptical weighted average filter. IEEE Computer Graphics and Applications 6, 6, 21–27.
    11. Han, C., Sun, B., Ramamoorthi, R., and Grinspun, E. 2007. Frequency domain normal map filtering. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 28:1–28:12.
    12. Hanika, J., Dammertz, H., and Lensch, H. 2011. Edge-optimized À-trous wavelets for local contrast enhancement with robust denoising. Computer Graphics Forum 30, 7, 1879–1886.
    13. Heckbert, P. 1989. Fundamentals of Texture Mapping and Image Warping. Master’s thesis, U. C. Berkeley.
    14. Jeong, W.-K., Johnson, M. K., Yu, I., Kautz, J., Pfister, H., and Paris, S. 2011. Display-aware image editing. In Proceedings of IEEE International Conference on Computational Photography.
    15. Kass, M., and Solomon, J. 2010. Smoothed local histogram filters. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2010) 29, 4, 100:1–100:10.
    16. Kazhdan, M., and Hoppe, H. 2008. Streaming multigrid for gradient-domain operations on large images. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2008) 27, 3, 21:1–21:10.
    17. Koenderink, J. J., and Van Doorn, A. J. 1999. The structure of locally orderless images. International Journal of Computer Vision 31, 2–3 (Apr.), 159–168.
    18. Kopf, J., Uyttendaele, M., Deussen, O., and Cohen, M. F. 2007. Capturing and viewing gigapixel images. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 3, 93:1–93:10.
    19. Mallat, S., and Zhang, Z. 1993. Matching pursuits with time-frequency dictionaries. IEEE Transactions on Signal Processing 41, 12 (Dec), 3397–3415.
    20. Mallat, S. 2009. A Wavelet Tour of Signal Processing: The Sparse Way, 3rd ed. Academic Press.
    21. NASA, 2005. Blue marble: Next generation. NASA Earth Observatory. http://earthobservatory.nasa.gov/Features/BlueMarble/.
    22. Paris, S., and Durand, F. 2006. A fast approximation of the bilateral filter using a signal processing approach. In Proceedings of European Conference on Computer Vision (ECCV) 2006, 568–580.
    23. Paris, S., Hasinoff, S. W., and Kautz, J. 2011. Local Laplacian filters: Edge-aware image processing with a Laplacian pyramid. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2011) 30, 4, 68:1–68:12.
    24. Reeves, W., Salesin, D., and Cook, R. 1987. Rendering antialiased shadows with depth maps. In Proceedings of SIGGRAPH 1987, ACM Press/ACM SIGGRAPH, 283–291.
    25. Summa, B., Scorzelli, G., Jiang, M., Bremer, P.-T., and Pascucci, V. 2010. Interactive editing of massive imagery made simple: Turning Atlanta into Atlantis. ACM Transactions on Graphics 30, 2, 7:1–7:13.
    26. Tan, P., Lin, S., Quan, L., Guo, B., and Shum, H. 2008. Filtering and rendering of resolution-dependent reflectance models. IEEE Transactions on Visualization and Computer Graphics 14, 2, 412–425.
    27. Thompson, D., Levine, J., Bennett, J., Breemer, P.-T., Gyulassy, A., Pebay, P., and Pascucci, V. 2011. Analysis of large-scale scalar data using hixels. In Proceedings of IEEE Symposium on Large-Scale Data Analysis and Visualization (LDAV), 23–30.
    28. Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proceedings of International Conference on Computer Vision (ICCV) ’98, 839–846.
    29. Williams, L. 1983. Pyramidal parametrics. In Proceedings of SIGGRAPH 1983, ACM Press/ACM SIGGRAPH, 1–11.
    30. Younesy, H., Möller, T., and Carr, H. 2006. Improving the quality of multi-resolution volume rendering. In Proceedings of Eurovis 2006, 251–258.

ACM Digital Library Publication:


Overview Page:


Submit a story:

If you would like to submit a story about this presentation, please contact us: historyarchives@siggraph.org