“Fast Local Laplacian Filters: Theory and Applications” by Aubry, Paris, Hasinoff, Kautz and Durand

  • ©Mathieu Aubry, Sylvain Paris, Samuel Hasinoff, Jan Kautz, and Frédo Durand

Conference:


Type:


Title:

    Fast Local Laplacian Filters: Theory and Applications

Session/Category Title: Image Tricks

Presenter(s)/Author(s):


Moderator(s):


Abstract:


    Multiscale manipulations are central to image editing but also prone to halos. Achieving artifact-free results requires sophisticated edge-aware techniques and careful parameter tuning. These shortcomings were recently addressed by the local Laplacian filters, which can achieve a broad range of effects using standard Laplacian pyramids. However, these filters are slow to evaluate and their relationship to other approaches is unclear. In this article, we show that they are closely related to anisotropic diffusion and to bilateral filtering. Our study also leads to a variant of the bilateral filter that produces cleaner edges while retaining its speed. Building upon this result, we describe an acceleration scheme for local Laplacian filters on gray-scale images that yields speedups on the order of 50×. Finally, we demonstrate how to use local Laplacian filters to alter the distribution of gradients in an image. We illustrate this property with a robust algorithm for photographic style transfer.

References:


    1. A. Adams, J. Baek, and A. Davis. 2010. Fast high-dimensional filtering using the permutohedral lattice. http://graphics.stanford.edu/papers/permutohedral/permutohedral.pdf.
    2. A. Adams, N. Gelfand, J. Dolson, and M. Levoy. 2009. Gaussian kd-trees for fast high-dimensional filtering. ACM Trans. Graph. 28, 3.
    3. G. Aubert and P. Kornprobst. 2002. Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations. Applied Mathematical Sciences, vol. 147, Springer.
    4. S. Bae, S. Paris, and F. Durand. 2006. Two-scale tone management for photographic look. ACM Trans. Graph. 25, 3, 637–645.
    5. D. Barash and D. Comaniciu. 2004. A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift. J. Image Video Comput. 22, 73–81.
    6. M. J. Black, G. Sapiro, D. H. Marimont, and D. Heeger. 1998. Robust anisotropic diffusion. IEEE Trans. Image Process. 7, 3, 421–432.
    7. A. Buades, B. Coll, and J.-M. Morel. 2005a. Neighborhood filters and PDE’s. Tech. rep. 2005-04, CMLA.
    8. A. Buades, B. Coll, and J.-M. Morel. 2005b. A non-local algorithm for image denoising. In Proceedings of the Conference on Computer Vision and Pattern Recognition.
    9. A. Buades, B. Coll, and J.-M. Morel. 2006. The staircasing effect in neighborhood filters and its solution. IEEE Trans. Image Process. 15, 6, 1499–1505.
    10. J. Chen, S. Paris, and F. Durand. 2007. Real-time edge-aware image processing with the bilateral grid. ACM Trans. Graph. 26, 3.
    11. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian. 2006. Image denoising with block-matching and 3D filtering. Proc. SPIE 6064, A30.
    12. F. Durand and J. Dorsey. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 3.
    13. E. Eisemann and F. Durand. 2004. Flash photography enhancement via intrinsic relighting. ACM Trans. Graph. 23, 3.
    14. M. Elad. 2002. On the bilateral filter and ways to improve it. IEEE Trans. Image Process. 11, 10.
    15. Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27, 3.
    16. R. Fattal. 2009. Edge-avoiding wavelets and their applications. ACM Trans. Graph. 28, 3.
    17. R. Fattal, M. Agrawala, and S. Rusinkiewicz. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Trans. Graph. 26, 3.
    18. R. Fattal, D. Lischinski, and M. Werman. 2002. Gradient domain high dynamic range compression. ACM Trans. Graph. 21, 3.
    19. E. S. L. Gastal and M. M. Oliveira. 2011. Domain transform for edge-aware image and video processing. ACM Trans. Graph. 30, 3.
    20. E. S. L. Gastal and M. M. Oliveira. 2012. Adaptive manifolds for real-time high-dimensional filtering. ACM Trans. Graph. 31, 4.
    21. K. He, J. Sun, and X. Tang. 2010. Guided image filtering. In Proceedings of the European Conference on Computer Vision.
    22. M. Kass. and J. Solomon. 2010. Smoothed local histogram filters. ACM Trans. Graph. 29, 3.
    23. Y. Cli, L. Sharan, and E. H. Adelson. 2005. Compressing and companding high dynamic range images with subband architectures. ACM Trans. Graph. 24, 3, 836–844.
    24. P. Mrzek, J. Weickert, and A. Bruhn. 2006. Robust estimation and smoothing with spatial and tonal kernels. In Geometric Properties from Incomplete Data. Springer.
    25. S. Paris and F. Durand. 2009. A fast approximation of the bilateral filter using a signal processing approach. Int. J. Comput. Vis. 81, 1, 24–52.
    26. S. Paris, S. W. Hasinoff, and J. Kautz. 2011. Local laplacian filters: Edge-aware image processing with a laplacian pyramid. ACM Trans. Graph. 30, 4.
    27. S. Paris, P. Kornprobst, J. Tumblin, and F. Durand. 2009. Bilateral filtering: Theory and applications. In Foundations and Trends in Computer Graphics and Vision.
    28. P. Perona and J. Malik. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12, 7, 629–639.
    29. G. Petschnigg, M. Agrawala, H. Hoppe, R. Szeliski, M. Cohen, and K. Toyama. 2004. Digital photography with flash and no-flash image pairs. ACM Trans. Graph. 23, 3.
    30. J. Ragan-Kelley, A. Adams, S. Paris, M. Levoy, S. Amarasinghe, and F. Durand. 2012. Decoupling algorithms from schedules for easy optimization of image processing pipelines. ACM Trans. Graph. 31, 3.
    31. K. Subr, C. Soler, and F. Durand. 2009. Edge-preserving multi-scale image decomposition based on local extrema. ACM Trans. Graph. 28, 5.
    32. K. Sunkavalli, M. K. Johnson, W. Matusik, and H. Pfister. 2010. Multi-scale image harmonization. ACM Trans. Graph. 29, 3.
    33. C. Tomasi and R. Manduchi. 1998. Bilateral filtering for gray and color images. In Proceedings of the International Conference on Computer Vision. IEEE, 839–846.
    34. M. Trenacoste, R. Mantiuk, W. Heidrich, and F. Dufroz. 2012. Unsharp masking, countershading and halos: Enhancements or artifacts? Comput. Graph. Forum 31, 2, 555–564.
    35. J. Van De Weijer. and R. Van Den Boomgaard. 2002. On the equivalence of local-mode finding, robust estimation and mean-shift analysis as used in early vision tasks. In Proceedings of the International Conference on Pattern Recognition.
    36. L. Xu, C. Lu, Y. Xu, and J. Jia. 2011. Image smoothing via l0 gradient minimization. ACM Trans. Graph. 30, 6.
    37. J. Zhong and H. Sun. 2008. Wavelet-based multiscale diffusion with adaptive statistical analysis for image restoration. IEEE Trans. Circ. Syst. 55, 9.

ACM Digital Library Publication:


Overview Page: