“Real-time edge-aware image processing with the bilateral grid” by Chen, Paris and Durand

We present a new data structure—the bilateral grid, that enables fast edge-aware image processing. By working in the bilateral grid, algorithms such as bilateral filtering, edge-aware painting, and local histogram equalization become simple manipulations that are both local and independent. We parallelize our algorithms on modern GPUs to achieve real-time frame rates on high-definition video. We demonstrate our method on a variety of applications such as image editing, transfer of photographic look, and contrast enhancement of medical images.

1. Aurich, V., and Weule, J. 1995. Non-linear gaussian filters performing edge preserving diffusion. In Proceedings of the DAGM Symposium. Google ScholarDigital Library
2. Bae, S., Paris, S., and Durand, F. 2006. Two-scale tone management for photographic look. ACM Transactions on Graphics 25, 3, 637 — 645. Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
3. Barash, D. 2002. A fundamental relationship between bilateral filtering, adaptive smoothing and the nonlinear diffusion equation. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 6, 844. Google ScholarDigital Library
4. Bennett, E. P., and McMillan, L. 2005. Video enhancement using per-pixel virtual exposures. ACM Transactions on Graphics 24, 3 (July), 845 — 852. Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
5. Blinn, J. F. 1996. Fun with premultiplied alpha. IEEE Computer Graphics and Applications 16, 5, 86–89. Google ScholarDigital Library
6. Chiu, K., Herf, M., Shirley, P., Swamy, S., Wang, C., and Zimmerman, K. 1993. Spatially nonuniform scaling functions for high contrast images. In Proceedings of the conference on Graphics Interface, 245–253.Google Scholar
7. DeCarlo, D., and Santella, A. 2002. Stylization and abstraction of photographs. ACM Transactions on Graphics 21, 3. Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
8. Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics 21, 3. Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
9. Eisemann, E., and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. ACM Transactions on Graphics 23, 3 (July). Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
10. Felsberg, M., Forssén, P.-E., and Scharr, H. 2006. Channel smoothing: Efficient robust smoothing of low-level signal features. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 2 (February), 209–222. Google ScholarDigital Library
11. Gonzales, R. C., and Woods, R. E. 2002. Digital Image Processing. Prentice Hall. ISBN 0201180758. Google ScholarDigital Library
12. Goodnight, N., Woolley, C., Lewin, G., Luebke, D., and Humphreys, G. 2003. A multigrid solver for boundary value problems using programmable graphics hardware. In Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics Hardware. Google ScholarDigital Library
13. Harris, M., and Luebke, D. 2004. GPGPU. In Course notes of the ACM SIGGRAPH conference. Google ScholarDigital Library
14. Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Transactions on Graphics 23, 3 (July). Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
15. Levin, A., Rav-Acha, A., and Lischinski, D. 2007. Spectral matting. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition.Google Scholar
16. Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Transactions on Graphics 25, 3, 646 — 653. Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
17. Oh, B. M., Chen, M., Dorsey, J., and Durand, F. 2001. Image-based modeling and photo editing. In Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
18. Paris, S., and Durand, F. 2006. A fast approximation of the bilateral filter using a signal processing approach. In Proceedings of the European Conference on Computer Vision. Google ScholarDigital Library
19. Perona, P., and Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions Pattern Analysis Machine Intelligence 12, 7 (July), 629–639. Google ScholarDigital Library
20. Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. ACM Transactions on Graphics 23, 3 (July). Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
21. Pham, T. Q., and van Vliet, L. J. 2005. Separable bilateral filtering for fast video preprocessing. In Proceedings of the IEEE International Conference on Multimedia and Expo.Google ScholarCross Ref
22. Smith, S. M., and Brady, J. M. 1997. SUSAN – a new approach to low level image processing. International Journal of Computer Vision 23, 1 (May), 45–78. Google ScholarDigital Library
23. Sochen, N., Kimmel, R., and Malladi, R. 1998. A general framework for low level vision. IEEE Transactions in Image Processing 7, 310–318. Google ScholarDigital Library
24. Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proceedings of the IEEE International Conference on Computer Vision, 839–846. Google ScholarDigital Library
25. Tumblin, J., and Turk, G. 1999. LCIS: A boundary hierarchy for detail-preserving contrast reduction. In Proceedings of the ACM SIGGRAPH conference, 83–90. Google ScholarDigital Library
26. Weiss, B. 2006. Fast median and bilateral filtering. ACM Transactions on Graphics 25, 3, 519 — 526. Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
27. Willis, P. J. 2006. Projective alpha colour. Computer Graphics Forum 25, 3 (Sept.), 557–566. 0167–7055.Google ScholarCross Ref
28. Winnemöller, H., Olsen, S. C., and Gooch, B. 2006. Realtime video abstraction. ACM Transactions on Graphics 25, 3, 1221 — 1226. Proceedings of the ACM SIGGRAPH conference. Google ScholarDigital Library
29. Xiao, J., Cheng, H., Sawhney, H., Rao, C., and Isnardi, M. 2006. Bilateral filtering-based optical flow estimation with occlusion detection. In Proceedings of the European Conference on Computer Vision. Google ScholarDigital Library