“Structure-preserving image smoothing via region covariances” by Karacan, Erdem and Erdem
Conference:
Type(s):
Title:
- Structure-preserving image smoothing via region covariances
Session/Category Title: Image Ops
Presenter(s)/Author(s):
Abstract:
Recent years have witnessed the emergence of new image smoothing techniques which have provided new insights and raised new questions about the nature of this well-studied problem. Specifically, these models separate a given image into its structure and texture layers by utilizing non-gradient based definitions for edges or special measures that distinguish edges from oscillations. In this study, we propose an alternative yet simple image smoothing approach which depends on covariance matrices of simple image features, aka the region covariances. The use of second order statistics as a patch descriptor allows us to implicitly capture local structure and texture information and makes our approach particularly effective for structure extraction from texture. Our experimental results have shown that the proposed approach leads to better image decompositions as compared to the state-of-the-art methods and preserves prominent edges and shading well. Moreover, we also demonstrate the applicability of our approach on some image editing and manipulation tasks such as image abstraction, texture and detail enhancement, image composition, inverse halftoning and seam carving.
References:
1. Aujol, J.-F., Gilboa, G., Chan, T., and Osher, S. 2006. Structure-texture image decomposition–modeling, algorithms, and parameter selection. Int. J. Comput. Vision 67, 1, 111–136.
2. Avidan, S., and Shamir, A. 2007. Seam carving for content-aware image resizing. ACM Trans. Graph. 26, 3.
3. Baek, J., and Jacobs, D. E. 2010. Accelerating spatially varying gaussian filters. ACM Trans. Graph. 29, 6.
4. Buades, A., Coll, B., and Morel, J.-M. 2005. A non-local algorithm for image denoising. In CVPR, vol. 2, 60–65.
5. Buades, A., Le, T. M., Morel, J.-M., and Vese, L. A. 2010. Fast cartoon + texture image filters. IEEE Trans. Image Process. 19, 8, 1978–1986.
6. Burt, P. J., and Adelson, E. H. 1983. The laplacian pyramid as a compact image code. IEEE Trans. Commun. 31, 4, 532–540.
7. Cherian, A., Sra, S., Banerjee, A., and Papanikolopoulos, N. 2011. Efficient similarity search for covariance matrices via the Jensen-Bregman LogDet divergence. In ICCV, 2399–2406.
8. Criminisi, A., Sharp, T., Rother, C., and Pérez, P. 2010. Geodesic image and video editing. ACM Trans. Graph. 29, 5.
9. Dowson, N., and Salvado, O. 2011. Hashed nonlocal means for rapid image filtering. IEEE Trans. on Pattern Analysis and Machine Intelligence 33, 3, 485–499.
10. Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 3, 257–266.
11. Efros, A., and Leung, T. 1999. Texture synthesis by nonparametric sampling. In ICCV, 1033–1038.
12. Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27, 3.
13. Farbman, Z., Fattal, R., and Lischinski, D. 2010. Diffusion maps for edge-aware image editing. ACM Trans. Graph. 29, 6.
14. Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Trans. Graph. 26, 3.
15. Gilboa, G., Sochen, N., and Zeevi, Y. 2002. Regularized shock filters and complex diffusion. In ECCV, 399–313.
16. Hong, X., Chang, H., Shan, S., Chen, X., and Gao, W. 2009. Sigma set: A small second order statistical region descriptor. In CVPR, 1802–1809.
17. Kopf, J., and Lischinski, D. 2012. Digital reconstruction of halftoned color comics. ACM Trans. Graph. 31, 6.
18. Marr, D. 1982. Vision. W. H. Freeman and Company.
19. Meyer, Y. 2001. Oscillating patterns in image processing and nonlinear evolution equations: the fifteenth Dean Jacqueline B. Lewis memorial lectures, vol. 22. Amer Mathematical Society.
20. Perona, P., and Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intell. 12, 629–639.
21. Rubinstein, M., Gutierrez, D., Sorkine, O., and Shamir, A. 2010. A comparative study of image retargeting. ACM Trans. Graph. 29, 6.
22. Rudin, L., Osher, S., and Fatemi, E. 1992. Nonlinear total variation based noise removal algorithms. Phys. D. 60, 259–268.
23. Subr, K., Soler, C., and Durand, F. 2009. Edge-preserving multiscale image decomposition based on local extrema. ACM Trans. Graph. 28, 5.
24. Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In ICCV, 839–846.
25. Tuzel, O., Porikli, F., and Meer, P. 2006. Region covariance: A fast descriptor for detection and classification. ECCV, 589–600.
26. Winnemöller, H., Olsen, S. C., and Gooch, B. 2006. Realtime video abstraction. ACM Trans. Graph. 25, 3, 1221–1226.
27. Witkin, A. P. 1984. Scale-space filtering: A new approach to multi-scale description. In ICASSP, vol. 9, 150–153.
28. Xu, L., Lu, C., Xu, Y., and Jia, J. 2011. Image smoothing via L0 gradient minimization. ACM Trans. Graph. 30, 6.
29. Xu, L., Yan, Q., Xia, Y., and Jia, J. 2012. Structure extraction from texture via relative total variation. ACM Trans. Graph. 31, 6.
30. Zontak, M., Mosseri, I., and Irani, M. 2013. Separating signal from noise using patch recurrence across scales. In CVPR.
