“Structure extraction from texture via relative total variation” by Xu, Yan, Xia and Jia
Conference:
Type(s):
Title:
- Structure extraction from texture via relative total variation
Session/Category Title: Comics, Texture and Scribbles
Presenter(s)/Author(s):
Abstract:
It is ubiquitous that meaningful structures are formed by or appear over textured surfaces. Extracting them under the complication of texture patterns, which could be regular, near-regular, or irregular, is very challenging, but of great practical importance. We propose new inherent variation and relative total variation measures, which capture the essential difference of these two types of visual forms, and develop an efficient optimization system to extract main structures. The new variation measures are validated on millions of sample patches. Our approach finds a number of new applications to manipulate, render, and reuse the immense number of “structure with texture” images and drawings that were traditionally difficult to be edited properly.
References:
1. Arbelaez, P., Maire, M., Fowlkes, C., and Malik, J. 2011. Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33, 5, 898–916.
2. Arnheim, R. 1956. Art and Visual Perception: A Psychology of the Creative Eye. University of California Press.
3. Aujol, J.-F., Gilboa, G., Chan, T. F., and Osher, S. 2006. Structure-texture image decomposition – modeling, algorithms, and parameter selection. International Journal of Computer Vision 67, 1, 111–136.
4. Avidan, S., and Shamir, A. 2007. Seam carving for content-aware image resizing. ACM Trans. Graph. 26, 3, 10.
5. Canny, J. 1986. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, 6, 679–698.
6. Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 21, 3, 257–266.
7. Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In SIGGRAPH, 341–346.
8. Efros, A. A., and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In ICCV, 1033–1038.
9. Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. Graph. 27, 3.
10. Farbman, Z., Fattal, R., and Lischinski, D. 2010. Diffusion maps for edge-aware image editing. ACM Trans. Graph. 29, 6, 145.
11. Fattal, R., Agrawala, M., and Rusinkiewicz, S. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Trans. Graph. 26, 3, 51.
12. Goferman, S., Zelnik-Manor, L., and Tal, A. 2010. Context-aware saliency detection. In CVPR, 2376–2383.
13. Hays, J., Leordeanu, M., Efros, A. A., and Liu, Y. 2006. Discovering texture regularity as a higher-order correspondence problem. In ECCV (2), 522–535.
14. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. 2001. Image analogies. In SIGGRAPH, 327–340.
15. Kass, M., and Solomon, J. 2010. Smoothed local histogram filters. ACM Trans. Graph. 29, 4.
16. Krishnan, D., and Szeliski, R. 2011. Multigrid and multilevel preconditioners for computational photography. ACM Trans. Graph. 30, 6.
17. Kwatra, V., Schödl, A., Essa, I. A., Turk, G., and Bobick, A. F. 2003. Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22, 3, 277–286.
18. Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Trans. Graph. 23, 3, 689–694.
19. Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. Graph. 25, 3, 646–653.
20. Liu, Y., Collins, R. T., and Tsin, Y. 2003. A computational model for periodic pattern perception based on frieze and wallpaper groups. IEEE Trans. Pattern Anal. Mach. Intell. 26, 3, 354–371.
21. Liu, Y., Lin, W.-C., and Hays, J. 2004. Near-regular texture analysis and manipulation. ACM Trans. Graph. 23, 3, 368–376.
22. Liu, Y., Belkina, T., Hays, J., and Lublinerman, R. 2008. Image de-fencing. In CVPR.
23. Malik, J., Belongie, S., Leung, T. K., and Shi, J. 2001. Contour and texture analysis for image segmentation. International Journal of Computer Vision 43, 1, 7–27.
24. Meyer, Y. 2001. Oscillating patterns in image processing and nonlinear evolution equations: the fifteenth Dean Jacqueline B. Lewis memorial lectures, vol. 22. American Mathematical Society.
25. Paris, S., and Durand, F. 2006. A fast approximation of the bilateral filter using a signal processing approach. In ECCV (4), 568–580.
26. Paris, S., Hasinoff, S. W., and Kautz, J. 2011. Local laplacian filters: Edge-aware image processing with a laplacian pyramid. ACM Trans. Graph. 30, 4, 68.
27. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. Graph. 22, 3, 313–318.
28. Rudin, L., Osher, S., and Fatemi, E. 1992. Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena 60, 1–4, 259–268.
29. Subr, K., Soler, C., and Durand, F. 2009. Edge-preserving multiscale image decomposition based on local extrema. ACM Trans. Graph. 28, 5.
30. Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. ACM Trans. Graph. 25, 3, 1135–1143.
31. Tuceryan, M. 1994. Moment-based texture segmentation. Pattern Recognition Letters 15, 7, 659–668.
32. Vector Magic, Inc., 2010. Vector magic. http://vectormagic.com.
33. Watson, G. S. 1983. Statistics on spheres. John Wiley and Sons.
34. Wei, L.-Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In SIGGRAPH, 479–488.
35. Wei, L., Lefebvre, S., Kwatra, V., Turk, G., et al. 2009. State of the art in example-based texture synthesis. In Eurographics’ 09 State of the Art Report.
36. Xu, L., Lu, C., Xu, Y., and Jia, J. 2011. Image smoothing via l0 gradient minimization. ACM Trans. Graph. 30, 6.
37. Yin, W., Goldfarb, D., and Osher, S. 2005. Image cartoon-texture decomposition and feature selection using the total variation regularized 11 functional. In VLSM, 73–84.
