“Manifold preserving edit propagation” by Chen, Zou, Zhao and Tan
Conference:
Type(s):
Title:
- Manifold preserving edit propagation
Session/Category Title: Operating on Images
Presenter(s)/Author(s):
Abstract:
We propose a novel edit propagation algorithm for interactive image and video manipulations. Our approach uses the locally linear embedding (LLE) to represent each pixel as a linear combination of its neighbors in a feature space. While previous methods require similar pixels to have similar results, we seek to maintain the manifold structure formed by all pixels in the feature space. Specifically, we require each pixel to be the same linear combination of its neighbors in the result. Compared with previous methods, our proposed algorithm is more robust to color blending in the input data. Furthermore, since every pixel is only related to a few nearest neighbors, our algorithm easily achieves good runtime efficiency. We demonstrate our manifold preserving edit propagation on various applications.
References:
1. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., and Süsstrunk, S. 2010. SLIC Superpixels. Tech. Rep. no. 149300, EPFL.
2. An, X., and Pellacini, F. 2008. Appprop: all-pairs appearance-space edit propagation. In ACM Trans. Graph. (Proc. of Siggraph), vol. 27.
3. Chang, Y., Saito, S., and Nakajima, M. 2003. A framework for transfer colors based on the basic color categories. In Proc. of Computer Graphics International, 176–183.
4. Chen, J., Paris, S., and Durand, F. 2007. Real-time edge-aware image processing with the bilateral grid. ACM Trans. Graph. (Proc. of Siggraph) 26, 3.
5. Chia, A. Y.-S., Zhuo, S., Gupta, R. K., Tai, Y.-W., Cho, S.-Y., Tan, P., and Lin, S. 2011. Semantic colorization with internet images. ACM Trans. Graph. (Proc. of Siggraph Asia) 30, 6.
6. Coifman, R., and Lafon, S. 2006. Diffusion maps. Appl. Comput. Harmon. A. 21, 1, 5–30.
7. de Ridder, D., and Duin, R. P. 2002. Locally linear embedding for classification. Tech. Rep. PH-2002-01.
8. Farbman, Z., Fattal, R., and Lischinski, D. 2010. Diffusion maps for edge-aware image editing. ACM Trans. Graph. (Proc. of Siggraph Asia) 29, 6.
9. Fattal, R. 2009. Edge-avoiding wavelets and their applications. ACM Trans. Graph. 28, 3.
10. He, K., Sun, J., and Tang, X. 2010. Guided image filtering. In Proc. of ECCV, 1–14.
11. Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Trans. Graph. (Proc. of Siggraph) 23, 3.
12. Levin, A., Rav-Acha, A., and Lischinski, D. 2008. Spectral matting. IEEE Trans. Pattern Anal. Mach. Intell. 30, 10, 1699–1712.
13. Li, Y., Adelson, E. H., and Agarwala, A. 2008. Scribble-boost: Adding classification to edge-aware interpolation of local image and video adjustments. Comput. Graph. Forum 27, 2, 1255–1264.
14. Li, Y., Ju, T., and Hu, S.-M. 2010. Instant propagation of sparse edits on images and videos. Comput. Graph. Forum 29, 7, 2049–2054.
15. Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. Graph. (Proc. of Siggraph) 25, 3.
16. Liu, C., Freeman, W. T., Adelson, E. H., and Weiss, Y. 2008. Human-assisted motion annotation. In Proc. of CVPR.
17. Ma, L.-Q., and Xu, K. 2011. Antialiasing recovery for edit propagation. In Proc. of Virtual Reality Continuum and Its Applications in Industry (VRCAI), 125–130.
18. Ou, L., Luo, M., Woodcock, A., and Wright, A. 2004. A study of colour emotion and colour preference. part i: Colour emotions for single colours. In Proc. of Color Res. Appl., 232–240.
19. Paris, S., and Durand, F. 2009. A fast approximation of the bilateral filter using a signal processing approach. Int. J. Comput. Vision 81, 1, 24–52.
20. Pellacini, F., and Lawrence, J. 2007. Appwand: editing measured materials using appearance-driven optimization. ACM Trans. Graph. (Proc. of Siggraph) 26, 3.
21. Rhemann, C., Rother, C., Wang, J., Gelautz, M., Kohli, P., and Rott, P. 2009. A perceptually motivated online benchmark for image matting. In Proc. of CVPR, 1826–1833.
22. Roweis, S., and Saul, L. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326.
23. Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proc. of ICCV, 839.
24. Wang, B., Yu, Y., Wong, T.-T., Chen, C., and Xu, Y.-Q. 2010. Data-driven image color theme enhancement. ACM Trans. Graph. (Proc. Siggraph Asia) 29, 6 (December), 146:1–146:10.
25. Xu, K., Li, Y., Ju, T., Hu, S.-M., and Liu, T.-Q. 2009. Efficient affinity-based edit propagation using k-d tree. ACM Trans. Graph. (Proc. of Siggraph) 28, 5.
26. Yang, L., Sander, P. V., Lawrence, J., and Hoppe, H. 2011. Antialiasing recovery. ACM Trans. Graph. 30, 3.
