“”Mind the gap”: tele-registration for structure-driven image completion” by Huang, Yin, Gong, Lischinski, Cohen-Or, et al. …
Conference:
Type(s):
Title:
- "Mind the gap": tele-registration for structure-driven image completion
Session/Category Title: Image Ops
Presenter(s)/Author(s):
Abstract:
Concocting a plausible composition from several non-overlapping image pieces, whose relative positions are not fixed in advance and without having the benefit of priors, can be a daunting task. Here we propose such a method, starting with a set of sloppily pasted image pieces with gaps between them. We first extract salient curves that approach the gaps from non-tangential directions, and use likely correspondences between pairs of such curves to guide a novel tele-registration method that simultaneously aligns all the pieces together. A structure-driven image completion technique is then proposed to fill the gaps, allowing the subsequent employment of standard in-painting tools to finish the job.
References:
1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Trans. on Graph (Proc. of SIGGRAPH) 23, 3, 294–302.
2. Barnes, C., Shechtman, E., Finkelstein, A., and Goldman, D. B. 2009. Patchmatch: a randomized correspondence algorithm for structural image editing. ACM Trans. on Graph (Proc. of SIGGRAPH) 28, 3, 24:1–24:11.
3. Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. 2000. Image inpainting. Proc. of SIGGRAPH, 417–424.
4. Borji, A., and Itti, L. 2013. State-of-the-art in visual attention modeling. IEEE Trans. Pat. Ana. & Mach. Int. 35, 1, 185–207.
5. Brown, M., and Lowe, D. G. 2007. Automatic panoramic image stitching using invariant features. Int. J. Comp. Vis. 74, 1, 59–73.
6. Chan, T., and Shen, J. 2005. Image Processing and Analysis: Variational, PDE, Wavelet and Stochastic Methods. SIAM.
7. Darabi, S., Shechtman, E., Barnes, C., Goldman, D. B., and Sen, P. 2012. Image melding: Combining inconsistent images using patch-based synthesis. ACM Trans. on Graph (Proc. of SIGGRAPH) 31, 4, 82:1–82:10.
8. Drori, I., Cohen-Or, D., and Yeshurun, H. 2003. Fragment-based image completion. ACM Trans. on Graph (Proc. of SIGGRAPH) 22, 3, 303–312.
9. Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. Proc. of SIGGRAPH, 341–346.
10. Efros, A., and Leung, T. 1999. Texture synthesis by nonparametric sampling. In Proc. IEEE Conf. on Comp. Vis. and Pat. Rec., 1033–1038.
11. Farbman, Z., Fattal, R., Lischinski, D., and Szeliski, R. 2008. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. on Graph (Proc. of SIGGRAPH) 27, 3, 67:1–67:10.
12. Huang, Q.-X., Flöry, S., Gelfand, N., Hofer, M., and Pottmann, H. 2006. Reassembling fractured objects by geometric matching. ACM Trans. on Graph (Proc. of SIGGRAPH) 25, 3, 569–578.
13. Huang, H., Gong, M., Cohen-Or, D., Ouyang, Y., Tan, F., and Zhang, H. 2012. Field-guided registration for feature-conforming shape composition. ACM Trans. on Graph (Proc. of SIGGRAPH Asia) 31, 6, 171:1–171:11.
14. Jia, J., and Tang, C.-K. 2008. Image stitching using structure deformation. IEEE Trans. Pat. Ana. & Mach. Int. 30, 4, 617–631.
15. Kaneva, B., Sivic, J., Torralba, A., Avidan, S., and Freeman, W. T. 2010. Infinite images: Creating and exploring a large photorealistic virtual space. In Proc. the IEEE, vol. 98, 1391–1407.
16. Kimia, B. B., Frankel, I., and Popescu, A.-M. 2003. Euler spiral for shape completion. Int. J. Comp. Vis. 54, 1–3, 157–180.
17. Kopf, J., Kienzle, W., Drucker, S., and Kang, S. B. 2012. Quality prediction for image completion. ACM Trans. on Graph (Proc. of SIGGRAPH Asia) 31, 6, 131:1–131:8.
18. Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. ACM Trans. on Graph (Proc. of SIGGRAPH) 24, 3, 795–802.
19. Leitao, H. C. G., and Stolfi, J. 2002. A multiscale method for the reassembly of two-dimensional fragmented objects. IEEE Trans. Pat. Ana. & Mach. Int. 24, 9, 1239–1251.
20. Nocedal, J., and Wright, S. J. 2006. Numerical Optimization (2nd ed.). New York: Springer-Verlag.
21. Papaodysseus, C., Panagopoulos, T., Exarhos, M., Triantafillou, C., Fragoulis, D., and Doumas, C. 2002. Contour-shape based reconstruction of fragmented, 1600 b.c. wall paintings. IEEE Trans. on Signal Processing 50, 6, 1277–1288.
22. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. on Graph (Proc. of SIGGRAPH) 22, 3, 313–318.
23. Poleg, Y., and Peleg, S. 2012. Alignment and mosaicing of non-overlapping images. In Proc. IEEE Int. Conf. on Computational Photography, 1–8.
24. Pritch, Y., Poleg, Y., and Peleg, S. 2011. Snap image composition. In Proc. the 5th int. conf. on Computer vision/computer graphics collaboration techniques, 181–191.
25. Schaefer, S., McPhail, T., and Warren, J. 2006. Image deformation using moving least squares. ACM Trans. on Graph (Proc. of SIGGRAPH) 25, 3, 533–540.
26. Sun, J., Yuan, L., Jia, J., and Shum, H.-Y. 2005. Image completion with structure propagation. ACM Trans. on Graph (Proc. of SIGGRAPH) 24, 3, 861–868.
27. Wei, L.-Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. Proc. of SIGGRAPH, 479–488.
28. Wexler, Y., Shechtman, E., and Irani, M. 2007. Spacetime video completion. IEEE Trans. Pat. Ana. & Mach. Int. 29, 3, 463–476.
29. Xu, K., Cohen-Or, D., Ju, T., Liu, L., Zhang, H., Zhou, S., and Xiong, Y. 2009. Feature-aligned shape texturing. ACM Trans. on Graph (Proc. of SIGGRAPH Asia) 28, 5, 108:1–108:7.
30. Zelnik-Manor, L., and Perona, P. 2007. Automating joiners. In Proc. Int. symp. on Non-photorealistic animation and rendering, 121–131.
31. Zhou, H., Zheng, J., and Yang, X. 2012. Euler arc splines for curve completion. Computers & Graphics 36, 6, 642–650.
