“Perspective-aware warping for seamless stereoscopic image cloning”
Conference:
Type(s):
Title:
- Perspective-aware warping for seamless stereoscopic image cloning
Session/Category Title: Stereo and Displays
Presenter(s)/Author(s):
Abstract:
This paper presents a novel technique for seamless stereoscopic image cloning, which performs both shape adjustment and color blending such that the stereoscopic composite is seamless in both the perceived depth and color appearance. The core of the proposed method is an iterative disparity adaptation process which alternates between two steps: disparity estimation, which re-estimates the disparities in the gradient domain so that the disparities are continuous across the boundary of the cloned region; and perspective-aware warping, which locally re-adjusts the shape and size of the cloned region according to the estimated disparities. This process guarantees not only depth continuity across the boundary but also models local perspective projection in accordance with the disparities, leading to more natural stereoscopic composites. The proposed method allows for easy cloning of objects with intricate silhouettes and vague boundaries because it does not require precise segmentation of the objects. Several challenging cases are demonstrated to show that our method generates more compelling results compared to methods with only global shape adjustment.
References:
1. Basha, T., Moses, Y., and Avidan, S. 2011. Geometrically consistent stereo seam carving. In Proc. IEEE ICCV ’11, 1816–1823.
2. Carroll, R., Agarwala, A., and Agrawala, M. 2010. Image warps for artistic perspective manipulation. ACM TOG 29, 4, 127:1–127:9.
3. Chang, C.-H., Liang, C.-K., and Chuang, Y.-Y. 2011. Content-aware display adaptation and interactive editing for stereoscopic images. IEEE TMM 13, 4, 589–601.
4. Chen, T., Cheng, M.-M., Tan, P., Shamir, A., and Hu, S.-M. 2009. Sketch2Photo: internet image montage. ACM TOG 28, 5, 124:1–124:10.
5. Ding, M., and Tong, R.-F. 2010. Content-aware copying and pasting in images. The Visual Computer 26, 6–8, 721–729.
6. Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., and Lischinski, D. 2009. Coordinates for instant image cloning. ACM TOG 28, 3, 67:1–67:9.
7. Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. ACM TOG 24, 3, 1134–1141.
8. Jia, J., Sun, J., Tang, C.-K., and Shum, H.-Y. 2006. Drag-and-drop pasting. ACM TOG 25, 3, 631–637.
9. Kim, C., Hornung, A., Heinzle, S., Matusik, W., and Gross, M. 2011. Multi-perspective stereoscopy from light fields. ACM TOG 30, 6, 190:1–190:10.
10. Kim, J., Hoffman, D. M., and Banks, M. S. 2011. The zone of comfort: Predicting visual discomfort with stereo displays. Journal of Vision 11, 8, 1–29.
11. Koppal, S., Zitnick, C. L., Cohen, M., Kang, S. B., Ressler, B., and Colburn, A. 2011. A viewer-centric editor for 3D movies. IEEE CG&A 31, 1, 20–35.
12. Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., and Criminisi, A. 2007. Photo clip art. ACM TOG 26, 3, 3:1–3:10.
13. Lambooij, M. T. M., IJsselsteijn, W. A., and Heynderickx, I. 2007. Visual discomfort in stereoscopic displays: a review. In Proc. SPIE, vol. 6490, 64900I.
14. Lang, M., Hornung, A., Wang, O., Poulakos, S., Smolic, A., and Gross, M. 2010. Nonlinear disparity mapping for stereoscopic 3D. ACM TOG 29, 4, 75:1–75:10.
15. Liu, F., Gleicher, M., Jin, H., and Agarwala, A. 2009. Content-preserving warps for 3D video stabilization. ACM TOG 28, 3, 44:1–44:9.
16. Lo, W.-Y., van Baar, J., Knaus, C., Zwicker, M., and Gross, M. 2010. Stereoscopic 3D copy & paste. ACM TOG 29, 6, 147:1–147:10.
17. Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. IJCV 60, 2, 91–110.
18. Mendiburu, B. 2009. 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen. Focal Press.
19. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM TOG 22, 3, 313–318.
20. Schaefer, S., McPhail, T., and Warren, J. 2006. Image deformation using moving least squares. ACM TOG 25, 3, 533–540.
21. Shamir, A., and Sorkine, O. 2009. Visual media retargeting. In ACM SIGGRAPH Asia ’09 Courses, 11:1–11:13.
22. Smith, B., Zhang, L., and Jin, H. 2009. Stereo matching with nonparametric smoothness priors in feature space. In Proc. IEEE CVPR ’09, 485–492.
23. Wang, J., and Cohen, M. F. 2007. Simultaneous matting and compositing. In Proc. IEEE CVPR ’07, 1–8.
24. Wang, L., Jin, H., Yang, R., and Gong, M. 2008. Stereoscopic inpainting: Joint color and depth completion from stereo images. In Proc. IEEE CVPR ’08.
25. Wang, Y.-S., Tai, C.-L., Sorkine, O., and Lee, T.-Y. 2008. Optimized scale-and-stretch for image resizing. ACM TOG 27, 5, 118:1–118:8.
26. Yang, W., Zheng, J., Cai, J., Rahardja, S., and Chen, C. W. 2009. Natural and seamless image composition with color control. IEEE TIP 18, 11, 2584–2592.
