“Drag-and-drop pasting” by Jia, Sun, Tang and Shum

  • ©Jiaya Jia, Jian Sun, Chi-Keung Tang, and Heung-Yeung Shum

Conference:


Type:


Title:

    Drag-and-drop pasting

Presenter(s)/Author(s):



Abstract:


    In this paper, we present a user-friendly system for seamless image composition, which we call drag-and-drop pasting. We observe that for Poisson image editing [Perez et al. 2003] to work well, the user must carefully draw a boundary on the source image to indicate the region of interest, such that salient structures in source and target images do not conflict with each other along the boundary. To make Poisson image editing more practical and easy to use, we propose a new objective function to compute an optimized boundary condition. A shortest closed-path algorithm is designed to search for the location of the boundary. Moreover, to faithfully preserve the object’s fractional boundary, we construct a blended guidance field to incorporate the object’s alpha matte. To use our system, the user needs only to simply outline a region of interest in the source image, and then drag and drop it onto the target image. Experimental results demonstrate the effectiveness of our “drag-and-drop pasting” system.

References:


    1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. Proceedings of ACM SIGGRAPH 23, 3, 294–302. Google ScholarDigital Library
    2. Berman, A., Vlahos, P., and Dadourian, A. 2000. Comprehensive method for removing from an image the background surrounding a selected object. U.S. Patent 6,134,345.Google Scholar
    3. Boykov, Y., and Jolly, M. P. 2001. Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images. In Proceedings of ICCV.Google Scholar
    4. Burt, P. J., and Adelson, E. H. 1983. A multiresolution spline with application to image mosaics. In ACM Transactions on Graphics, vol. 2, 217–236. Google ScholarDigital Library
    5. Chuang, Y., Curless, B., Salesin, D., and Szeliski, R. 2001. A bayesian approach to digital matting. In Proceedings of CVPR01, vol. 2, 264–271.Google Scholar
    6. Dijkstra, E. W. 1959. A note on two problems in connexion with graphs. Numerische Mathematik 1, 269–270.Google ScholarDigital Library
    7. Jia, J., and Tang, C.-K. 2005. Eliminating structure and intensity misalignment in image stitching. In Proceedings of ICCV. Google ScholarDigital Library
    8. Kwatra, V., Schodl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graph-cut textures: image and video synthesis using graph cuts. Proceedings of ACM SIGGRAPH 22, 3, 277–286. Google ScholarDigital Library
    9. Levin, A., Zomet, A., Peleg, S., and Weiss, Y. 2004. Seamless image stitching in the gradient domain. In Proceedings of ECCV, Vol IV: 377–389.Google Scholar
    10. Li, Y., Sun, J., Tang, C., and Shum, H. 2004. Lazy snapping. Proceedings of ACM SIGGRAPH, 303–308. Google ScholarDigital Library
    11. McGuire, M., Matusik, W., Pfister, H., Hughes, J. F., and Durand, F. 2005. Defocus video matting. In Proceedings of ACM SIGGRAPH, vol. 24, 567–576. Google ScholarDigital Library
    12. Mortensen, E. N., and Barrett, W. A. 1995. Intelligent scissors for image composition. Proceedings of ACM SIGGRAPH, 191–198. Google ScholarDigital Library
    13. Perez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. Proceedings of ACM SIGGRAPH, 313–318. Google ScholarDigital Library
    14. Rother, C., Kolmogorov, V., and Blake, A. 2004. “grabcut” – interactive foreground extraction using iterated graph cuts. Proceedings of ACM SIGGRAPH, 309–314. Google ScholarDigital Library
    15. Ruzon, M., and Tomasi, C. 2000. alpha estimation in natural images. In Proceedings of CVPR00, 18–25.Google Scholar
    16. Shum, H.-Y., Sun, J., Yamazaki, S., Li, Y., and Tang, C.-K. 2004. Popup light field: An interactive image-based modeling and rendering system. ACM Trans. Graph. 23, 2, 143–162. Google ScholarDigital Library
    17. Smith, A., and Blinn, J. 1996. Blue screen matting. Proceedings of ACM SIGGRAPH, 259–268. Google ScholarDigital Library
    18. Sun, J., Jia, J., Tang, C., and Shum, H. 2004. Poisson matting. Proceedings of ACM SIGGRAPH, 315–321. Google ScholarDigital Library
    19. Zwillinger, D. 1997. Handbook of Differential Equations, 3rd ed. Boston, MA: Academic Press.Google Scholar


ACM Digital Library Publication: