“Sketch2Photo: internet image montage”
Conference:
Type(s):
Title:
- Sketch2Photo: internet image montage
Session/Category Title: Resizing/montage
Presenter(s)/Author(s):
Moderator(s):
Abstract:
We present a system that composes a realistic picture from a simple freehand sketch annotated with text labels. The composed picture is generated by seamlessly stitching several photographs in agreement with the sketch and text labels; these are found by searching the Internet. Although online image search generates many inappropriate results, our system is able to automatically select suitable photographs to generate a high quality composition, using a filtering scheme to exclude undesirable images. We also provide a novel image blending algorithm to allow seamless image composition. Each blending result is given a numeric score, allowing us to find an optimal combination of discovered images. Experimental results show the method is very successful; we also evaluate our system using the results from two user studies.
References:
1. Belongie, S., Malik, J., and Puzicha, J. 2002. Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24, 4, 509–522. Google ScholarDigital Library
2. Ben-Haim, N., Babenko, B., and Belongie, S. 2006. Improvingweb-based image search via content based clustering. In Proc. of CVPR Workshop. Google ScholarDigital Library
3. Diakopoulos, N., Essa, I., and Jain, R. 2004. Content based image synthesis. In Proc. of International Conference on Image and Video Retrieval (CIVR).Google Scholar
4. Eitz, M., Hildebrand, K., Boubekeur, T., and Alexa, M. 2009. Photosketch: A sketch based image query and compositing system. In SIGGRAPH 2009 Talk Program. Google ScholarDigital Library
5. Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., and Lischinski, D. 2009. Coordinates for instant image cloning. ACM Transactions on Graphics 28, 3 (Aug.), 67. Google ScholarDigital Library
6. Felzenszwalb, P. F., and Huttenlocher, D. P. 2004. Efficient graph-based image segmentation. Int. J. of Comput. Vision 59, 2, 167–181. Google ScholarDigital Library
7. Fergus, R., Fei-Fei, L., Perona, P., and Zisserman, A. 2005. Learning object categories from google’s image search. In Proc. of ICCV. Google ScholarDigital Library
8. Georgescu, B., Shimshoni, I., and Meer, P. 2003. Mean shift based clustering in high dimensions: A texture classification example. In Proc. of ICCV. Google ScholarDigital Library
9. Hays, J. H., and Efros, A. A. 2007. Scene completion using millions of photographs. ACM Transactions on Graphics 26, 3 (July), 4. Google ScholarDigital Library
10. Hou, X., and Zhang, L. 2007. Saliency detection: A spectral residual approach. In Proc. of CVPR.Google Scholar
11. Jacobs, C., Finkelstein, A., and Salesin, D. 1995. Fast multiresolution image querying. In SIGGRAPH 1995. Google ScholarDigital Library
12. Jia, J., Sun, J., Tang, C.-K., and Shum, H.-Y. 2006. Drag-and-drop pasting. SIGGRAPH 2006. Google ScholarDigital Library
13. Johnson, M., Brostow, G. J., Shotton, J., Arandjelović, O., Kwatra, V., and Cipolla, R. 2006. Semantic photo synthesis. Proc. of Eurographics.Google Scholar
14. Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., and Criminisi, A. 2007. Photo clip art. ACM Transactions on Graphics 26, 3 (Aug.), 3. Google ScholarDigital Library
15. Levin, A., Lischinski, D., and Weiss, Y. 2008. A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell. 30, 2, 228–242. Google ScholarDigital Library
16. Li, Y., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Lazy snapping. SIGGRAPH 2004. Google ScholarDigital Library
17. Liu, T., Sun, J., Zheng, N.-N., Tang, X., and Shum, H.-Y. 2007. Learning to detect a salient object. In Proc. of CVPR.Google Scholar
18. Manjunath, B. S., and Ma, W. Y. 1996. Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 18, 8, 837–842. Google ScholarDigital Library
19. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. SIGGRAPH 2003. Google ScholarDigital Library
20. Rajendran, R., and Chang, S. 2000. Image retrieval with sketches and compositions. In Proc. of International Conference on Multimedia&Expo (ICME).Google Scholar
21. Rother, C., Kolmogorov, V., and Blake, A. 2004. “grabcut”: interactive foreground extraction using iterated graph cuts. SIGGRAPH2004. Google ScholarDigital Library
22. Saxena, A., Chung, S. H., and Ng, A. Y. 2008. 3-d depth reconstruction from a single still image. Int. J. of Comput. Vision 76, 1, 53–69. Google ScholarDigital Library
23. Smeulders, A., Worring, M., Santini, S., Gupta, A., and Jain, R. 2000. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22, 12, 1349–1380. Google ScholarDigital Library
24. Wang, J., and Cohen, M. 2007. Simultaneous matting and compositing. In Proc. of CVPR, 1–8.Google Scholar
