“SkyFinder: attribute-based sky image search” by Tao, Yuan and Sun

  • ©Litian Tao, Lu Yuan, and Jian Sun




    SkyFinder: attribute-based sky image search



    In this paper, we present SkyFinder, an interactive search system of over a half million sky images downloaded from the Internet. Using a set of automatically extracted, semantic sky attributes (category, layout, richness, horizon, etc.), the user can find a desired sky image, such as “a landscape with rich clouds at sunset” or “a whole blue sky with white clouds”. The system is fully automatic and scalable. It computes all sky attributes offline, then provides an interactive online search engine. Moreover, we build a sky graph based on the sky attributes, so that the user can smoothly explore and find a path within the space of skies. We also show how our system can be used for controllable sky replacement.


    1. Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P., and Nayar, S. K. 2008. Face swapping: automatically replacing faces in photographs. ACM Trans. Graph. 27, 3, 1–8. Google ScholarDigital Library
    2. Boykov, Y., and Jolly, M. P. 2001. Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images. ICCVI, 105–112.Google Scholar
    3. Dance, C., Willamowski, J., Fan, L., Bray, C., and Csurka, G. 2004. Visual categorization with bags of keypoint. In ECCV Workshop on Statistical Learning in Computer Vision.Google Scholar
    4. Datta, R., Joshi, D., Li, J., and Wang, J. Z. 2008. Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys 40, 2. Google ScholarDigital Library
    5. Duda, R., H. P. S. D. 2001. Pattern Classification (2nd). Wiley Press. Google ScholarDigital Library
    6. Hays, J., and Efros, A. A. 2007. Scene completion using millions of photographs. ACM Trans. Graph. 26, 3, 4. Google ScholarDigital Library
    7. Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24, 3, 577–584. Google ScholarDigital Library
    8. Jacobs, C. E., Finkelstein, A., and Salesin, D. H. 1995. Fast multiresolution image querying. In SIGGRAPH, 277–286. Google ScholarDigital Library
    9. Johnson, M., Brostow, G., Shotton, J., Arandjelovic, O., Kwatra, V., and Cipolla, R. 2006. Semantic photo synthesis. Computer Graphics Forum.Google Scholar
    10. Kumar, N., Belhumeur, P., and Nayar, S. 2008. Facetracer: A search engine for large collections of images with faces. IV: 340–353. Google ScholarDigital Library
    11. Lalonde, J.-F., and Efros, A. A. 2007. Using color compatibility for assessing image realism. In ICCV.Google Scholar
    12. Lalonde, J.-F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., and Criminisi, A. 2008. Photo clip art. ACM Trans. Graph. 26, 3, 3. Google ScholarDigital Library
    13. Lalonde, J.-F., Srinivasa, Narasimhan, G., and Efros, A. A. 2008. What does the sky tell us about the camera? In ECCV. Google ScholarDigital Library
    14. Li, Y., Sun, J., Tang, C., and Shum, H. 2004. Lazy snapping. Proceedings of ACM SIGGRAPH, 303–308. Google ScholarDigital Library
    15. Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60, 2, 91–110. Google ScholarDigital Library
    16. Matusik, W., Zwicker, M., and Durand, F. 2005. Texture design using a simplicial complex of morphable textures. ACM Trans. Graph. 24, 3, 787–794. Google ScholarDigital Library
    17. Moosmann, F., Triggs, B., and Jurie., F. 2006. Fast discriminative visual codebooks using randomized clustering forests. In NIPS.Google Scholar
    18. Reinhard, E., Ashikhmin, M., Gooch, B., and Shirley, P. 2005. Color transfer between images. IEEE Computer Graphics and Applications 21, 5, 34–41. Google ScholarDigital Library
    19. Rubner, Y., Tomasi, C., and Guibas, L. 1998. A metric for distributions with applications to image databases. ICCV, 59–66. Google ScholarDigital Library
    20. Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: exploring photo collections in 3d. ACM Trans. Graph. 25, 3, 835–846. Google ScholarDigital Library
    21. Snavely, N., Garg, R., Seitz, S. M., and Szeliski, R. 2008. Finding paths through the world’s photos. ACM Trans. Graph. 27, 5, 1–11. Google ScholarDigital Library
    22. Stumpfel, J., Jones, A., Wenger, A., Tchou, C., Hawkins, T., and Debevec, P. 2004. Direct hdr capture of the sun and sky. In AFRIGRAPH. Google ScholarDigital Library
    23. Vapnik, V. 1995. The Nature of Statistical Learning Theory. Springer-Verlag. Google ScholarDigital Library

ACM Digital Library Publication: