“Color harmonization” by Cohen-Or, Sorkine-Hornung, Gal, Leyvand and Xu

  • ©Daniel Cohen-Or, Olga Sorkine-Hornung, Ran Gal, Tommer Leyvand, and Ying-Qing Xu




    Color harmonization



    Harmonic colors are sets of colors that are aesthetically pleasing in terms of human visual perception. In this paper, we present a method that enhances the harmony among the colors of a given photograph or of a general image, while remaining faithful, as much as possible, to the original colors. Given a color image, our method finds the best harmonic scheme for the image colors. It then allows a graceful shifting of hue values so as to fit the harmonic scheme while considering spatial coherence among colors of neighboring pixels using an optimization technique. The results demonstrate that our method is capable of automatically enhancing the color “look-and-feel” of an ordinary image. In particular, we show the results of harmonizing the background image to accommodate the colors of a foreground image, or the foreground with respect to the background, in a cut-and-paste setting. Our color harmonization technique proves to be useful in adjusting the colors of an image composed of several parts taken from different sources.


    1. Boykov, Y., and Jolly, M.-P. 2001. Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images. In Proceedings of ICCV, 105–112.Google Scholar
    2. Color Schemer, 2000. http://www.colorschemer.com/.Google Scholar
    3. Color Wheel Expert, 2000. http://www.abitom.com/.Google Scholar
    4. Goethe, J. v. W. 1971. Goethe’s color theory. Translated by Rupprecht Matthei. New York: Van Nostrand Reinhold Company.Google Scholar
    5. Gooch, A. A., Olsen, S. C., Tumblin, J., and Gooch, B. 2005. Color2Gray: salience-preserving color removal. ACM Trans. Graph. 24, 3, 634–639. Google ScholarDigital Library
    6. Granville, W. C., and Jacobson, E. 1944. Colorimetric specification of the color harmony manual from spectrophotometric measurements. Journal of the Optical Society of America 34, 7, 382–395.Google ScholarCross Ref
    7. Holtzschue, L. 2002. Understanding Color. John Wiley & Sons. Inc., New York.Google Scholar
    8. Ironi, R., Cohen-Or, D., and Lischinski, D. 2005. Colorization by example. In Eurographics Symposium on Rendering, 201–210. Google ScholarDigital Library
    9. Itten, J. 1960. The Art of Color. New York: Van Nostrand Reinhold Company.Google Scholar
    10. Krause, J. 2002. Color Index: Over 1,100 Color Combinations, CMYK and RGB Formulas, for Print and Web Media. F&W Publications, Inc. Google ScholarDigital Library
    11. Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Trans. Graph. 23, 3, 689–694. Google ScholarDigital Library
    12. Matsuda, Y. 1995. Color design. Asakura Shoten. (in Japanese).Google Scholar
    13. Meier, B. J. 1988. ACE: a color expert system for user interface design. In Proceedings of the 1st Annual ACM SIGGRAPH Symposium on User Interface Software, ACM Press, 117–128. Google ScholarDigital Library
    14. Moon, P., and Spencer, D. E. 1944. Geometrical formulation of classical color harmony. Journal of the Optical Society of America 34, 1, 46–60.Google ScholarCross Ref
    15. Morovic, J., and Luo, M. R. 2001. The fundamentals of gamut mapping: A survey. Journal of Imaging Science and Technology 45, 3, 283–290.Google Scholar
    16. Munsell, A. H. 1969. A Grammar of Colors. New York: Van Nostrand Reinhold Company.Google Scholar
    17. Nack, F., Manniesing, A., and Hardman, L. 2003. Colour picking: the pecking order of form and function. In Proceedings of the 11th ACM International Conference on Multimedia, ACM Press, 279–282. Google ScholarDigital Library
    18. Ostwald, W., and Birren, F. 1969. The Color Primer. New York: Van Nostrand Reinhold Company.Google Scholar
    19. Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P. 1992. Numerical Recipes in C: The Art of Scientific Computing. Cambridge University Press, New York, NY, USA. Google ScholarDigital Library
    20. Rasche, K., Geist, R., and Westall, J. 2005. Re-coloring images for gamuts of lower dimension. Computer Graphics Forum 24, 3, 423–432. Google ScholarDigital Library
    21. Reinhard, E., Ashikhmin, M., Gooch, B., and Shirley, P. 2001. Color transfer between images. IEEE Comput. Graph. Appl. 21, 5, 34–41. Google ScholarDigital Library
    22. Tokumaru, M., Muranaka, N., and Imanishi, S. 2002. Color design support system considering color harmony. In Proceedings of the IEEE International Conference on Fuzzy Systems, IEEE Press, 378–383.Google Scholar
    23. Welsh, T., Ashikhmin, M., and Mueller, K. 2002. Transferring color to greyscale images. ACM Trans. Graph. 21, 3, 277–280. Google ScholarDigital Library

ACM Digital Library Publication:

Overview Page: