“Efficient palette-based decomposition and recoloring of images via RGBXY-space geometry”
Conference:
Type(s):
Title:
- Efficient palette-based decomposition and recoloring of images via RGBXY-space geometry
Session/Category Title: Low-level imaging
Presenter(s)/Author(s):
Moderator(s):
Abstract:
We introduce an extremely scalable and efficient yet simple palette-based image decomposition algorithm. Given an RGB image and set of palette colors, our algorithm decomposes the image into a set of additive mixing layers, each of which corresponds to a palette color applied with varying weight. Our approach is based on the geometry of images in RGBXY-space. This new geometric approach is orders of magnitude more efficient than previous work and requires no numerical optimization. We provide an implementation of the algorithm in 48 lines of Python code. We demonstrate a real-time layer decomposition tool in which users can interactively edit the palette to adjust the layers. After preprocessing, our algorithm can decompose 6 MP images into layers in 20 milliseconds.
References:
1. Elad Aharoni-Mack, Yakov Shambik, and Dani Lischinski. 2017. Pigment-Based Recoloring of Watercolor Paintings. In NPAR. Google ScholarDigital Library
2. Yağiz Aksoy, Tunç Ozan Aydin, Aljoša Smolić, and Marc Pollefeys. 2017. Unmixing-based soft color segmentation for image manipulation. ACM Transactions on Graphics (TOG) 36, 2 (2017), 19. Google ScholarDigital Library
3. C. Bradford Barber, David P. Dobkin, and Hannu Huhdanpaa. 1996. The Quickhull Algorithm for Convex Hulls. ACM Trans. Math. Softw. 22, 4 (Dec. 1996), 469–483. Google ScholarDigital Library
4. Vladimir Bychkovsky, Sylvain Paris, Eric Chan, and Frédo Durand. 2011. Learning Photographic Global Tonal Adjustment with a Database of Input / Output Image Pairs. In Computer Vision and Pattern Recognition (CVPR). Google ScholarDigital Library
5. Huiwen Chang, Ohad Fried, Yiming Liu, Stephen DiVerdi, and Adam Finkelstein. 2015. Palette-based Photo Recoloring. ACM Trans. Graph. 34, 4 (July 2015). Google ScholarDigital Library
6. Daniel Cohen-Or, Olga Sorkine, Ran Gal, Tommer Leyvand, and Ying-Qing Xu. 2006. Color Harmonization. In ACM SIGGRAPH 2006 Papers (SIGGRAPH ’06). ACM, New York, NY, USA, 624–630. Google ScholarDigital Library
7. Maurice D Craig. 1994. Minimum-volume transforms for remotely sensed data. IEEE Transactions on Geoscience and Remote Sensing 32, 3 (May 1994), 542–552.Google ScholarCross Ref
8. Michael S Floater. 2015. Generalized barycentric coordinates and applications. Acta Numerica 24 (2015), 161–214.Google ScholarCross Ref
9. Michael Garland and Paul S. Heckbert. 1997. Surface Simplification Using Quadric Error Metrics. 209–216. Google ScholarDigital Library
10. Anat Levin, Alex Rav-Acha, and Dani Lischinski. 2008. Spectral matting. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 10 (2008), 1699–1712. Google ScholarDigital Library
11. Sharon Lin, Matthew Fisher, Angela Dai, and Pat Hanrahan. 2017a. LayerBuilder: Layer Decomposition for Interactive Image and Video Color Editing. arXiv preprint arXiv:1701.03754 (2017).Google Scholar
12. Sharon Lin, Matthew Fisher, Angela Dai, and Pat Hanrahan. 2017b. LayerBuilder: Layer Decomposition for Interactive Image and Video Color Editing. CoRR abs/1701.03754 (2017). arXiv:1701.03754 http://arxiv.org/abs/1701.03754Google Scholar
13. Sharon Lin and Pat Hanrahan. 2013. Modeling how people extract color themes from images. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3101–3110. Google ScholarDigital Library
14. Bryan S Morse, Daniel Thornton, Qing Xia, and John Uibel. 2007. Image-based color schemes. In Image Processing, 2007. ICIP 2007. IEEE International Conference on, Vol. 3. IEEE, III–497.Google ScholarCross Ref
15. R.M.H. Nguyen, B. Price, S. Cohen, and M. S. Brown. 2017. Group-Theme Recoloring for Multi-Image Color Consistency. Computer Graphics Forum 36, 7 (2017), 83–92.Google ScholarCross Ref
16. Peter O’Donovan, Aseem Agarwala, and Aaron Hertzmann. 2011. Color compatibility from large datasets. ACM Transactions on Graphics (TOG) 30, 4 (2011), 63. Google ScholarDigital Library
17. Huy Phan, Hongbo Fu, and Antoni Chan. 2017. Color Orchestra: Ordering Color Palettes for Interpolation and Prediction. IEEE Transactions on Visualization and Computer Graphics (2017).Google Scholar
18. Thomas Porter and Tom Duff. 1984. Compositing Digital Images. ACM SIGGRAPH Computer Graphics 18, 3 (1984), 253–259. Google ScholarDigital Library
19. Pedro V. Sander, Xianfeng Gu, Steven J. Gortler, Hugues Hoppe, and John Snyder. 2000. Silhouette Clipping. In Proceedings of ACM SIGGRAPH. 327–334. Google ScholarDigital Library
20. Jianchao Tan, Stephen DiVerdi, Jingwan Lu, and Yotam Gingold. 2017. Pigmento: Pigment-Based Image Analysis and Editing. arXiv preprint arXiv:1707.08323 (2017).Google Scholar
21. Jianchao Tan, Jyh-Ming Lien, and Yotam Gingold. 2016. Decomposing Images into Layers via RGB-space Geometry. ACM Trans. Graph. 36, 1, Article 7 (Nov. 2016), 14 pages. Google ScholarDigital Library
22. Yi-Jun Yang, Jun-Hai Yong, and Jia-Guang Sun. 2005. An algorithm for tetrahedral mesh generation based on conforming constrained Delaunay tetrahedralization. Computers & Graphics 29, 4 (2005), 606–615. Google ScholarDigital Library
23. Qing Zhang, Chunxia Xiao, Hanqiu Sun, and Feng Tang. 2017. Palette-Based Image Recoloring Using Color Decomposition Optimization. IEEE Transactions on Image Processing 26, 4 (2017), 1952–1964. Google ScholarDigital Library
