“Material matting”
Conference:
Type(s):
Title:
- Material matting
Session/Category Title: Material Editing
Presenter(s)/Author(s):
Abstract:
Despite the widespread use of measured real-world materials, intuitive tools for editing measured reflectance datasets are still lacking. We present a solution inspired by natural image matting and texture synthesis to the material matting problem, which allows separating a measured spatially-varying material into simpler foreground and background component materials and a corresponding opacity map. We approach this problem in the context of Bayesian statistics and introduce a new prior on materials that favors those with highly self-similar stochastic structure. We describe a prototype system that iteratively performs these separations based on small sets of user scribbles and demonstrate multiple separations and edits.
References:
1. Arya, S., and Mount, D. M. 1993. Approximate Nearest Neighbor Queries in Fixed Dimensions. In Proceedings of the fourth annual ACM-SIAM Symposium on Discrete algorithms, Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, SODA ’93, 271–280. Google ScholarDigital Library
2. Bai, X., and Sapiro, G. 2009. Geodesic Matting: A Framework for Fast Interactive Image and Video Segmentation and Matting. International Journal of Computer Vision 82, 2, 113–132. Google ScholarDigital Library
3. Barnes, C., Shechtman, E., Finkelstein, A., and Goldman, D. B. 2009. PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing. ACM Transactions on Graphics 28, 3 (July), 24:1–24:11. Google ScholarDigital Library
4. Bishop, C. M. 2006. Pattern Recognition and Machine Learning (Information Science and Statistics). Springer-Verlag New York, Inc., Secaucus, NJ, USA. Google ScholarDigital Library
5. Chang, H., Yang, Q., and Pan, C. 2006. An Iterative Bayesian Approach for Digital Matting. In Proceedings of the 18th International Conference on Pattern Recognition – Volume 02, IEEE Computer Society, Washington, DC, USA, ICPR ’06, 122–125. Google ScholarDigital Library
6. Chuang, Y.-Y., Curless, B., Salesin, D. H., and Szeliski, R. 2001. A Bayesian Approach to Digital Matting. In 2001 Conference on Computer Vision and Pattern Recognition (CVPR 2001), 264–271.Google Scholar
7. Dorsey, J., and Hanrahan, P. M. 1996. Modeling and Rendering of Metallic Patinas. In Proceedings of SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, 387–396. Google ScholarDigital Library
8. Dorsey, J., Edelman, A., Legakis, J., Jensen, H. W., and Pedersen, H. K. 1999. Modeling and Rendering of Weathered Stone. In Proceedings of SIGGRAPH 99, Computer Graphics Proceedings, Annual Conference Series, 225–234. Google ScholarDigital Library
9. Dorsey, J., Rushmeier, H., and Sillion, F. 2007. Digital Modeling of Material Appearance. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. Google ScholarDigital Library
10. Efros, A. A., and Leung, T. K. 1999. Texture Synthesis by Non-parametric Sampling. In 1999 International Conference on Computer Vision (ICCV 99), IEEE Computer Society, Washington, DC, USA, 1033–1038. Google ScholarDigital Library
11. Geman, S., and Geman, D. 1984. Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6, 6, 721–741.Google ScholarDigital Library
12. Goldman, D. B., Curless, B., Hertzmann, A., and Seitz, S. M. 2005. Shape and Spatially-Varying BRDFs from Photometric Stereo. In Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV’05) Volume 1, IEEE Computer Society, Washington, DC, USA, 341–348. Google ScholarDigital Library
13. Guan, Y., Chen, W., Liang, X., Ding, Z., and Peng, Q. 2006. Easy Matting – A Stroke Based Approach for Continuous Image Matting. Computer Graphics Forum 25, 3 (Sept.), 567–576.Google Scholar
14. Kautz, J., Boulos, S., and Durand, F. 2007. Interactive Editing and Modeling of Bidirectional Texture Functions. ACM Transactions on Graphics 26, 3 (July), 53:1–53:10. Google ScholarDigital Library
15. Lawrence, J., Ben-Artzi, A., DeCoro, C., Matusik, W., Pfister, H., Ramamoorthi, R., and Rusinkiewicz, S. 2006. Inverse Shade Trees for Non-Parametric Material Representation and Editing. ACM Transactions on Graphics 25, 3 (July), 735–745. Google ScholarDigital Library
16. Lefebvre, S., and Hoppe, H. 2005. Parallel Controllable Texture Synthesis. ACM Transactions on Graphics 24, 3 (Aug.), 777–786. Google ScholarDigital Library
17. Levin, A., Lischinski, D., and Weiss, Y. 2006. A Closed-Form Solution to Natural Image Matting. In 2006 Conference on Computer Vision and Pattern Recognition (CVPR 2006), 61–68. Google ScholarDigital Library
18. Levin, A., Rav-Acha, A., and Lischinski, D. 2008. Spectral Matting. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 10, 1699–1712. Google ScholarDigital Library
19. McAllister, D. K. 2002. A Generalized Surface Appearance Representation for Computer Graphics. PhD thesis. AAI3061704. Google ScholarDigital Library
20. Menzel, N., and Guthe, M. 2009. g-BRDFs: An Intuitive and Editable BTF Representation. Computer Graphics Forum 28, 8 (Dec.), 2189–2200.Google ScholarCross Ref
21. Nicodemus, F. E., Richmond, J. C., Hsia, J. J., Ginsberg, I. W., and Limperis, T. 1977. Geometrical Considerations and Nomenclature for Reflectance. Science And Technology 160, October, 1–52.Google Scholar
22. Pellacini, F., and Lawrence, J. 2007. AppWand: Editing Measured Materials using Appearance-Driven Optimization. ACM Transactions on Graphics 26, 3 (July), 54:1–54:9. Google ScholarDigital Library
23. Rhemann, C., Rother, C., and Gelautz, M. 2008. Improving Color Modeling for Alpha Matting. In 2008 British Machine Vision Conference (BMVC 2008), British Machine Vision Association, M. Everingham, C. J. Needham, and R. Fraile, Eds.Google Scholar
24. Rosenberger, A., Cohen-Or, D., and Lischinski, D. 2009. Layered Shape Synthesis: Automatic Generation of Control Maps for Non-Stationary Textures. ACM Transactions on Graphics 28, 5 (Dec.), 107:1–107:9. Google ScholarDigital Library
25. Simakov, D., Caspi, Y., Shechtman, E., and Irani, M. 2008. Summarizing Visual Data Using Bidirectional Similarity. In 2008 Conference on Computer Vision and Pattern Recognition (CVPR 2008), 1–8.Google Scholar
26. Wang, J., Tong, X., Lin, S., Pan, M., Wang, C., Bao, H., Guo, B., and Shum, H.-Y. 2006. Appearance Manifolds for Modeling Time-Variant Appearance of Materials. ACM Transactions on Graphics 25, 3 (July), 754–761. Google ScholarDigital Library
27. Wei, L.-Y., Han, J., Zhou, K., Bao, H., Guo, B., and Shum, H.-Y. 2008. Inverse Texture Synthesis. ACM Transactions on Graphics 27, 3 (Aug.), 52:1–52:9. Google ScholarDigital Library
28. Wexler, Y., Shechtman, E., and Irani, M. 2007. SpaceTime Completion of Video. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 3, 463–476. Google ScholarDigital Library
29. Xue, S., Wang, J., Tong, X., Dai, Q., and Guo, B. 2008. Image-based Material Weathering. Computer Graphics Forum 27, 2 (Apr.), 617–626.Google Scholar
30. Zalesny, A., Ferrari, V., Caenen, G., and Gool, L. V. Composite Texture Synthesis. International Journal of Computer Vision 62, 1. Google ScholarDigital Library
31. Zheng, Y., Kambhamettu, C., Yu, J., and Bauer, T. 2008. FuzzyMatte: A Computationally Efficient Scheme for Interactive Matting. In 2008 Conference on Computer Vision and Pattern Recognition (CVPR 2008), 1–8.Google Scholar
