“Material memex: automatic material suggestions for 3D objects” by Jain, Thormählen, Ritschel and Seidel
Conference:
Type(s):
Title:
- Material memex: automatic material suggestions for 3D objects
Session/Category Title: Materials and Images
Presenter(s)/Author(s):
Abstract:
The material found on 3D objects and their parts in our everyday surroundings is highly correlated with the geometric shape of the parts and their relation to other parts of the same object. This work proposes to model this context-dependent correlation by learning it from a database containing several hundreds of objects and their materials. Given a part-based 3D object without materials, the learned model can be used to fully automatically assign plausible material parameters, including diffuse color, specularity, gloss, and transparency. Further, we propose a user interface that provides material suggestions. This user-interface can be used, for example, to refine the automatic suggestion. Once a refinement has been made, the model incorporates this information, and the automatic assignment is incrementally improved. Results are given for objects with different numbers of parts and with different topological complexity. A user study validates that our method significantly simplifies and accelerates the material assignment task compared to other approaches.
References:
1. Bush, V. 1945. As we may think. Atlantic Monthly 176, 101–108.
2. Chajdas, M. G., Lefebvre, S., and Stamminger, M. 2010. Assisted texture assignment. In Proc. I3D, 173–179.
3. Chaudhuri, S., Kalogerakis, E., Guibas, L., and Koltun, V. 2011. Probabilistic reasoning for assembly-based 3D modeling. ACM Trans. Graph. (Proc. SIGGRAPH) 30.
4. Chen, D.-Y., Tian, X.-P., Shen, Y.-T., and Ouhyoung, M. 2003. On visual similarity based 3D model retrieval. Comput. Graph. Forum (Proc. Eurographics) 22, 223–232.
5. Fisher, M., and Hanrahan, P. 2010. Context-based search for 3D models. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 29, 182:1–182:10.
6. Fisher, M., Savva, M., and Hanrahan, P. 2011. Characterizing structural relationships in scenes using graph kernels. ACM Trans. Graph (Proc. SIGGRAPH) 30, 34:1–34:12.
7. Kalogerakis, E., Hertzmann, A., and Singh, K. 2010. Learning 3D mesh segmentation and labeling. ACM Trans. Graph. (Proc. SIGGRAPH) 29, 102:1–102:12.
8. Kautz, J., Boulos, S., and Durand, F. 2007. Interactive editing and modeling of bidirectional texture functions. ACM Trans. Graph. (Proc. SIGGRAPH) 26.
9. Kerr, W. B., and Pellacini, F. 2010. Toward evaluating material design interface paradigms for novice users. ACM Trans. Graph. 29, 35:1–35:10.
10. Kschischang, F. R., Frey, B. J., and Loeliger, H.-A. 1998. Factor graphs and the sum-product algorithm. IEEE Trans. Information Theory 47, 498–519.
11. Lee, Y. J., Zitnick, C. L., and Cohen, M. F. 2011. Shadowdraw: real-time user guidance for freehand drawing. ACM Trans. Graph. (Proc. SIGGRAPH), 27:1–27:10.
12. Lefebvre, S., Hornus, S., and Lasram, A. 2010. By-example synthesis of architectural textures. ACM Trans. Graph. 29, 84:1–84:8.
13. Lu, J., Georghiades, A. S., Glaser, A., Wu, H., Wei, L.-Y., Guo, B., Dorsey, J., and Rushmeier, H. 2007. Context-aware textures. ACM Trans. Graph. 26.
14. Malisiewicz, T., and Efros, A. A. 2009. Beyond categories: The visual memex model for reasoning about object relationships. In Proc. Neural Information Processing Systems.
15. Mertens, T., Kautz, J., Chen, J., Bekaert, P., and Durand, F. 2006. Texture transfer using geometry correlation. In Proc. EGSR, 273–284.
16. Ngan, A., Durand, F., and Matusik, W. 2006. Image-driven navigation of analytical BRDF models. In Proc. EGSR, 399–407.
17. Pellacini, F., and Lawrence, J. 2007. AppWand: Editing measured materials using appearance-driven optimization. ACM Trans. Graph. (Proc. SIGGRAPH) 26.
18. Pellacini, F., Ferwerda, J. A., and Greenberg, D. P. 2000. Toward a psychophysically-based light reflection model for image synthesis. In Proc. SIGGRAPH, 55–64.
19. Phong, B.-T. 1975. Illumination for computer generated pictures. Communications of the ACM 18, 6, 311–317.
20. Torralba, A. 2003. Contextual priming for object detection. Int. J. Comput. Vision 53, 169–191.
21. Wang, B., Yu, Y., Wong, T.-T., Chen, C., and Xu, Y.-Q. 2010. Data-driven image color theme enhancement. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 29, 146:1–146:10.
22. Yu, L.-F., Yeung, S. K., Tang, C.-K., Terzopoulos, D., Chan, T. F., and Osher, S. 2011. Make it home: Automatic optimization of furniture arrangement. ACM Trans. Graph. (Proc. SIGGRAPH) 30, 86.
