“Interactive design of probability density functions for shape grammars” by Dang, Lienhard, Ceylan, Neubert, Wonka, et al. …
Conference:
Type(s):
Title:
- Interactive design of probability density functions for shape grammars
Session/Category Title: Modelling and More
Presenter(s)/Author(s):
Abstract:
A shape grammar defines a procedural shape space containing a variety of models of the same class, e.g. buildings, trees, furniture, airplanes, bikes, etc. We present a framework that enables a user to interactively design a probability density function (pdf) over such a shape space and to sample models according to the designed pdf. First, we propose a user interface that enables a user to quickly provide preference scores for selected shapes and suggest sampling strategies to decide which models to present to the user to evaluate. Second, we propose a novel kernel function to encode the similarity between two procedural models. Third, we propose a framework to interpolate user preference scores by combining multiple techniques: function factorization, Gaussian process regression, autorelevance detection, and l1 regularization. Fourth, we modify the original grammars to generate models with a pdf proportional to the user preference scores. Finally, we provide evaluations of our user interface and framework parameters and a comparison to other exploratory modeling techniques using modeling tasks in five example shape spaces: furniture, low-rise buildings, skyscrapers, airplanes, and vegetation.
References:
1. Averkiou, M., Kim, V., Zheng, Y., and Mitra, N. J. 2014. ShapeSynth: Parameterizing Model Collections for Coupled Shape Exploration and Synthesis. Comp. Graph. Forum (Eurographics) 33, 2, 125–134.
2. Bao, F., Yan, D.-M., Mitra, N. J., and Wonka, P. 2013. Generating and Exploring Good Building Layouts. ACM Trans. Graph. (Siggraph) 32, 4, 122.
3. Beneš, B., Št’ava, O., Měch, R., and Miller, G. 2011. Guided Procedural Modeling. Comp. Graph. Forum (Eurographics) 30, 2, 325–334.
4. Bokeloh, M., Wand, M., and Seidel, H.-P. 2010. A Connection Between Partial Symmetry and Inverse Procedural Modeling. ACM Trans. Graph. (Siggraph) 29, 4, 104.
5. Brochu, E., Brochu, T., and de Freitas, N. 2010. A Bayesian Interactive Optimization Approach to Procedural Animation Design. ACM SIGGRAPH/Eurographics Symp. on Computer Animation, 103–112.
6. Chaudhuri, S., Kalogerakis, E., Giguere, S., and Funkhouser, T. 2013. Attribit: Content Creation with Semantic Attributes. ACM Symp. User Interface Software and Technology, 193–202.
7. Deng, B., Bouaziz, S., Deuss, M., Zhang, J., Schwartzburg, Y., and Pauly, M. 2013. Exploring Local Modifications for Constrained Meshes. Comp. Graph. Forum (Eurographics) 32, 2pt1, 11–20.
8. Farhadi, A., Endres, I., Hoiem, D., and Forsyth, D. 2009. Describing Objects By Their Attributes. IEEE CVPR, 1778–1785.
9. Johnson, M. 1998. Pcfg models of linguistic tree representations. Comput. Linguist. 24, 4, 613–632.
10. Kalogerakis, E., Chaudhuri, S., Koller, D., and Koltun, V. 2012. A probabilistic model for component-based shape synthesis. ACM Trans. Graph. (Siggraph) 31, 4, 55.
11. Kerr, W. B., and Pellacini, F. 2010. Toward Evaluating Material Design Interface Paradigms for Novice Users. ACM Trans. Graph. (Siggraph) 29, 4, 35.
12. Kleiman, Y., Fish, N., Lanir, J., and Cohen-Or, D. 2013. Dynamic Maps for Exploring and Browsing Shapes. Comp. Graphics Forum (SGP) 32, 5, 187–196.
13. Kovar, L., and Gleicher, M. 2001. Simplicial Families of Drawings. ACM Symp. User Interface Software and Technology, 163–172.
14. Koyama, Y., Sakamoto, D., and Igarashi, T. 2014. Crowd-powered Parameter Analysis for Visual Design Exploration. ACM Symp. User Interface Software and Technology, 65–74.
15. Lee, B., Srivastava, S., Kumar, R., Brafman, R. I., and Klemmer, S. R. 2010. Designing with Interactive Example Galleries. Proc. SIGCHI Conf. on Human Factors in Comp. Sys., 2257–2266.
16. Lienhard, S., Specht, M., Neubert, B., Pauly, M., and Müller, P. 2014. Thumbnail Galleries for Procedural Models. Comp. Graph. Forum (Eurographics) 33, 2, 361–370.
17. Lipp, M., Wonka, P., and Wimmer, M. 2008. Interactive Visual Editing of Grammars for Procedural Architecture. ACM Trans. Graph. (Siggraph) 27, 3, 102.
18. Manning, C. D., and Schütze, H. 1999. Foundations of Statistical Natural Language Processing. MIT Press.
19. Marks, J., Andalman, B., Beardsley, P. A., Freeman, W., Gibson, S., Hodgins, J., Kang, T., Mirtich, B., Pfister, H., Ruml, W., Ryall, K., Seims, J., and Shieber, S. 1997. Design Galleries: A General Approach to Setting Parameters for Computer Graphics and Animation. Proc. of SIGGRAPH, 389–400.
20. Martinovic, A., and Van Gool, L. 2013. Bayesian grammar learning for inverse procedural modeling. IEEE CVPR, 201–208.
21. Merrell, P., Schkufza, E., Li, Z., Agrawala, M., and Koltun, V. 2011. Interactive Furniture Layout Using Interior Design Guidelines. ACM Trans. Graph. (Siggraph) 30, 4, 87.
22. Müller, P., Wonka, P., Haegler, S., Ulmer, A., and Gool, L. V. 2006. Procedural Modeling of Buildings. ACM Trans. Graph. (Siggraph) 25, 3, 614–623.
23. Müller, P., Zeng, G., Wonka, P., and Gool, L. V. 2007. Image-based Procedural Modeling of Facades. ACM Trans. Graph. (Siggraph) 26, 3, 85.
24. Měch, R., and Prusinkiewicz, P. 1996. Visual Models of Plants Interacting with Their Environment. Proc. of SIGGRAPH, 397–410.
25. O’Donovan, P., Lībeks, J., Agarwala, A., and Hertzmann, A. 2014. Exploratory Font Selection Using Crowdsourced Attributes. ACM Trans. Graph. (Siggraph) 33, 4, 92.
26. Parish, Y. I. H., and Müller, P. 2001. Procedural Modeling of Cities. Proc. of SIGGRAPH, 301–308.
27. Platt, J. C., Burges, C. J., Swenson, S., Weare, C., and Zheng, A. 2001. Learning a gaussian process prior for automatically generating music playlists. In NIPS, 1425–1432.
28. Prusinkiewicz, P., and Lindenmayer, A. 1990. The Algorithmic Beauty of Plants. Springer.
29. Prusinkiewicz, P., James, M., and Měech, R. 1994. Synthetic Topiary. Proc. of SIGGRAPH, 351–358.
30. Prusinkiewicz, P. 1986. Graphical Applications of L-systems. Proc. on Graphics Interface/Vision Interface, 247–253.
31. Rasmussen, C. E., and Williams, C. K. I. 2005. Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning). MIT Press.
32. Shapira, L., Shamir, A., and Cohen-Or, D. 2009. Image Appearance Exploration by Model-Based Navigation. Comp. Graph. Forum (Eurographics) 28, 2, 629–638.
33. Simon, L., Teboul, O., Koutsourakis, P., and Paragios, N. 2011. Random Exploration of the Procedural Space for Single-View 3D Modeling of Buildings. IJCV 93, 2, 253–271.
34. Smelik, R. M., Tutenel, T., Bidarra, R., and Benes, B. 2014. A Survey on Procedural Modelling for Virtual Worlds. Comp. Graph. Forum (Eurographics) 33, 6, 31–50.
35. Št’ava, O., Beneš, B., Měch, R., Aliaga, D. G., and Krištof, P. 2010. Inverse Procedural Modeling by Automatic Generation of L-systems. Comp. Graph. Forum (Eurographics) 29, 2, 665–674.
36. Stiny, G. 1975. Pictorial and Formal Aspects of Shape and Shape Grammars. Birkhauser Verlag, Basel, Switzerland.
37. Stiny, G. 1982. Spatial Relations and Grammars. Environment and Planning B 5, 1, 5–18.
38. Talton, J. O., Gibson, D., Yang, L., Hanrahan, P., and Koltun, V. 2009. Exploratory Modeling with Collaborative Design Spaces. ACM Trans. Graph. (Siggraph Asia) 28, 5, 167.
39. Talton, J. O., Lou, Y., Lesser, S., Duke, J., Měch, R., and Koltun, V. 2011. Metropolis Procedural Modeling. ACM Trans. Graph. (Siggraph) 30, 2, 11.
40. Talton, J., Yang, L., Kumar, R., Lim, M., Goodman, N., and Měch, R. 2013. Learning design patterns with bayesian grammar induction. ACM Symp. User Interface Software and Technology, 63–74.
41. Umetani, N., Igarashi, T., and Mitra, N. J. 2012. Guided Exploration of Physically Valid Shapes for Furniture Design. ACM Trans. Graph. (Siggraph) 58, 9, 86.
42. Wonka, P., Wimmer, M., Sillion, F., and Ribarsky, W. 2003. Instant Architecture. ACM Trans. Graph. (Siggraph) 22, 3, 669–677.
43. Wu, F., Yan, D.-M., Dong, W., Zhang, X., and Wonka, P. 2014. Inverse Procedural Modeling of Facade Layouts. ACM Trans. Graph. (Siggraph) 33, 4, 121.
44. Xu, K., Zhang, H., Cohen-Or, D., and Chen, B. 2012. Fit and Diverse: Set Evolution for Inspiring 3D Shape Galleries. ACM Trans. Graph. (Siggraph) 31, 4, 57.
45. Yang, Y.-L., Yang, Y.-J., Pottmann, H., and Mitra, N. J. 2011. Shape Space Exploration of Constrained Meshes. ACM Trans. Graph. (Siggraph Asia) 30, 6, 124.
