“A Probabilistic Model for Exteriors of Residential Buildings” by Fan and Wonka

  • ©Lubin Fan and Peter Wonka



Session Title:



    A Probabilistic Model for Exteriors of Residential Buildings




    We propose a new framework to model the exterior of residential buildings. The main goal of our work is to design a model that can be learned from data that is observable from the outside of a building and that can be trained with widely available data such as aerial images and street-view images. First, we propose a parametric model to describe the exterior of a building (with a varying number of parameters) and propose a set of attributes as a building representation with fixed dimensionality. Second, we propose a hierarchical graphical model with hidden variables to encode the relationships between building attributes and learn both the structure and parameters of the model from the database. Third, we propose optimization algorithms to generate three-dimensional models based on building attributes sampled from the graphical model. Finally, we demonstrate our framework by synthesizing new building models and completing partially observed building models from photographs.


    1. Oswin Aichholzer, Franz Aurenhammer, David Alberts, and Bernd Gärtner. 1996. A Novel Type of Skeleton for Polygons. Springer, New York, NY.
    2. Melinos Averkiou, Vladimir Kim, Youyi Zheng, and Niloy J. Mitra. 2014. ShapeSynth: Parameterizing model collections for coupled shape exploration and synthesis. Computer Graphics Forum 33, 2, 125–134. 
    3. Fan Bao, Michael Schwarz, and Peter Wonka. 2013a. Procedural facade variations from a single layout. ACM Transactions on Graphics 32, 1, 8:1–8:13. 
    4. Fan Bao, Dong-Ming Yan, Niloy J. Mitra, and Peter Wonka. 2013b. Generating and exploring good building layouts. ACM Transactions on Graphics 32, 4, 122:1–122:10. 
    5. Martin Bokeloh, Michael Wand, and Hans-Peter Seidel. 2010. A connection between partial symmetry and inverse procedural modeling. ACM Transactions on Graphics 29, 4, 104:1–104:10. 
    6. Neill D. F. Campbell and Jan Kautz. 2014. Learning a manifold of fonts. ACM Transactions on Graphics 33, 4, 91:1–91:11. 
    7. Siddhartha Chaudhuri, Evangelos Kalogerakis, Leonidas Guibas, and Vladlen Koltun. 2011. Probabilistic reasoning for assembly-based 3D modeling. ACM Transactions on Graphics 30, 4, 35:1–35:10. 
    8. Siddhartha Chaudhuri, Evangelos Kalogerakis, Stephen Giguere, and Thomas Funkhouser. 2013. AttribIt: Content creation with semantic attributes. Proc. UIST. ACM. 
    9. Peter Cheeseman and John Stutz. 1996. Bayesian classification (AutoClass): Theory and results. In Advances in Knowledge Discovery and Data Mining. 153–180. 
    10. Lubin Fan, Przemyslaw Musialski, Ligang Liu, and Peter Wonka. 2014. Structure completion for facade layouts. ACM Transactions on Graphics 33, 6, 210:1–210:11. 
    11. David Heckerman. 1998. A Tutorial on Learning with Bayesian Networks. Springer, New York, NY.
    12. Evangelos Kalogerakis, Siddhartha Chaudhuri, Daphne Koller, and Vladlen Koltun. 2012. A probabilistic model for component-based shape synthesis. ACM Transactions on Graphics 31, 4, 55:1–55:11. 
    13. Vladimir G. Kim, Wilmot Li, Niloy J. Mitra, Siddhartha Chaudhuri, Stephen DiVerdi, and Thomas Funkhouser. 2013. Learning part-based templates from large collections of 3D shapes. ACM Transactions on Graphics 32, 4, 70:1–70:12. 
    14. Daphne Koller and Nir Friedman. 2009. Probabilistic Graphical Models: Principles and Techniques. MIT Press, Cambridge, MA. 
    15. Jinjie Lin, Daniel Cohen-Or, Hao Zhang, Cheng Liang, Andrei Sharf, Oliver Deussen, and Baoquan Chen. 2011. Structure-preserving retargeting of irregular 3D architecture. ACM Transactions on Graphics 30, 6, 183:1–183:10. 
    16. A. Martinovic and L. Van Gool. 2013. Bayesian grammar learning for inverse procedural modeling. In CVPR. 201–208. 
    17. Paul Merrell, Eric Schkufza, and Vladlen Koltun. 2010. Computer-generated residential building layouts. ACM Transactions on Graphics 29, 6, 181:1–181:12. 
    18. Pascal Müller, Peter Wonka, Simon Haegler, Andreas Ulmer, and Luc Van Gool. 2006. Procedural modeling of buildings. ACM Transactions on Graphics 25, 3, 614–623. 
    19. Przemyslaw Musialski, Peter Wonka, Daniel G. Aliaga, Michael Wimmer, Luc van Gool, and Werner Purgathofer. 2013. A survey of urban reconstruction. Computer Graphics Forum 32, 6, 146–177. 
    20. Jorma Rissanen. 1983. A universal prior for integers and estimation by minimum description length. Annals of Statistics, 416–431.
    21. Michael Schwarz and Pascal Müller. 2015. Advanced procedural modeling of architecture. ACM Transactions on Graphics 34, 4, 107:1–107:12. 
    22. Ruben M. Smelik, Tim Tutenel, Rafael Bidarra, and Bedrich Benes. 2014. A survey on procedural modelling for virtual worlds. Computer Graphics Forum 33, 6, 31–50.
    23. O. Št’ava, B. Beneš, R. Měch, Daniel G. Aliaga, and P. Krištof. 2010. Inverse procedural modeling by automatic generation of L-systems. Computer Graphics Forum 29, 2, 665–674.
    24. Jerry Talton, Lingfeng Yang, Ranjitha Kumar, Maxine Lim, Noah Goodman, and Radomír Měch. 2012. Learning design patterns with Bayesian grammar induction. In Proceedings of UIST. 63–74. 
    25. Jerry O. Talton, Yu Lou, Steve Lesser, Jared Duke, Radomír Měch, and Vladlen Koltun. 2011. Metropolis procedural modeling. ACM Transactions on Graphics. 30, 2, 11:1–11:14. 
    26. Carlos A. Vanegas, Daniel G. Aliaga, Peter Wonka, Pascal Müller, Paul Waddell, and Benjamin Watson. 2010. Modelling the appearance and behaviour of urban spaces. Computer Graphics Forum 29, 1, 25–42.
    27. Peter Wonka, Michael Wimmer, François X. Sillion, and William Ribarsky. 2003. Instant architecture. ACM Transactions on Graphics 22, 3, 669–677. 
    28. Fuzhang Wu, Dong-Ming Yan, Weiming Dong, Xiaopeng Zhang, and Peter Wonka. 2014. Inverse procedural modeling of facade layouts. ACM Transactions on Graphics 33, 4, 121:1–121:10. 
    29. Yong-Liang Yang, Yi-Jun Yang, Helmut Pottmann, and Niloy J. Mitra. 2011. Shape space exploration of constrained meshes. ACM Transactions on Graphics 30, 6, 124:1–124:12. 
    30. Hao Zhang, Kai Xu, Wei Jiang, Jinjie Lin, Daniel Cohen-Or, and Baoquan Chen. 2013. Layered analysis of irregular facades via symmetry maximization. ACM Transactions on Graphics 32, 4, 121:1–121:13

ACM Digital Library Publication: