“Structure completion for facade layouts” by Fan, Musialski, Liu and Wonka
Conference:
Type(s):
Title:
- Structure completion for facade layouts
Session/Category Title: Scenes, Syntax, Statistics and Semantics
Presenter(s)/Author(s):
Abstract:
We present a method to complete missing structures in facade layouts. Starting from an abstraction of the partially observed layout as a set of shapes, we can propose one or multiple possible completed layouts. Structure completion with large missing parts is an ill-posed problem. Therefore, we combine two sources of information to derive our solution: the observed shapes and a database of complete layouts. The problem is also very difficult, because shape positions and attributes have to be estimated jointly. Our proposed solution is to break the problem into two components: a statistical model to evaluate layouts and a planning algorithm to generate candidate layouts. This ensures that the completed result is consistent with the observation and the layouts in the database.
References:
1. AlHalawani, S., Yang, Y.-L., Liu, H., and Mitra, N. J. 2013. Interactive facades analysis and synthesis of semi-regular facades. Computer Graphics Forum 32, 2, 215–224.Cross Ref
2. Ali, S., Ye, J., Razdan, A., and Wonka, P. 2009. Compressed facade displacement maps. IEEE Trans. on Vis. and Comp. Graph 15, 2, 262–273.
3. Bao, F., Schwarz, M., and Wonka, P. 2013. Procedural facade variations from a single layout. ACM Trans. Graph. 32, 1 (Jan.), 8:1–8:13.
4. Bertalmí O, M., Sapiro, G., Caselles, V., and Ballester, C. 2000. Image inpainting. In Proc. of SIGGRAPH 2000, 417–424.
5. Dai, D., Riemenschneider, H., Schmitt, G., and Van Gool, L. 2013. Example-based facade texture synthesis. In ICCV, 1065–1072.
6. He, K., and Sun, J. 2012. Statistics of patch offsets for image completion. In ECCV, 16–29.
7. Hinton, G. E. 2002. Training products of experts by minimizing contrastive divergence. Neural Computation 14, 8, 1771–1800.
8. Korah, T., and Rasmussen, C. 2008. Analysis of building textures for reconstructing partially occluded facades. In ECCV, 359–372.
9. Koutsourakis, P., Simon, L., Teboul, O., Tziritas, G., and Paragios, N. 2009. Single view reconstruction using shape grammars for urban environments. In ICCV, 1795–1802.
10. LaValle, S. M. 2006. Planning Algorithms. Cambridge University Press.
11. Lefebvre, S., Hornus, S., and Lasram, A. 2010. By-example synthesis of architectural textures. ACM Trans. Graph. 29, 4 (July), 84:1–84:8.
12. Lin, J., Cohen-Or, D., Zhang, H., Liang, C., Sharf, A., Deussen, O., and Chen, B. 2011. Structure-preserving re-targeting of irregular 3D architecture. ACM Trans. Graph. 30, 6, 183:1–183:10.
13. Lin, S., Ritchie, D., Fisher, M., and Hanrahan, P. 2013. Probabilistic color-by-numbers: Suggesting pattern colorizations using factor graphs. ACM Trans. Graph. 32, 4 (July), 37:1–37:12.
14. Martinovic, A., and Van Gool, L. 2013. Bayesian grammar learning for inverse procedural modeling. In CVPR, 201–208.
15. Martinović, A., Mathias, M., Weissenberg, J., and Van Gool, L. 2012. A three-layered approach to facade parsing. In ECCV, 416–429.
16. Müller, P., Wonka, P., Haegler, S., Ulmer, A., and Gool, L. V. 2006. Procedural modeling of buildings. ACM Trans. Graph. 25, 3 (July), 614–623.
17. Müller, P., Zeng, G., Wonka, P., and Gool, L. V. 2007. Image-based procedural modeling of facades. ACM Trans. Graph. 26, 3 (July), 85:1–85:9.
18. Musialski, P., Wimmer, M., and Wonka, P. 2012. Interactive coherence-based façade modeling. Computer Graphics Forum 31, 2, 661–670.
19. Musialski, P., Wonka, P., Aliaga, D. G., Wimmer, M., van Gool, L., and Purgathofer, W. 2013. A Survey of Urban Reconstruction. Computer Graphics Forum 32, 6, 146–177.
20. Rissanen, J. 1983. A universal prior for integers and estimation by minimum description length. The Annals of statistics, 416–431.Cross Ref
21. Shen, C.-H., Huang, S.-S., Fu, H., and Hu, S.-M. 2011. Adaptive partitioning of urban facades. ACM Trans. Graph. 30, 6 (Dec.), 184:1–184:10.
22. Sun, J., Yuan, L., Jia, J., and Shum, H.-Y. 2005. Image completion with structure propagation. ACM Trans. Graph. 24, 3 (July), 861–868.
23. Talton, J. O., Lou, Y., Lesser, S., Duke, J., Měch, R., and Koltun, V. 2011. Metropolis procedural modeling. ACM Trans. Graph. 30, 2 (Apr.), 11:1–11:14.
24. Teboul, O., Simon, L., Koutsourakis, P., and Paragios, N. 2010. Segmentation of building facades using procedural shape priors. 3105–3112.
25. Teboul, O., Kokkinos, I., Simon, L., Koutsourakis, P., and Paragios, N. 2013. Parsing facades with shape grammars and reinforcement learning. IEEE Trans. Pattern Anal. Mach. Intell 35, 7, 1744–56.
26. Wand, M. P., and Jones, M. C. 1994. Kernel Smoothing. Crc Press.
27. Weissenberg, J., Riemenschneider, H., Prasad, M., and Van Gool, L. 2013. Is there a procedural logic to architecture? In CVPR, 185–192.
28. Wonka, P., Wimmer, M., Sillion, F. X., and Ribarsky, W. 2003. Instant architecture. ACM Trans. Graph. 22, 3 (July), 669–677.
29. Wu, F., Yan, D.-M., Dong, W., Zhang, X., and Wonka, P. 2014. Inverse procedural modeling of facade layouts. ACM Trans. Graph. 33, 4 (July), 121:1–121:10.
30. Yang, C., Han, T., Quan, L., and Tai, C.-L. 2012. Parsing façade with rank-one approximation. 1720–1727.
31. Yeh, Y.-T., Breeden, K., Yang, L., Fisher, M., and Hanrahan, P. 2013. Synthesis of tiled patterns using factor graphs. ACM Trans. Graph. 32, 1 (Jan.), 3:1–3:13.
32. Zhang, H., Xu, K., Jiang, W., Lin, J., Cohen-Or, D., and Chen, B. 2013. Layered analysis of irregular facades via symmetry maximization. ACM Trans. Graph. 32, 4 (July), 121:1–121:10.
