“Symmetric architecture modeling with a single image”
Conference:
Type(s):
Title:
- Symmetric architecture modeling with a single image
Session/Category Title: Urban modeling
Presenter(s)/Author(s):
Moderator(s):
Abstract:
We present a method to recover a 3D texture-mapped architecture model from a single image. Both single image based modeling and architecture modeling are challenging problems. We handle these difficulties by employing constraints derived from shape symmetries, which are prevalent in architecture. We first present a novel algorithm to calibrate the camera from a single image by exploiting symmetry. Then a set of 3D points is recovered according to the calibration and the underlying symmetry. With these reconstructed points, the user interactively marks out components of the architecture structure, whose shapes and positions are automatically determined according to the 3D points. Lastly, we texture the 3D model according to the input image, and we enhance the texture quality at those foreshortened and occluded regions according to their symmetric counterparts. The modeling process requires only a few minutes interaction. Multiple examples are provided to demonstrate the presented method.
References:
1. Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: a hybrid geometry and image-based approach. ACM SIGGRAPH 1996, 11–20. Google ScholarDigital Library
2. Debevec, P. E. 1996. Modeling and Rendering Architecture from Photographs. PhD thesis, University of California at Berkeley, Computer Science Division, Berkeley CA. Google ScholarDigital Library
3. Dick, A. R., Torr, P. H. S., and Cipolla, R. 2004. Modelling and interpretation of architecture from several images. Int. J. Comput. Vision 60, 2, 111–134. Google ScholarDigital Library
4. Fitzgibbon, A. W., Cross, G., and Zisserman, A. 1998. Automatic 3d model construction for turn-table sequences. In Proc. of SMILE Workshop on Structure from Multiple Images in Large Scale Environments, 155–170. Google ScholarDigital Library
5. Francois, A., Medioni, G., and Waupotitsch, R. 2002. Reconstructing mirror symmetric scenes from a single view using 2-view stereo geometry. In Proc. of ICPR 2002. Google ScholarDigital Library
6. Freeman, W., Pasztor, E., and Carmichael, O. 2000. Learning low-level vision. Int. J. of Comput. Vision 40, 2000. Google ScholarDigital Library
7. Früh, C., and Zakhor, A. 2003. Constructing 3d city models by merging ground-based and airborne views. In Proc. of CVPR.Google Scholar
8. Hargittai, I., and Hargittai, M. 1994. Symmetry: A Unifying Concept. Shelter Publications.Google Scholar
9. Hartley, R., and Zisserman, A. 2001. Multiple View Geometry in Computer Vision. Cambridge University Press. Google ScholarDigital Library
10. Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM SIGGRAPH 2005 24, 3, 577–584. Google ScholarDigital Library
11. Hong, W., Yang, A. Y., Huang, K., and Ma, Y. 2004. On symmetry and multiple-view geometry: Structure, pose, and calibration from a single image. Int. J. Comput. Vision 60, 241–265. Google ScholarDigital Library
12. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: image and video synthesis using graph cuts. ACM SIGGRAPH 2003 22, 3, 277–286. Google ScholarDigital Library
13. Lhuillier, M., and Quan, L. 2002. Match propagation for image-based modeling and rendering. IEEE Trans. Pattern Anal. Mach. Intell. 24, 8, 1140–1146. Google ScholarDigital Library
14. Liebowitz, D., Criminisi, A., and Zisserman, A. 1996. Creating architectural models from images. Computer Graphics Forum (September), 39–50.Google Scholar
15. Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. Int. J. of Comput. Vision 60, 2, 91–110. Google ScholarDigital Library
16. Müller, P., Wonka, P., Haegler, S., Ulmer, A., and van Gool, L. 2006. Procedural modeling of buildings. ACM Trans. Graph. (SIGGRAPH 2006) 25, 3, 614–623. Google ScholarDigital Library
17. Müller, P., Zeng, G., Wonka, P., and van Gool, L. 2007. Image-based procedural modeling of facades. ACM Trans. Graph. (SIGGRAPH 2007) 26, 3, 85. Google ScholarDigital Library
18. Oh, B. M., Chen, M., Dorsey, J., and Durand, F. 2001. Image-based modeling and photo editing. In ACM SIGGRAPH 2001. Google ScholarDigital Library
19. Parish, Y. I. H., and Müller, P. 2001. Procedural modeling of cities. In ACM SIGGRAPH 2001. Google ScholarDigital Library
20. Pollefeys, M., and et al. 2008. Detailed real-time urban 3d reconstruction from video. Int. J. Comput. Vision 78, 143–167. Google ScholarDigital Library
21. Ramanarayanan, G., and Bala, K. 2007. Constrainted texture synthesis via engergy minimization. IEEE Trans. Visualization and Computer Graphics 13, 1, 167–178. Google ScholarDigital Library
22. Rothwell, C. A., Forsyth, D. A., Zisserman, A., and Mundy, J. L. 1993. Extracting projective structure from single perspective views of 3d point sets. In Proc. of ICCV1993.Google Scholar
23. Sinha, S. N., Steedly, D., Szeliski, R., Agrawala, M., and Pollefeys, M. 2008. Interactive 3d architectural modeling from unordered photo collections. ACM Trans. Graph. (SIGGRAPH Asia 2008) 27, 5, 1–10. Google ScholarDigital Library
24. Tai, Y.-W., Brown, M. S., Tang, C.-K., and Shum, H.-Y. 2008. Texture amendment: reducing texture distortion in constrained parameterization. ACM Trans. Graph. (Siggraph Asia 2008) 27, 5, 1–6. Google ScholarDigital Library
25. van den Hengel, A., Dick, A., Thormählen, T., Ward, B., and Torr, P. H. S. 2007. Videotrace: rapid interactive scene modelling from video. 86.Google Scholar
26. Wang, J., Tong, X., Lin, S., Pan, M., Wang, C., Bao, H., Guo, B., and Shum, H.-Y. 2006. Appearance manifolds for modeling time-variant appearance of materials. ACM Trans. on Graph. (SIGGRAPH 2006), 754–761. Google ScholarDigital Library
27. Wilczkowiak, M., Boyer, E., and Sturm, P. 2001. Camera calibration and 3d reconstruction from single images using parallelepipeds. In Proc. of ICCV, 142–148.Google Scholar
28. Wilczkowiak, M., Sturm, P., and Boyer, E. 2005. Using geometric constraints through parallelepipeds for calibration and 3d modeling. IEEE Trans. Pattern Anal. Mach. Intell. 27, 2. Google ScholarDigital Library
29. Xiao, J., Fang, T., Tan, P., Zhao, P., Ofek, E., and Quan, L. 2008. Image-based façade modeling. ACM Trans. Graph. (SIGGRAPH Asia 2008) 27, 5, 1–10. Google ScholarDigital Library
30. Zebedin, L., Klaus, A., Gruber-Geymayer, B., and Karner, K. 2006. Towards 3d map generation from digital aerial images. Journal of photogrammetry and remote sensing 60, 6, 413–427.Google ScholarCross Ref
31. Zhang, Z. Y., and Tsui, H. T. 1998. 3d reconstruction from a single view of an object and its image in a plane mirror. In Proc. of ICPR 1998. Google ScholarDigital Library
