“3D-modeling by ortho-image generation from image sequences” by Thormählen and Seidel

A semi-automatic approach is presented that enables the generation of a high-quality 3D model of a static object from an image sequence that was taken by a moving, uncalibrated consumer camera. A bounding box is placed around the object, and orthographic projections onto the sides of the bounding box are automatically generated out of the image sequence. These ortho-images can be imported as background maps in the orthographic views (e.g., the top, side, and front view) of any modeling package. Modelers can now use these ortho-images to guide their modeling by tracing the shape of the object over the ortho-images. This greatly improves the accuracy and efficiency of the manual modeling process. An additional advantage over existing semi-automatic systems is that modelers can use the modeling package that they are trained in and can thereby increase their productivity by applying the advanced modeling features the package offers. The results presented show that accurate 3D models can even be generated for translucent or specular surfaces, and the approach is therefore still applicable in cases where today’s fully automatic image-based approaches or laser scanners would fail.

1. Eos Systems, 2005. Photomodeler: A commercial photogrammetry product http://www.photomodeler.com.Google Scholar
2. Gibson, S., Hubbold, R. J., Cook, J., and Howard, T. L. J. 2003. Interactive reconstruction of virtual environments from video sequences. Computers and Graphics 27, 293–301.Google ScholarCross Ref
3. Habib, A. F., Kim, E. M., and Kim, C. J. 2007. New methodologies for true orthophoto generation. Photogrammetric Engineering and Remote Sensing 73, 1, 25–36.Google ScholarCross Ref
4. Karras, G., Grammatikopoulos, L., Kaisperakis, I., and Petsa, E. 2007. Generation of orthoimages and perspective views with automatic visibility checking and texture blending. Photogrammetric Engineering and Remote Sensing 73, 4, 403–411.Google ScholarCross Ref
5. Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., and Fulk, D. 2000. The digital michelangelo project. In Proc. ACM SIGGraph, K. Akeley, Ed., 131–144. Google ScholarDigital Library
6. Niem, W. 1999. Automatic reconstruction of 3d objects using a mobile camera. Image Vision Comput. 17, 2, 125–134.Google ScholarCross Ref
7. Pollefeys, M., Gool, L. V., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., and Koch, R. 2004. Visual modeling with a hand-held camera. Int. J. Comput. Vision 59, 3, 207–232. Google ScholarDigital Library
8. Shum, H.-Y., and Kang, S. B. 2000. A review of image-based rendering techniques. In Proc. Visual Communications and Image Processing, 2–13.Google Scholar
9. Taylor, C., Debevec, P., and Malik, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach. In Proc. ACM SIGGraph, 11–20. Google ScholarDigital Library
10. Thormählen, T. 2006. Zuverlässige Schätzung der Kamerabewegung aus einer Bildfolge. PhD thesis, University of Hannover, related software ‘Voodoo Camera Tracker’ can be downloaded from http://www.digilab.uni-hannover.de.Google Scholar
11. van den Hengel, A., Dick, A., Thormählen, T., Ward, B., and Torr, P. H. S. 2007. Videotrace: rapid interactive scene modelling from video. In Proc. ACM SIGGraph, 86–90. Google ScholarDigital Library
12. Vogiatzis, G., Torr, P. H. S., and Cipolla, R. 2005. Multi-view stereo via volumetric graph-cuts. In Proc. IEEE Computer Vision and Pattern Recognition. Google ScholarDigital Library