“Image-based visual hulls” by Matusik, Buehler, Raskar, Gortler and McMillan

In this paper, we describe an efficient image-based approach to computing and shading visual hulls from silhouette image data. Our algorithm takes advantage of epipolar geometry and incremental computation to achieve a constant rendering cost per rendered pixel. It does not suffer from the computation complexity, limited resolution, or quantization artifacts of previous volumetric approaches. We demonstrate the use of this algorithm in a real-time virtualized reality application running off a small number of video streams.

1. Bichsel, M. “Segmenting Simply Connected Moving Objects in a Static Scene.” IEEE PAM116, 11 (November 1994), 1138-1142.
2. Boyer, E., and M. Berger. “3D Surface Reconstruction Using Occluding Contours.” IJCV 22, 3 (1997), 219-233.
3. Chen, S. E. and L. Williams. “View Interpolation for Image Synthesis.” SIGGRAPH 93, 279-288.
4. Chen, S. E. “Quicktime VR- An Image-Based Approach to Virtual Environment Navigation.” SIGGRAPH 95, 29-38.
5. Curless, B., and M. Levoy. “A Volumetric Method for Building Complex Models from Range Images.” SIGGRAPH 96, 303-312.
6. Debevec, P., C. Taylor, and J. Malik, “Modeling and Rendering Architecture from Photographs.” SIGGRAPH 96, 11-20.
7. Debevec, P.E., Y. Yu, and G. D. Borshukov, “Efficient View- Dependent Image-based Rendering with Projective Texture Mapping.” Proc. of EGRW 1998 (June 1998).
8. Debevec, P. Modeling and Rendering Architecture from Photographs. Ph.D. Thesis, University of California at Berkeley, Computer Science Division, Berkeley, CA, 1996.
9. Faugeras, O. Three-dimensional Computer Vision: A Geometric Viewpoint. MIT Press, 1993.
10. Friedman, N. and S. Russel. “Image Segmentation in Video Sequences.” Proc 13th Conference on Uncertainty in Artifical Intelligence (1997).
11. Goldfeather, J., J. Hultquist, and H. Fuchs. “Fast Constructive Solid Geometry Display in the Pixel-Powers Graphics System.” SIG- GRAPH 86, 107-116.
12. Gortler, S. J., R. Grzeszczuk, R. Szeliski, and M. F. Cohen. “The Lumigraph.” SIGGRAPH 96, 43-54.
13. Kanade, T., P. W. Rander, and P. J. Narayanan. “Virtualized Reality: Constructing Virtual Worlds from Real Scenes.” IEEE Multimedia 4, 1 (March 1997), 34-47.
14. Laurentini, A. “The Visual Hull Concept for Silhouette Based Image Understanding.” IEEE PAMI 16,2 (1994), 150-162.
15. Levoy, M. and P. Hanrahan. “Light Field Rendering.” SIGGRAPH 96, 31-42.
16. Lorensen, W.E., and H. E. Cline. “Marching Cubes: A High Resolution 3D Surface Construction Algorithm.” SIGGRAPH 87, 163-169.
17. McMillan, L., and G. Bishop. “Plenoptic Modeling: An Image- Based Rendering System.” SIGGRAPH 95, 39-46.
18. McMillan, L. An Image-Based Approach to Three-Dimensional Computer Graphics, Ph.D. Thesis, University of North Carolina at Chapel Hill, Dept. of Computer Science, 1997.
19. Moezzi, S., D.Y. Kuramura, and R. Jain. “Reality Modeling and Visualization from Multiple Video Sequences.” IEEE CG&A 16, 6 (November 1996), 58-63.
20. Narayanan, P., P. Rander, and T. Kanade. “Constructing Virtual Worlds using Dense Stereo.” Proc. ICCV 1998, 3-10.
21. Pollard, S. and S. Hayes. “View Synthesis by Edge Transfer with Applications to the Generation of Immersive Video Objects.” Proc. of VRST, November 1998, 91-98.
22. Potmesil, M. “Generating Octree Models of 3D Objects from their Silhouettes in a Sequence of Images.” CVGIP 40 (1987), 1-29.
23. Rander, P. W., P. J. Narayanan and T. Kanade, “Virtualized Reality: Constructing Time Varying Virtual Worlds from Real World Events.” Proc. IEEE Visualization 1997, 277-552.
24. Rappoport, A., and S. Spitz. “Interactive Boolean Operations for Conceptual Design of 3D solids.” SIGGRAPH 97, 269-278.
25. Roth, S. D. “Ray Casting for Modeling Solids.” Computer Graphics and Image Processing, 18 (February 1982), 109-144.
26. Saito, H. and T. Kanade. “Shape Reconstruction in Projective Grid Space from a Large Number of Images.” Proc. of CVPR, (1999).
27. Seitz, S. and C. R. Dyer. “Photorealistic Scene Reconstruction by Voxel Coloring.” Proc. of CVPR (1997), 1067-1073.
28. Seuss, D. “The Cat in the Hat,” CBS Television Special (1971).
29. Szeliski, R. “Rapid Octree Construction from Image Sequences.” CVGIP: Image Understanding 58, 1 (July 1993), 23-32.
30. Vedula, S., P. Rander, H. Saito, and T. Kanade. “Modeling, Combining, and Rendering Dynamic Real-World Events from Image Sequences.” Proc. 4~h Intl. Conf. on Virtual Systems and Multimedia (Nov 1998).