“Multiple-center-of-projection images” by Rademacher and Bishop

In image-based rendering, images acquired from a scene are used to represent the scene itself. A number of reference images are required to fully represent even the simplest scene. This leads to a number of problems during image acquisition and subsequent reconstruction. We present the multiple-center-of-projection image, a single image acquired from multiple locations, which solves many of the problems of working with multiple range images. This work develops and discusses multiple-center-of-projection images, and explains their advantages over conventional range images for image-based rendering. The contributions include greater flexibility during image acquisition and improved image reconstruction due to greater connectivity information. We discuss the acquisition and rendering of multiple-center-of-projection datasets, and the associated sampling issues. We also discuss the unique epipolar and correspondence properties of this class of image.

1. E.H. Adelson and J. R. Bergen. The Plenoptic Function And The Elements Of Early Vision. In Computational Models of Visual Processing, pp. 3-20, Edited by Michael Landy and J. Anthony Movshon, The MIT Press, Cambridge, 1991.
2. Robert C. Bolles, H. Harlyn Baker, and David H. Marimont. Epipolar-Plane Image Analysis: An Approach To Determining Structure From Motion. In International Journal of Computer Vision, volume 1, page 7-55. Boston, 1987.
3. Shenchang Eric Chen and Lance Williams. View Interpolation For Image Synthesis. In Proceedings of SIGGRAPH 93, pp. 279-288, New York, 1993. ACM.
4. Shenchang Eric Chen. Quicktime VR: An Image-Based Approach To Virtual Environment Navigation. In Proceedings of SIGGRAPH 95, pp. 29-38, New York, 1995. ACM.
5. Brian Curless and Marc Levoy. A Volumetric Method For Building Complex Models From Range Images. In Proceedings of SIGGRAPH 96, pp. 303-312. NewYork, 1996. ACM.
6. William J. Dally, Leonard McMillan, Gary Bishop, and Henry Fuchs. The Delta Tree: An Object-Centered Approach To Image-Based Rendering. MIT AI Lab Technical Memo 1604, May 1996.
7. Lucia Darsa, Bruno Costa Silva, and Amitabh Varshney. Navigating Static Environments Using Image-Space Simplification And Morphing. In Proceedings of 1997 Symposium on Interactive 3D Graphics, pp. 25-34. April 1997.
8. Olivier Faugeras. Three-Dimensional Computer Vision: A Geometric Approach. MIT Press, Cambridge, Massachusetts, 1993.
9. Sanjib K. Ghosh. Analytical Photogrammetry, second edition. Pergamon, 1988.
10. Steven J. Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F. Cohen. The Lumigraph. In Proceedings of SIGGRAPH 96, pp. 43-54, New York, 1996. ACM.
11. Eduard Gr611er and Helwig L6ffelmann. Extended Camera Specifications for Image Synthesis. In Machine Graphics and Vision, 3 (3), pp. 513-530. 1994.
12. Michael Halle. Multiple Viewpoint Rendering. To appear in Proceedings of SIGGRAPH 98. New York, 1998. ACM
13. Richard Hartley and Rajiv Gupta. Linear Pushbroom Cameras. In Proceedings of Third European Conference on Computer Vision, pp. 555-566. New York, 1994.
14. Hugues Hoppe, Tony DeRose, Tom Duchamp, John McDonald, and Werner Stuetzle. Surface Reconstruction From Unorganized Points. In Computer Graphics (SIGGRAPH 92 Conference Proceedings), volume 26, pp. 71-78. New York, July 1992. ACM.
15. Stephane Lavaeu and Olivier Faugeras. 3-D Scene Representation As A Collection Of Images. INRIA Technical Report RR-2205. February 1994, INRIA.
16. Marc Levoy and Pat Hanrahan. Light Field Rendering. In Proceedings of SIGGRAPH 96, pp. 31-42, New York, 1996. ACM.
17. William R. Mark, Leonard McMillan and Gary Bishop. Post-Rendering 3D Warping. In Proceedings of the 1997 Symposium on Interactive 3D Graphics, page 7-16, Providence, Rhode Island, April 1997.
18. Leonard McMillan and Gary Bishop. Shape As A Perturbation To Projective Mapping, UNC Computer Science Technical Report TR95-046, University of North Carolina, April 1995.
19. Leonard McMillan and Gary Bishop. Plenoptic Modeling: An Image-Based Rendering System. In Proceedings of SIGGRAPH 95, pp. 39-46, New York, 1995. ACM.
20. Shmuel Peleg and Joshua Herman. Panoramic Mosaics by Manifold Projection. In Proceedings of Computer Vision and Pattern Recognition, pp. 338-343, Washington, June 1997. IEEE.
21. Karl Pulli, Michael Cohen, Tom Duchamp, Hugues Hoppe, Linda Shapiro, Werner Stuetzle. View-Based Rendering: Visualizing Real Objects from Scanned Range and Color Data. In Proceedings of Eighth Eurographics Workshop on Rendering, pp. 23-34. Eurographics, June 1997.
22. Matthew Regan and Ronald Pose. Priority Rendering with a Virtual Reality Address Recalculation Pipeline. In Proceedings of SIGGRAPH 94, pp. 155- 162, New York, 1994. ACM.
23. Jonathan Shade, Steven Gortler, Li-wei He, and Richard Szeliski. Layered Depth Images. To appear in Proceedings of SIGGRAPH 98. New York, 1998. ACM
24. Francois X. Sillion, George Drettakis and Benoit Bodelet. Efficient Impostor Manipulation For Real-Time Visualization Of Urban Scenery. In Proceedings of Eurographics 97, pp. 207-218. Budapest, Hungary, September 1997.
25. Edward Swan, Klaus Mueller, Torsten Moiler, Naeem Shareef, Roger Crawfis, and Roni Yagel. An Anti-Aliasing Technique For Splatting. In Proceedings oflEEE Visualization 97, pp. 197-204, 1997
26. Jay Torborg, James T. Kajiya. Talisman: Commodity Real-Time Graphics For The PC. In Proceedings of SIGGRAPH 96, pp. 353-363. New York, August 1996. ACM.
27. Greg Turk and Marc Levoy. Zippered Polygon Meshes From Range Images. In Proceedings of SIGGRAPH 94, pp. 311-318. New York, July 1994. ACM.
28. Gregory Welch and Gary Bishop. SCAAT: Incremental Tracking With Incomplete Information. In Proceedings of SIGGRAPH 97, pp. 333-344. Los Angeles, August 1997. ACM.
29. Lee Westover. Footprint Evaluation For Volume Rendering. In Computer Graphics (SIGGRAPH 90 Conference Proceedings), volume 24, pp. 367-376. NewYork, August 1990. ACM.
30. Daniel N. Wood, Adam Finkelstein, John F. Hughes, Craig E. Thayer, and David H. Salesin. Multiperspective Panoramas For Cel Animation. In Proceedings of SIGGRAPH 97, pp. 243-250. New York, 1997. ACM.
31. Jiang Yu Zheng and Saburo Tsuji. Panoramic Representation for Route Recognition by a Mobile Robot. In International Journal of Computer Vision 9 (1): 55-76. Netherlands, 1992. Kluwer.