“Shield fields: modeling and capturing 3D occluders”
Conference:
Type(s):
Title:
- Shield fields: modeling and capturing 3D occluders
Session/Category Title: Image-based capture
Presenter(s)/Author(s):
Abstract:
We describe a unified representation of occluders in light transport and photography using shield fields: the 4D attenuation function which acts on any light field incident on an occluder. Our key theoretical result is that shield fields can be used to decouple the effects of occluders and incident illumination. We first describe the properties of shield fields in the frequency-domain and briefly analyze the “forward” problem of efficiently computing cast shadows. Afterwards, we apply the shield field signal-processing framework to make several new observations regarding the “inverse” problem of reconstructing 3D occluders from cast shadows — extending previous work on shape-from-silhouette and visual hull methods. From this analysis we develop the first single-camera, single-shot approach to capture visual hulls without requiring moving or programmable illumination. We analyze several competing camera designs, ultimately leading to the development of a new large-format, mask-based light field camera that exploits optimal tiled-broadband codes for light-efficient shield field capture. We conclude by presenting a detailed experimental analysis of shield field capture and 3D occluder reconstruction.
References:
1. Accorsia, R., Gasparini, F., and Lanza, R. C. 2001. Optimal coded aperture patterns for improved SNR in nuclear medicine imaging. Nuclear Instruments and Methods in Physics Research A 474, 3, 273–284.Google ScholarCross Ref
2. Adelson, T., and Wang, J. 1992. Single lens stereo with a plenoptic camera. IEEE TPAMI 14, 2, 99–106. Google ScholarDigital Library
3. BowHaus, Inc., 2007. BowHaus LVT specs and resolutions. http://www.bowhaus.com/services/lvtspecs.php4.Google Scholar
4. Chai, J.-X., Tong, X., Chan, S.-C., and Shum, H.-Y. 2000. Plenoptic sampling. In SIGGRAPH, 307–318. Google Scholar
5. Debevec, P., Hawkins, T., Tchou, C., Duiker, H.-P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In SIGGRAPH, 145–156. Google Scholar
6. Durand, F., Holzschuch, N., Soler, C., Chan, E., and Sillion, F. X. 2005. A frequency analysis of light transport. ACM Trans. Graph. 24, 3, 1115–1126. Google ScholarDigital Library
7. Farid, H. 1997. Range Estimation by Optical Differentiation. PhD thesis, University of Pennsylvania. Google Scholar
8. Fenimore, E., and Cannon, T. 1978. Coded aperture imaging with uniformly redundant arrays. Appl. Optics 17, 3, 337–347.Google ScholarCross Ref
9. Georgiev, T., Zheng, K. C., Curless, B., Salesin, D., Na-yar, S., and Intwala, C. 2006. Spatio-angular resolution tradeoffs in integral photography. In EGSR, 263–272. Google Scholar
10. Goodman, J. W. 1996. Introduction to Fourier Optics.Google Scholar
11. Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The lumigraph. In SIGGRAPH, 43–54. Google Scholar
12. Gross, M., Würmlin, S., Naef, M., Lamboray, E., Spagno, C., Kunz, A., Koller-Meier, E., Svoboda, T., Gool, L. V., Lang, S., Strehlke, K., Moere, A. V., and Staadt, O. 2003. blue-c: a spatially immersive display and 3d video portal for telepresence. ACM Trans. Graph. 22, 3, 819–827. Google ScholarDigital Library
13. Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In SIGGRAPH, 297–306. Google Scholar
14. Ives, H. E. 1928. Camera for making parallax panoramagrams. J. Opt. Soc. of America 17, 435–439.Google ScholarCross Ref
15. Levin, A., Fergus, R., Durand, F., and Freeman, W. T. 2007. Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26, 3, 70. Google ScholarDigital Library
16. Levoy, M., and Hanrahan, P. 1996. Light field rendering. In SIGGRAPH, 31–42. Google Scholar
17. Lippmann, G. 1908. Epreuves reversible donnant la sensation du relief. Journal of Physics 7, 4, 821–825.Google Scholar
18. Matusik, W., Buehler, C., and McMillan, L. 2001. Polyhedral visual hulls for real-time rendering. In EGSR, 115–126. Google Scholar
19. Nayar, S. K., Krishnan, G., Grossberg, M. D., and Raskar, R. 2006. Fast separation of direct and global components of a scene using high frequency illumination. ACM Trans. Graph. 25, 3, 935–944. Google ScholarDigital Library
20. Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., and Hanrahan, P. 2005. Light field photography with a hand-held plenoptic camera. Tech. rep., Stanford University.Google Scholar
21. Ng, R. 2005. Fourier slice photography. ACM Trans. Graph. 24, 735–744. Google ScholarDigital Library
22. Ramamoorthi, R., Koudelka, M., and Belhumeur, P. 2005. A fourier theory for cast shadows. IEEE TPAMI 27, 2, 288–295. Google ScholarDigital Library
23. Ramamoorthi, R., Mahajan, D., and Belhumeur, P. 2007. A first-order analysis of lighting, shading, and shadows. ACM Trans. Graph. 26, 1, 2. Google ScholarDigital Library
24. Raskar, R., Agrawal, A., and Tumblin, J. 2006. Coded exposure photography: motion deblurring using fluttered shutter. ACM Trans. Graph. 25, 3, 795–804. Google ScholarDigital Library
25. Savarese, S., Rushmeier, H., Bernardini, F., and Per-ona, P. 2001. Shadow carving. In ICCV, 190–197.Google Scholar
26. Soler, C., and Sillion, F. X. 1998. Fast calculation of soft shadow textures using convolution. In SIGGRAPH, 321–332. Google Scholar
27. Talvala, E.-V., Adams, A., Horowitz, M., and Levoy, M. 2007. Veiling glare in high dynamic range imaging. ACM Trans. Graph. 26, 3, 37. Google ScholarDigital Library
28. Thornber, K., and Jacobs, D. 2001. Cast shadows and linear subspaces. Tech. rep. TR-2001-100, NEC.Google Scholar
29. Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., and Tumblin, J. 2007. Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph. 26, 3, 69. Google ScholarDigital Library
30. Vlasic, D., Pfister, H., Molinov, S., Grzeszczuk, R., and Matusik, W. 2003. Opacity light fields: Interactive rendering of surface light fields with view-dependent opacity. In Symposium on Interactive 3D Graphics (i3D), 65–74. Google Scholar
31. Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., An-tunez, E., Barth, A., Adams, A., Horowitz, M., and Levoy, M. 2005. High performance imaging using large camera arrays. ACM Trans. Graph. 24, 3, 765–776. Google ScholarDigital Library
32. Wood, D., Azuma, D., Aldinger, K., Curless, B., Duchamp, T., Salesin, D., and Stuetzle, W. 2000. Surface light fields for 3d photography. In SIGGRAPH, 287–296. Google Scholar
33. Yamazaki, S., Narasimhan, S. G., Baker, S., and Kanade, T. 2007. Coplanar shadowgrams for acquiring visual hulls of intricate objects. In ICCV, 1–8.Google Scholar
34. Zhou, K., Hu, Y., Lin, S., Guo, B., and Shum, H.-Y. 2005. Precomputed shadow fields for dynamic scenes. ACM Trans. Graph. 24, 3, 1196–1201. Google ScholarDigital Library
35. Zwicker, M., Matusik, W., Durand, F., and Pfister, H. 2006. Antialiasing for automultiscopic displays. In EGSR, 1–10. Google Scholar
