“Epipolar time-of-flight imaging” by Achar, Bartels, Whittaker, Kutulakos and Narasimhan

  • ©

Conference:


Type(s):


Title:

    Epipolar time-of-flight imaging

Session/Category Title:   Imaginative Imaging

Presenter(s)/Author(s):


Moderator(s):


Abstract:


    Consumer time-of-flight depth cameras like Kinect and PMD are cheap, compact and produce video-rate depth maps in short-range applications. In this paper we apply energy-efficient epipolar imaging to the ToF domain to significantly expand the versatility of these sensors: we demonstrate live 3D imaging at over 15 m range outdoors in bright sunlight; robustness to global transport effects such as specular and diffuse inter-reflections—the first live demonstration for this ToF technology; interference-free 3D imaging in the presence of many ToF sensors, even when they are all operating at the same optical wavelength and modulation frequency; and blur-free, distortion-free 3D video in the presence of severe camera shake. We believe these achievements can make such cheap ToF devices broadly applicable in consumer and robotics domains.

References:


    1. Hatem Alismail, L Douglas Baker, and Brett Browning. 2014. Continuous trajectory estimation for 3D SLAM from actuated lidar. In 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 6096–6101. Google ScholarCross Ref
    2. American National Standards Institute. 2014. American National Standard for Safe Use of Lasers Z136.1. Laser Institute of America.Google Scholar
    3. Simon Baker, Eric Bennett, Sing Bing Kang, and Richard Szeliski. 2010. Removing rolling shutter wobble. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on. IEEE, 2392–2399. Google ScholarCross Ref
    4. Oliver S Cossairt, Nathan Matsuda, and Mohit Gupta. 2015. Motion Contrast 3D Scanning. In Computational Optical Sensing and Imaging. Optical Society of America, CT2E-1.Google Scholar
    5. A. A. Dorrington, J. P. Godbaz, M. J. Cree, A. D. Payne, and L. V. Streeter. 2011. Separating true range measurements from multi-path and scattering interference in commercial range cameras. (2011). Google ScholarCross Ref
    6. Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T Roweis, and William T Freeman. 2006. Removing camera shake from a single photograph. In ACM Transactions on Graphics (TOG), Vol. 25. ACM, 787–794.Google ScholarDigital Library
    7. Mohit Gupta, Shree K. Nayar, Matthias B. Hullin, and Jaime Martín. 2015. Phasor Imaging: A Generalization Of Correlation-Based Time-of-Flight Imaging. ACM Transactions on Graphics 34 (2015). Google ScholarDigital Library
    8. Mohit Gupta, Qi Yin, and Shree K Nayar. 2013. Structured Light In Sunlight. International Conference on Computer Vision (2013).Google Scholar
    9. Felix Heide, Lei Xiao, Andreas Kolb, Matthias B. Hullin, and Wolfgang Heidrich. 2014. Imaging in scattering media using correlation image sensors and sparse convolutional coding. Opt. Express 22, 21 (Oct 2014), 26338–26350. Google ScholarCross Ref
    10. Achuta Kadambi, Refael Whyte, Ayush Bhandari, Lee Streeter, Christopher Barsi, Adrian Dorrington, and Ramesh Raskar. 2013. Coded Time of Flight Cameras: Sparse Deconvolution to Address Multipath Interference and Recover Time Profiles. ACM Trans. Graph. 32, 6, Article 167 (Nov. 2013), 10 pages. Google ScholarDigital Library
    11. C. Kerl, J. Stueckler, and D. Cremers. 2015. Dense Continuous-Time Tracking and Mapping with Rolling Shutter RGB-D Cameras. In ICCV. Santiago, Chile.Google Scholar
    12. Robert Lange and Peter Seitz. 2001. Solid-state time-of-flight range camera. IEEE Journal of quantum electronics 37, 3 (2001), 390–397. Google ScholarCross Ref
    13. Christoph Mertz, Sanjeev J Koppal, Solomon Sia, and Srinivasa Narasimhan. 2012. A low-power structured light sensor for outdoor scene reconstruction and dominant material identification. In 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. IEEE, 15–22. Google ScholarCross Ref
    14. Thierry Oggier, Rolf Kaufmann, Michael Lehmann, Bernhard Buttgen, Simon Neukom, Michael Richter, Matthias Schweizer, Peter Metzler, Felix Lustenberger, and Nicolas Blanc. 2005. Novel pixel architecture with inherent background suppression for 3D time-of-flight imaging. In Electronic Imaging 2005. International Society for Optics and Photonics, 1–8. Google ScholarCross Ref
    15. Matthew O’Toole, Supreeth Achar, Srinivasa G. Narasimhan, and Kiriakos N. Kutulakos. 2015. Homogeneous Codes for Energy-efficient Illumination and Imaging. ACM Trans. Graph. 34, 4, Article 35 (July 2015), 13 pages. Google ScholarDigital Library
    16. Matthew O’Toole, Felix Heide, Lei Xiao, Matthias B. Hullin, Wolfgang Heidrich, and Kiriakos N. Kutulakos. 2014a. Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport. ACM Trans. Graph. 33, 4, Article 87 (July 2014), 11 pages. Google ScholarDigital Library
    17. Matthew O’Toole, John Mather, and Kiriakos N Kutulakos. 2014b. 3d shape and indirect appearance by structured light transport. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3246–3253. Google ScholarDigital Library
    18. S. Shrestha, F. Heide, W. Heidrich, and G. Wetzstein. 2016. Computational Imaging with Multi-Camera Time-of-Flight Systems. ACM Trans. Graph. (SIGGRAPH) (2016).Google Scholar

ACM Digital Library Publication:


Overview Page: