“Neural Volumetric Reconstruction for Coherent Synthetic Aperture Sonar” by Reed, Kim, Blanford, Pediredla, Brown, et al. …
Conference:
Type(s):
Title:
- Neural Volumetric Reconstruction for Coherent Synthetic Aperture Sonar
Session/Category Title: Fabrication-Oriented Design
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Synthetic aperture sonar (SAS) measures a scene from multiple views in order to increase the resolution of reconstructed imagery. Image reconstruction methods for SAS coherently combine measurements to focus acoustic energy onto the scene. However, image formation is typically under-constrained due to a limited number of measurements and bandlimited hardware, which limits the capabilities of existing reconstruction methods. To help meet these challenges, we design an analysis-by-synthesis optimization that leverages recent advances in neural rendering to perform coherent SAS imaging. Our optimization enables us to incorporate physics-based constraints and scene priors into the image formation process. We validate our method on simulation and experimental results captured in both air and water. We demonstrate both quantitatively and qualitatively that our method typically produces superior reconstructions than existing approaches. We share code and data for reproducibility.
References:
1. Byeongjoo Ahn, Akshat Dave, Ashok Veeraraghavan, Ioannis Gkioulekas, and Aswin C Sankaranarayanan. 2019. Convolutional approximations to the general non-line-of-sight imaging operator. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 7889–7899.
2. Miad Al Mursaline, Timothy K Stanton, Andone C Lavery, and Erin M Fischell. 2021. Acoustic scattering by elastic cylinders: Practical sonar effects. The Journal of the Acoustical Society of America 150, 4 (2021), A327–A327.
3. Victor Arellano, Diego Gutierrez, and Adrian Jarabo. 2017. Fast back-projection for non-line of sight reconstruction. In ACM SIGGRAPH 2017 Posters. 1–2.
4. Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin, and Matthew O’Toole. 2021. TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis. Advances in Neural Information Processing Systems 34 (2021).
5. Richard Bamler. 1992. A comparison of range-Doppler and wavenumber domain SAR focusing algorithms. IEEE Transactions on Geoscience and Remote Sensing 30, 4 (1992), 706–713.
6. Andrea Bellettini and Marc Pinto. 2008. Design and experimental results of a 300-kHz synthetic aperture sonar optimized for shallow-water operations. IEEE Journal of Oceanic Engineering 34, 3 (2008), 285–293.
7. Mario Bertero, Patrizia Boccacci, and Christine De Mol. 2021. Introduction to inverse problems in imaging. CRC Press.
8. Junguo Bian, Jeffrey H Siewerdsen, Xiao Han, Emil Y Sidky, Jerry L Prince, Charles A Pelizzari, and Xiaochuan Pan. 2010. Evaluation of sparse-view reconstruction from flat-panel-detector cone-beam CT. Physics in Medicine & Biology 55, 22 (2010), 6575.
9. Thomas E Blanford, Luke Garrett, J Daniel Park, and Daniel C Brown. 2022. Leveraging audio hardware for underwater acoustics experiments. In Proceedings of Meetings on Acoustics 182ASA, Vol. 46. Acoustical Society of America, 030002.
10. Thomas E. Blanford, John D. McKay, Daniel C. Brown, Joonho D. Park, and Shawn F. Johnson. 2019. Development of an in-air circular synthetic aperture sonar system as an educational tool. 177th Meeting of the Acoustical Society of America 36, 070002.
11. Gunilla Borgefors. 1986. Distance transformations in digital images. Computer Vision, Graphics, and Image Processing 34, 3 (1986), 344–371.
12. Charles A Bouman. 2022. Foundations of Computational Imaging: A Model-Based Approach. SIAM.
13. Ronald Newbold Bracewell. 1986. The Fourier transform and its applications. McGraw-Hill New York.
14. Daniel C Brown. 2017. Modeling and measurement of spatial coherence for normal incidence seafloor scattering. Ph. D. Dissertation. The Pennsylvania State University.
15. Daniel C Brown, Isaac D Gerg, and Thomas E Blanford. 2019a. Interpolation kernels for synthetic aperture sonar along-track motion estimation. IEEE Journal of Oceanic Engineering 45, 4 (2019), 1497–1505.
16. Daniel C Brown, Shawn Johnson, Caleb Brownstead, Joeseph Calantoni, and Gene Fabian. 2021. Sediment Volume Search Sonar Development. Technical Report. https://serdp-estcp.org/projects/details/97e4a43c-bb65-432d-94ba-6aaff361571a
17. Daniel C Brown, Shawn F Johnson, Isaac D Gerg, and Cale F Brownstead. 2019b. Simulation and testing results for a sub-bottom ieee. In Proceedings of Meetings on Acoustics 177ASA, Vol. 36. Acoustical Society of America, 070001.
18. Daniel C Brown, Shawn F Johnson, and Derek R Olson. 2017. A point-based scattering model for the incoherent component of the scattered field. The Journal of the Acoustical Society of America 141, 3 (2017), EL210–EL215.
19. Clara Callenberg, Zheng Shi, Felix Heide, and Matthias B Hullin. 2021. Low-cost SPAD sensing for non-line-of-sight tracking, material classification and depth imaging. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1–12.
20. Hayden J Callow. 2003. Signal Processing for Synthetic Aperture Sonar Image Enhancement. Ph. D. Dissertation. University of Canterbury.
21. Hayden J Callow, Roy E Hansen, and TO Saebo. 2006. Effect of approximations in fast factorized backprojection in synthetic aperture imaging of spot regions. In OCEANS 2006. IEEE, 1–6.
22. Hayden J Callow, Michael P Hayes, and Peter T Gough. 2009. Motion-compensation improvement for widebeam, multiple-receiver SAS systems. IEEE Journal of Oceanic Engineering 34, 3 (2009), 262–268.
23. Chunxiao Cao, Zhong Ren, Carl Schissler, Dinesh Manocha, and Kun Zhou. 2016. Interactive sound propagation with bidirectional path tracing. ACM Transactions on Graphics (TOG) 35, 6 (2016), 1–11.
24. Yuan Cao, Zhiying Fang, Yue Wu, Ding-Xuan Zhou, and Quanquan Gu. 2019. Towards understanding the spectral bias of deep learning. arXiv preprint arXiv:1912.01198 (2019).
25. Jeffrey N Chadwick, Steven S An, and Doug L James. 2009. Harmonic shells: a practical nonlinear sound model for near-rigid thin shells. ACM Transactions on Graphics 28, 5 (2009), 1–119.
26. Jeffrey N Chadwick and Doug L James. 2011. Animating fire with sound. ACM Transactions on Graphics (TOG) 30, 4 (2011), 1–8.
27. Fabien Chaillan, Christophe Fraschini, and Philippe Courmontagne. 2007. Speckle noise reduction in SAS imagery. Signal Processing 87, 4 (2007), 762–781.
28. Chakravarty R. Alla Chaitanya, Nikunj Raghuvanshi, Keith W. Godin, Zechen Zhang, Derek Nowrouzezahrai, and John M. Snyder. 2020. Directional Sources and Listeners in Interactive Sound Propagation Using Reciprocal Wave Field Coding. ACM Trans. Graph. 39, 4, Article 44 (7 2020), 14 pages.
29. Sreenithy Chandran and Suren Jayasuriya. 2019. Adaptive Lighting for Data-Driven Non-Line-of-Sight 3D Localization and Object Identification. In 30th British Machine Vision Conference 2019, BMVC 2019, Cardiff, UK, September 9–12, 2019. BMVA Press, 155. https://bmvc2019.org/wp-content/uploads/papers/0723-paper.pdf
30. Wenzheng Chen, Simon Daneau, Fahim Mannan, and Felix Heide. 2019. Steady-state non-line-of-sight imaging. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6790–6799.
31. Daniel A Cook. 2007. Synthetic aperture sonar motion estimation and compensation. Ph. D. Dissertation. Georgia Institute of Technology.
32. Daniel A Cook and Daniel C Brown. 2008. Analysis of phase error effects on stripmap SAS. IEEE Journal of Oceanic Engineering 34, 3 (2008), 250–261.
33. Benjamin Cowen, J Daniel Park, Thomas E Blanford, Geoff Goehle, and Daniel C Brown. 2021. AirSAS: Controlled Dataset Generation for Physics-Informed Machine Learning. In NeurIPS Data-Centric AI Workshop.
34. Philippe de Heering, Klaus Uwe Simmer, Ezackiel Ochieng-Ogolla, and Alexander Wasiljeff. 1994. A Deconvolution Algorithm for Broadband Synthetic Aperture Data Processing. IEEE Journal of Oceanic Engineering 19 (1994), 73–83. Issue 1.
35. Jerry Eaves and Edward Reedy. 2012. Principles of modern radar. Springer Science & Business Media.
36. Brian G Ferguson and Ron J Wyber. 2005. Application of acoustic reflection tomography to sonar imaging. The Journal of the Acoustical Society of America 117, 5 (2005), 2915–2928.
37. Brian G Ferguson and Ron J Wyber. 2009. Generalized framework for real aperture, synthetic aperture, and tomographic sonar imaging. IEEE Journal of Oceanic Engineering 34, 3 (2009), 225–238.
38. JR Fienup. 2000. Synthetic-aperture radar autofocus by maximizing sharpness. Optics letters 25, 4 (2000), 221–223.
39. SA Fortune, MP Hayes, and PT Gough. 2001. Statistical autofocus of synthetic aperture sonar images using image contrast optimisation. In MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No. 01CH37295), Vol. 1. IEEE, 163–169.
40. Fridovich-Keil and Yu, Matthew Tancik, Qinhong Chen, Benjamin Recht, and Angjoo Kanazawa. 2022. Plenoxels: Radiance Fields without Neural Networks. In CVPR.
41. Isaac Gerg and Vishal Monga. 2020. Deep Autofocus for Synthetic Aperture Sonar. arXiv preprint arXiv:2010.15687 (2020).
42. Isaac D Gerg, Daniel C Brown, Stephen G Wagner, Daniel Cook, Brian N O’Donnell, Thomas Benson, and Thomas C Montgomery. 2020. GPU Acceleration for Synthetic Aperture Sonar Image Reconstruction. In Global Oceans 2020: Singapore-US Gulf Coast. IEEE, 1–9.
43. Isaac D Gerg and Vishal Monga. 2021. Real-Time, Deep Synthetic Aperture Sonar (SAS) Autofocus. In 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS. IEEE, 8684–8687.
44. Geoff Goehle, Benjamin Cowen, Thomas E Blanford, J Daniel Park, and Daniel C Brown. 2022. Approximate extraction of late-time returns via morphological component analysis. arXiv preprint arXiv:2208.06056 (2022).
45. Peter T Gough and David W Hawkins. 1997a. Imaging algorithms for a strip-map synthetic aperture sonar: Minimizing the effects of aperture errors and aperture undersampling. IEEE Journal of Oceanic Engineering 22, 1 (1997), 27–39.
46. Peter T Gough and David W Hawkins. 1997b. Unified framework for modern synthetic aperture imaging algorithms. International Journal of Imaging Systems and Technology 8, 4 (1997), 343–358.
47. HD Griffiths, TA Rafik, Z Meng, CFN Cowan, H Shafeeu, and DK Anthony. 1997. Interferometric synthetic aperture sonar for high-resolution 3-D mapping of the seabed. IEE Proceedings-Radar, Sonar and Navigation 144, 2 (1997), 96–103.
48. Sana Gul, S Sajjad Haider Zaidi, Rehan Khan, and Ammar Banduk Wala. 2017. Underwater acoustic channel modeling using BELLHOP ray tracing method. In 2017 14th International Bhurban Conference on Applied Sciences and Technology (IBCAST). IEEE, 665–670.
49. Brian Hamilton, Stefan Bilbao, Brian Hamilton, and Stefan Bilbao. 2017. FDTD Methods for 3-D Room Acoustics Simulation With High-Order Accuracy in Space and Time. IEEE/ACM Trans. Audio, Speech and Lang. Proc. 25, 11 (11 2017), 2112–2124.
50. Roy Edgar Hansen, Hayden John Callow, Torstein Olsmo Sabo, and Stig Asle Vaksvik Synnes. 2011. Challenges in seafloor imaging and mapping with synthetic aperture sonar. IEEE Transactions on Geoscience and Remote Sensing 49, 10 (2011), 3677–3687.
51. Roy Edgar Hansen, Torstien Olsom Saebo, Kenneth Gade, and Sean Chapman. 2003. Signal processing for AUV based interferometric synthetic aperture sonar. IEEE Oceans 2003 5 (2003), 2438–2444.
52. Lee Andrew Andy Harrison. 2019. Introduction to Radar using Python and MATLAB. Artech House.
53. David William Hawkins. 1996. Synthetic aperture imaging algorithms: with application to wide bandwidth sonar. Ph. D. Dissertation. University of Canterbury.
54. Michael P Hayes and Peter T Gough. 1992. Broad-band synthetic aperture sonar. IEEE Journal of Oceanic Engineering 17, 1 (1992), 80–94.
55. Michael P Hayes and Peter T Gough. 2009. Synthetic aperture sonar: A review of current status. IEEE Journal of Oceanic Engineering 34, 3 (2009), 207–224.
56. Felix Heide, Matthias B Hullin, James Gregson, and Wolfgang Heidrich. 2013. Low-budget transient imaging using photonic mixer devices. ACM Transactions on Graphics (ToG) 32, 4 (2013), 1–10.
57. Julian Iseringhausen and Matthias B Hullin. 2020. Non-line-of-sight reconstruction using efficient transient rendering. ACM Transactions on Graphics (ToG) 39, 1 (2020), 1–14.
58. Jørgen Arendt Jensen, Svetoslav Ivanov Nikolov, Kim Løkke Gammelmark, and Morten Høgholm Pedersen. 2006. Synthetic aperture ultrasound imaging. Ultrasonics 44 (2006), e5–e15.
59. Shawn F Johnson and Daniel C Brown. 2018. SAS simulations with procedural texture and the point-based sonar scattering model. In OCEANS 2018 MTS/IEEE Charleston. IEEE, 1–7.
60. Achuta Kadambi, Refael Whyte, Ayush Bhandari, Lee Streeter, Christopher Barsi, Adrian Dorrington, and Ramesh Raskar. 2013. Coded time of flight cameras: sparse deconvolution to address multipath interference and recover time profiles. ACM Transactions on Graphics (ToG) 32, 6 (2013), 1–10.
61. Achuta Kadambi, Hang Zhao, Boxin Shi, and Ramesh Raskar. 2016. Occluded imaging with time-of-flight sensors. ACM Transactions on Graphics (ToG) 35, 2 (2016), 1–12.
62. Jari P Kaipio and Erkki Somersalo. 2004. Computational and statistical methods for inverse problems. Applied Mathematical Sciences 160 (2004).
63. Juhyeon Kim and Young Min Kim. 2021. Fast and Lightweight Path Guiding Algorithm on GPU. In Pacific Graphics Short Papers, Posters, and Work-in-Progress Papers, Sung-Hee Lee, Stefanie Zollmann, Makoto Okabe, and Burkhard Wünsche (Eds.). The Eurographics Association.
64. Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
65. Johann Heinrich Lambert. 1760. Photometria sive de mensura et gradibus luminis, colorum et umbrae. sumptibus vidvae E. Klett, typis CP Detleffsen.
66. André Lannes, Eric Anterrieu, and Pierre Maréchal. 1997. Clean and wipe. Astronomy and Astrophysics Supplement Series 123, 1 (1997), 183–198.
67. Marc Levoy and Pat Hanrahan. 1996. Light field rendering. Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (1996), 31–42.
68. David B Lindell, Gordon Wetzstein, and Vladlen Koltun. 2019a. Acoustic non-line-of-sight imaging. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6780–6789.
69. David B Lindell, Gordon Wetzstein, and Matthew O’Toole. 2019b. Wave-based non-line-of-sight imaging using fast fk migration. ACM Transactions on Graphics (ToG) 38, 4 (2019), 1–13.
70. Shiguang Liu and Dinesh Manocha. 2020. Sound synthesis, propagation, and rendering: a survey. arXiv preprint arXiv:2011.05538 (2020).
71. Xiaochun Liu, Ibón Guillén, Marco La Manna, Ji Hyun Nam, Syed Azer Reza, Toan Huu Le, Adrian Jarabo, Diego Gutierrez, and Andreas Velten. 2019. Non-line-of-sight imaging using phasor-field virtual wave optics. Nature 572, 7771 (2019), 620–623.
72. Alice Lucas, Michael Iliadis, Rafael Molina, and Aggelos K Katsaggelos. 2018. Using deep neural networks for inverse problems in imaging: beyond analytical methods. IEEE Signal Processing Magazine 35, 1 (2018), 20–36.
73. Hassan Mansour, Dehong Liu, Ulugbek S. Kamilov, and Petros T. Boufounos. 2018. Sparse Blind Deconvolution for Distributed Radar Autofocus Imaging. (5 2018). http://arxiv.org/abs/1805.03269
74. Timothy M Marston and Jermaine L Kennedy. 2016. Volumetric acoustic imaging via circular multipass aperture synthesis. IEEE Journal of Oceanic Engineering 41, 4 (2016), 852–867.
75. Timothy M Marston, Jermaine L Kennedy, and Philip L Marston. 2011. Coherent and semi-coherent processing of limited-aperture circular synthetic aperture (CSAS) data. In OCEANS’11 MTS/IEEE KONA. IEEE, 1–6.
76. Timothy M Marston, Jermaine L Kennedy, and Philip L Marston. 2014. Autofocusing circular synthetic aperture sonar imagery using phase corrections modeled as generalized cones. The Journal of the Acoustical Society of America 136, 2 (2014), 614–622.
77. Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. 2021. Nerf: Representing scenes as neural radiance fields for view synthesis. Commun. ACM 65, 1 (2021), 99–106.
78. Thomas Müller, Alex Evans, Christoph Schied, and Alexander Keller. 2022. Instant Neural Graphics Primitives with a Multiresolution Hash Encoding. ACM Trans. Graph. 41, 4, Article 102 (July 2022), 15 pages.
79. Nahid Nadimi, Reza Javidan, and Kamran Layeghi. 2021. Efficient Detection of Underwater Natural Gas Pipeline Leak Based on Synthetic Aperture Sonar (SAS) Systems. Journal of Marine Science and Engineering 9, 11 (2021), 1273.
80. Matthew O’Toole, Felix Heide, David B Lindell, Kai Zang, Steven Diamond, and Gordon Wetzstein. 2017. Reconstructing transient images from single-photon sensors. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1539–1547.
81. Yan Pailhas, Yvan Petillot, and Bernard Mulgrew. 2017. Increasing circular synthetic aperture sonar resolution via adapted wave atoms deconvolution. The Journal of the Acoustical Society of America 141 (4 2017), 2623–2632. Issue 4.
82. J Daniel Park, Thomas E Blanford, Daniel C Brown, and Daniel Plotnick. 2020. Alternative representations and object classification of circular synthetic aperture in-air acoustic data. The Journal of the Acoustical Society of America 148, 4 (2020), 2661–2661.
83. Adithya Pediredla, Ashok Veeraraghavan, and Ioannis Gkioulekas. 2019. Ellipsoidal path connections for time-gated rendering. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1–12.
84. A. D. Pierce. 1981. Acoustics: An introduction to its physical principles and applications. (1981), 486–487.
85. John E Piper, Kerry W Commander, Eric I Thorsos, and Kevin L Williams. 2002. Detection of buried targets using a synthetic aperture sonar. IEEE Journal of Oceanic Engineering 27, 3 (2002), 495–504.
86. Markus Plack, Clara Callenberg, Monika Schneider, and Matthias B Hullin. 2023. Fast Differentiable Transient Rendering for Non-Line-of-Sight Reconstruction. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 3067–3076.
87. Daniel S Plotnick, Philip L Marston, and Timothy M Marston. 2014. Fast nearfield to farfield conversion algorithm for circular synthetic aperture sonar. The Journal of the Acoustical Society of America 136, 2 (2014), EL61–EL66.
88. Ben Poole, Ajay Jain, Jonathan T. Barron, and Ben Mildenhall. 2022. DreamFusion: Text-to-3D using 2D Diffusion. arXiv (2022).
89. Easton Potokar, Spencer Ashford, Michael Kaess, and Joshua G Mangelson. 2022. HoloOcean: An underwater robotics simulator. In 2022 International Conference on Robotics and Automation (ICRA). IEEE, 3040–3046.
90. Angela Putney and Richard H. Anderson. 2005. Reconstruction of under-sampled SAS data using the WIPE algorithm. Proceedings of MTS/IEEE OCEANS, 2005 2005, 111–118.
91. M. Qadri, M. Kaess, and I. Gkioulekas. 2023. Neural Implicit Surface Reconstruction using Imaging Sonar. In Proc. IEEE Intl. Conf. on Robotics and Automation, ICRA. London, UK. To appear.
92. Nikunj Raghuvanshi and John Snyder. 2014. Parametric Wave Field Coding for Precomputed Sound Propagation. ACM Trans. Graph. 33, 4, Article 38 (7 2014), 11 pages.
93. Nikunj Raghuvanshi, John Snyder, Ravish Mehra, Ming Lin, and Naga Govindaraju. 2010. Precomputed Wave Simulation for Real-Time Sound Propagation of Dynamic Sources in Complex Scenes. ACM Trans. Graph. 29, 4, Article 68 (7 2010), 11 pages.
94. Ravi Ramamoorthi and Pat Hanrahan. 2001. A signal-processing framework for inverse rendering. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. 117–128.
95. Albert Reed, Thomas Blanford, Daniel C. Brown, and Suren Jayasuriya. 2021a. Implicit Neural Representations for Deconvolving SAS Images. In OCEANS 2021: San Diego – Porto. 1–7.
96. Albert Reed, Thomas Blanford, Daniel C. Brown, and Suren Jayasuriya. 2022. SINR: Deconvolving Circular SAS Images Using Implicit Neural Representations. IEEE Journal of Selected Topics in Signal Processing (2022), 1–16.
97. Albert Reed, Isaac D Gerg, John D McKay, Daniel C Brown, David P Williamsk, and Suren Jayasuriya. 2019. Coupling rendering and generative adversarial networks for artificial SAS image generation. In OCEANS 2019 MTS/IEEE SEATTLE. IEEE, 1–10.
98. Albert W. Reed, Hyojin Kim, Rushil Anirudh, K. Aditya Mohan, Kyle Champley, Jingu Kang, and Suren Jayasuriya. 2021b. Dynamic CT Reconstruction from Limited Views with Implicit Neural Representations and Parametric Motion Fields. 2021 IEEE/CVF International Conference on Computer Vision (ICCV) (2021), 2238–2248.
99. Darius Rückert, Yuanhao Wang, Rui Li, Ramzi Idoughi, and Wolfgang Heidrich. 2022. NeAT: Neural Adaptive Tomography. ACM Transactions on Graphics (2022).
100. G.S. Sammelmann. 2001. Propagation and scattering in very shallow water. In MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No.01CH37295), Vol. 1. 337–344 vol.1.
101. Lauri Savioja and U Peter Svensson. 2015. Overview of geometrical room acoustic modeling techniques. The Journal of the Acoustical Society of America 138, 2 (2015), 708–730.
102. Carl Schissler, Ravish Mehra, and Dinesh Manocha. 2014. High-Order Diffraction and Diffuse Reflections for Interactive Sound Propagation in Large Environments. ACM Trans. Graph. 33, 4, Article 39 (7 2014), 12 pages.
103. Eston Schweickart, Doug L James, and Steve Marschner. 2017. Animating elastic rods with sound. ACM Transactions on Graphics (TOG) 36, 4 (2017), 1–10.
104. Siyuan Shen, Zi Wang, Ping Liu, Zhengqing Pan, Ruiqian Li, Tian Gao, Shiying Li, and Jingyi Yu. 2021. Non-line-of-Sight Imaging via Neural Transient Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021).
105. Samuel Siltanen, Tapio Lokki, Sami Kiminki, and Lauri Savioja. 2007. The room acoustic rendering equation. The Journal of the Acoustical Society of America 122, 3 (2007), 1624–1635.
106. Steven W Smith. 1997. The scientist and engineer’s guide to digital signal processing. California Technical Pub. San Diego.
107. Mehrdad Soumekh. 1999. Synthetic aperture radar signal processing. Vol. 7. New York: Wiley.
108. Øystein Sture, Martin Ludvigsen, Margrete S Scheide, and Terje Thorsnes. 2018. Recognition of cold-water corals in synthetic aperture sonar imagery. In 2018 IEEE/OES Autonomous Underwater Vehicle Workshop (AUV). IEEE, 1–6.
109. Gang Sun and Shuyue Wang. 2019. A review of the artificial neural network surrogate modeling in aerodynamic design. Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering 233, 16 (2019), 5863–5872.
110. Yu Sun, Jiaming Liu, Mingyang Xie, Brendt Wohlberg, and Ulugbek S Kamilov. 2022. Coil: Coordinate-based internal learning for imaging inverse problems. IEEE Transactions on Computational Imaging (2022).
111. Andreas Velten, Thomas Willwacher, Otkrist Gupta, Ashok Veeraraghavan, Moungi G Bawendi, and Ramesh Raskar. 2012. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature Communications 3, 1 (2012), 745.
112. J.W. Wallis, T.R. Miller, C.A. Lerner, and E.C. Kleerup. 1989. Three-Dimensional Display in Nuclear Medicine. IEEE Trans. Med. Imag. 8, 4 (Dec. 1989), 297–303.
113. Jui-Hsien Wang, Ante Qu, Timothy R Langlois, and Doug L James. 2018. Toward wave-based sound synthesis for computer animation. ACM Trans. Graph. 37, 4 (2018), 109–1.
114. David P Williams. 2016. Underwater target classification in synthetic aperture sonar imagery using deep convolutional neural networks. In 2016 23rd International Conference on Pattern Recognition (ICPR). IEEE, 2497–2502.
115. Denton Woods. 2020. Ray-based methods in PC SWAT. The Journal of the Acoustical Society of America 148, 4 (2020), 2796–2796.
116. Lifan Wu, Guangyan Cai, Ravi Ramamoorthi, and Shuang Zhao. 2021. Differentiable time-gated rendering. ACM Transactions on Graphics (TOG) 40, 6 (2021), 1–16.
117. Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, and Srinath Sridhar. 2022. Neural fields in visual computing and beyond. In Computer Graphics Forum, Vol. 41. Wiley Online Library, 641–676.
118. Shinyoung Yi, Donggun Kim, Kiseok Choi, Adrian Jarabo, Diego Gutierrez, and Min H Kim. 2021. Differentiable transient rendering. ACM Transactions on Graphics (TOG) 40, 6 (2021), 1–11.
119. Lian Yu, Nicola Neretti, and Nathan Intrator. 2006. Multiple ping sonar accuracy improvement using robust motion estimation and ping fusion. The Journal of the Acoustical Society of America 119, 4 (2006), 2106–2113.
120. Guangming Zang, Ramzi Idoughi, Rui Li, Peter Wonka, and Wolfgang Heidrich. 2021. IntraTomo: Self-supervised Learning-based Tomography via Sinogram Synthesis and Prediction. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 1960–1970.
121. Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang. 2018a. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 586–595.
122. Xiuming Zhang, Pratul P Srinivasan, Boyang Deng, Paul Debevec, William T Freeman, and Jonathan T Barron. 2021. Nerfactor: Neural factorization of shape and reflectance under an unknown illumination. ACM Transactions on Graphics (TOG) 40, 6 (2021), 1–18.
123. Zechen Zhang, Nikunj Raghuvanshi, John Snyder, and Steve Marschner. 2018b. Ambient sound propagation. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1–10.
124. Zechen Zhang, Nikunj Raghuvanshi, John Snyder, and Steve Marschner. 2019. Acoustic texture rendering for extended sources in complex scenes. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1–9.
125. Changxi Zheng and Doug L James. 2010. Rigid-body fracture sound with precomputed soundbanks. ACM SIGGRAPH 2010 papers (2010), 1–13.
Additional Images:
