“3DCrewCap: Applying 3D Volumetric video capture for XR helicopter rescue crew training and simulation.” by McGhee, Bourke, Lawther, Zhou and Petersen
Conference:
Type(s):
Title:
- 3DCrewCap: Applying 3D Volumetric video capture for XR helicopter rescue crew training and simulation.
Session/Category Title: Images, Video & Computer Vision
Presenter(s)/Author(s):
Abstract:
In this research, we present a practical early-stage development of 3D volumetric video capture and playback workflow for use in helicopter rescue crew training on XR HMDs. We break down the workflow of using Gaussian Splat approach to construct keyframed 3D animated models of the rescue crew training actions.
References:
[1]
Capturing Reality s.r.o. (2023). RealityCapture (Version 1.3) [Software]. https://www.capturingreality.com
[2]
Hackett, M., Makled, B., Mizroch, E., Venshtain, S., & Mccoy-Thompson, M. (2022). Volumetric video and mixed reality for healthcare training. Paper presented at the Interservice/Industry Training, Simulation, and Education Conference. IMX.
[3]
Kerbl, B., Kopanas, G., Leimk?hler, T., & Drettakis, G. (2023). 3d gaussian splatting for real-time radiance field rendering. ACM Transactions on Graphics, 42(4), 1-14.
[4]
Kocabas, M., Chang, J.-H. R., Gabriel, J., Tuzel, O., & Ranjan, A. (2023). Hugs: Human gaussian splats. arXiv preprint arXiv:2311.17910.
[5]
Lin, Y., Dai, Z., Zhu, S., & Yao, Y. (2023). Gaussian-flow: 4d reconstruction with dynamic 3d gaussian particle. arXiv preprint arXiv:2312.03431.
[6]
O’Dwyer, N., Young, G. W., Johnson, N., Zerman, E., & Smolic, A. (2020). Mixed reality and volumetric video in cultural heritage: Expert opinions on augmented and virtual reality. Paper presented at the International conference on human-computer interaction.
[7]
Stevens, J., Ortiz, E., Reinerman-Jones, L., & Maxwell, D. (2015). Approach to examine efficacy of game-based and virtual simulation training. Paper presented at the Proceedings of the Conference on Summer Computer Simulation.
[8]
Stone, R. J. (2012). Human factors guidance for designers of interactive 3D and games-based training systems. Human Factors Integration Defence Technology Centre Booklet.
[9]
Sun, X., Liu, H., Tian, Y., Wu, G., & Gao, Y. (2020). Team effectiveness evaluation and virtual reality scenario mapping model for helicopter emergency rescue. Chinese Journal of Aeronautics, 33(12), 3306-3317
