“Live 6DoF Video Production with Stereo Camera” by Nakatani, Shinohara and Miyaki
Conference:
Experience Type(s):
Title:
- Live 6DoF Video Production with Stereo Camera
Presenter(s):
Description:
We propose a light-weight 6DoF video production pipeline which uses only one stereo camera as input. The subject can move freely in any direction (lateral and depth) as the stereo camera follows to keep the subject within the frame. DeepKeying, our own proprietary keying method based on deep learning, helps with ease of live shooting with no need for green screen. The live video stream is processed in real time to provide 6DoF video experience. Our method enables a sense of immersion at production quality.
References:
[1] T. Kanade, P. J. Narayanan, and P. W. Rander. 1995. Virtualized reality: concepts and early results. In Proceedings IEEE Workshop on Representation of Visual Scenes. IEEE, Cambridge, MA, USA, USA, 69–76.
[2] A. Serrano, I. Kim, Z. Chen, S. DiVerdi, D. Gutierrez, A. Hertzmann, and B. Masia. 2019. Motion parallax for 360° RGBD video. IEEE Transactions on Visualization and Computer Graphics (2019), 1817–1827.
