“MegaParallax: 360° Panoramas with Motion Parallax” by Bertel and Richardt

  • ©Tobias Bertel and Christian Richardt

Conference:


Type:


Entry Number: 38

Title:

    MegaParallax: 360° Panoramas with Motion Parallax

Presenter(s)/Author(s):


Abstract:


    Capturing 360° panoramas has become straightforward now that this functionality is implemented on every phone. However, it remains difficult to capture immersive 360° panoramas with motion parallax, which provide different views for different viewpoints. Alternatives such as omnidirectional stereo panoramas provide different views for each eye (binocular disparity), but do not support motion parallax, while Casual 3D Photography [Hedman et al. 2017] reconstructs textured 3D geometry that provides motion parallax but suffers from reconstruction artefacts. We propose a new image-based approach for capturing and rendering high-quality 360° panoramas with motion parallax. We use novel-view synthesis with flow-based blending to turn a standard monoscopic video into an enriched 360° panoramic experience that can be explored in real time. Our approach makes it possible for casual consumers to capture and view high-quality 360° panoramas with motion parallax.

References:


    • Chris Buehler, Michael Bosse, Leonard McMillan, Steven Gortler, and Michael Cohen. 2001. Unstructured Lumigraph Rendering. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH). 425–432. https: //doi.org/10.1145/383259.383309 
    • Abe Davis, Marc Levoy, and Fredo Durand. 2012. Unstructured Light Fields. Computer Graphics Forum (Proceedings of Eurographics) 31, 2 (May 2012), 305–314. https: //doi.org/10.1111/j.1467-8659.2012.03009.x 
    • Peter Hedman, Suhib Alsisan, Richard Szeliski, and Johannes Kopf. 2017. Casual 3D Photography. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 36, 6 (November 2017), 234:1–15. https://doi.org/10.1145/3130800.3130828
    • Bicheng Luo, Feng Xu, Christian Richardt, and Jun-Hai Yong. 2018. Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax. IEEE Transactions on Visualization and Computer Graphics 24, 4 (April 2018), 1545–1553. https: //doi.org/10.1109/TVCG.2018.2794071 
    • Christian Richardt, Yael Pritch, Henning Zimmer, and Alexander Sorkine-Hornung. 2013. Megastereo: Constructing High-Resolution Stereo Panoramas. In Proceedings of the International Conference on Computer Vision and Pattern Recognition (CVPR). 1256–1263. https://doi.org/10.1109/CVPR.2013.166

Keyword(s):


Acknowledgements:


    This work was supported by EU Horizon 2020 MSCA grant FIRE (665992), the EPSRC Centre for Doctoral Training in Digital Entertainment (EP/L016540/1), RCUK grant CAMERA (EP/M023281/1), a Rabin Ezra Scholarship and an NVIDIA Corporation GPU Grant. 

     

PDF:


ACM Digital Library Publication:


Overview Page: