“Video for Virtual Reality” by Tompkin, Halsey, Hertzmann, Starck and Wang
Conference:
Type:
Entry Number: 20
Title:
- Video for Virtual Reality
Course Organizer(s):
Presenter(s)/Author(s):
Abstract:
Prerequisites
Basic knowledge of video processing, computer graphics, and computer vision is useful, but other attendees will find the course engaging. The section on storytelling and tools, for example, will be accessible to all audiences.
Level
Intermediate
Intended Audience
Visual computing researchers, video producers, enthusiastic video users.
Description
Video captures the dynamic appearance of the real world, while virtual reality technology enables display of dynamic visual content with unparalleled realism and immersion. The fusion of video and virtual reality promises to enable many exciting photorealistic experiences. This course provides an overview of three aspects of this promising fusion: technical foundations, current systems in practice, and the potential for future systems of VR video.
The course begins with a review of the the geometric and optical problems underpinning VR video. Then it introduces 360-degree and stereoscopic video, and explains how 360 video is captured, analysed, and stitched, including the mathematics behind how state-of-the-art stereo 360 video is produced from camera systems and computational processing. It also discusses the art of storytelling in VR, and how new tools for editing VR video can aid in production. The final section focuses on the next generation of video for VR, which is moving to 6-degrees-of-freedom experiences. Topics include the basic principles and challenges of light-field cameras, how they can enable 6DoF experiences, and how light-field camera arrays have been used to create cutting-edge experiences that integrate volumetric live-action elements.
