“Virtual video camera: image-based viewpoint navigation through space and time”
Conference:
Type(s):
Title:
- Virtual video camera: image-based viewpoint navigation through space and time
Abstract:
We present an image-based rendering system to viewpoint-navigate through space and time of complex real-world, dynamic scenes. Our approach accepts unsynchronized, uncalibrated multi-video footage as input. Inexpensive, consumer-grade camcorders suffice to acquire arbitrary scenes, e.g., in the outdoors, without elaborate recording setup procedures. Instead of scene depth estimation, layer segmentation, or 3D reconstruction, our approach is based on dense image correspondences, treating view interpolation uniformly in space and time: spatial viewpoint navigation, slow motion, and freeze-and-rotate effects can all be created in the same fashion. Acquisition simplification, generalization to difficult scenes, and space-time symmetric interpolation amount to a widely applicable Virtual Video Camera system.
References:
1. Chen, S. E., and Williams, L. 1993. View interpolation for image synthesis. In Proc. of ACM SIGGRAPH’93, ACM Press/ACM SIGGRAPH, New York, 279–288.
2. Goesele, M., Snavely, N., Curless, B., Hoppe, H., and Seitz, S. 2007. Multi-view stereo for community photo collections. ICCV’07, 1–8.
3. Mark, W., McMillan, L., and Bishop, G. 1997. Post-Rendering 3D Warping. In Proc. of Symposium on Interactive 3D Graphics, 7–16.
4. Shrstha, P., Barbieri, M., and Weda, H. 2007. Synchronization of multi-camera video recordings based on audio. In Proc. of MULTIMEDIA’07, ACM Press, New York, 545–548.
5. Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: Exploring photo collections in 3d. ACM Trans. on Graphics 25, 3, 835–846.
6. Stich, T., Linz, C., Albuquerque, G., and Magnor, M. 2008. View and Time Interpolation in Image Space. Computer Graphics Forum (Proc. of PG’08) 27, 7.
