“Real-time 3D interaction for augmented and virtual reality” by Prince, Cheok, Farbiz, Williamson, Johnson, et al. …
Conference:
Type(s):
Interest Area:
- Application
Title:
- Real-time 3D interaction for augmented and virtual reality
Session/Category Title: Virtual Reality Techniques
Presenter(s)/Author(s):
Abstract:
We demonstrate a real-time 3-D augmented reality video-conferencing system. The observer sees the real world from his viewpoint, but modified so that the image of a remote collaborator is rendered into the scene. For each frame, we estimate the transformation between the camera and a fiducial marker using techniques developed in Kato and Billinghurst [1999]. We use a shape-from-silhouette algorithm to generate the appropriate view of the collaborator in real time. This is based on simultaneous measurements from fifteen calibrated cameras that surround the collaborator. The novel view is then superimposed upon the real world image and appropriate directional audio is added. The result gives the strong impression that the virtual collaborator is a real part of the scene.
References:
1. Kato, H. and Billinghurst, M. 1999. Marker tracking and HMD calibration for a video based augmented reality conferencing system. In Proc. IWAR, 85–94.
2. Matusik, W., Buehler, R., Raskar, R., Gortler, S. J. and McMillan, L. 2000. Image-Based Visual Hulls. In Proc. SIGGRAPH, 369–374.
