“Real-time 3D interaction for augmented and virtual reality” by Prince, Cheok, Farbiz, Williamson, Johnson, et al. …

  • ©Simon J. D. Prince, Adrian David Cheok, Farzam Farbiz, Todd Williamson, Nik Johnson, Mark Nathan Billinghurst, and Hirokazu Kato



Interest Area:



    Real-time 3D interaction for augmented and virtual reality

Session/Category Title:   Virtual Reality Techniques



    We demonstrate a real-time 3-D augmented reality video-conferencing system. The observer sees the real world from his viewpoint, but modified so that the image of a remote collaborator is rendered into the scene. For each frame, we estimate the transformation between the camera and a fiducial marker using techniques developed in Kato and Billinghurst [1999]. We use a shape-from-silhouette algorithm to generate the appropriate view of the collaborator in real time. This is based on simultaneous measurements from fifteen calibrated cameras that surround the collaborator. The novel view is then superimposed upon the real world image and appropriate directional audio is added. The result gives the strong impression that the virtual collaborator is a real part of the scene.


    1. Kato, H. and Billinghurst, M. 1999. Marker tracking and HMD calibration for a video based augmented reality conferencing system. In Proc. IWAR, 85–94.
    2. Matusik, W., Buehler, R., Raskar, R., Gortler, S. J. and McMillan, L. 2000. Image-Based Visual Hulls. In Proc. SIGGRAPH, 369–374.

ACM Digital Library Publication:

Overview Page: