“Remote Collaboration in AR and VR Using Virtual Replicas” by Elvezio, Sukan, Oda, Feiner and Tversky

  • ©Carmine Elvezio, Mengu Sukan, Ohan Oda, Steven K. Feiner, and Barbara Gans Tversky

Conference:


Entry Number: 13

Title:


    Remote Collaboration in AR and VR Using Virtual Replicas

Presenter(s):


Description:


    In many complex tasks, a remote subject-matter expert may need to assist a local user, to guide their actions on objects in the local user’s environment. However, effective spatial referencing and action demonstration in a remote physical environment can be challenging. We demonstrate an approach that uses Virtual Reality (VR) or Augmented Reality (AR) for the remote expert, and AR for the local user, each wearing a stereo head-worn display (HWD). Our approach allows the remote expert to create and manipulate virtual replicas of physical objects in the local environment to refer to parts of those physical objects and to indicate actions on them. This can be especially useful for parts that are occluded or difficult to access. The remote expert can demonstrate actions in 3D by manipulating virtual replicas, supported by constraints and annotations, and point in 3D to portions of virtual replicas to annotate them.

References:


    1. S. Bottecchia, J. Cieutat, and J. Jessel. 2010. T.A.C: Augmented Reality System for Collaborative Tele-assistance in the Field of Maintenance Through Internet. In Proc. ACM AH. 14:1–7. 
    2. S. Gauglitz, B. Nuernberger, M. Turk, and T. Höllerer. 2014. World-Stabilized Annotations And Virtual Scene Navigation For Remote Collaboration. In Proc. ACM UIST. 449–459. 
    3. J. Heiser, B. Tversky, and M. Silverman. 2004. Sketches for and from Collaboration. Visual and spatial reasoning in design III 3 (2004), 69–78.
    4. S. Henderson and S. Feiner. 2011. Augmented Reality in the Psychomotor Phase of a Procedural Task. In Proc. IEEE ISMAR. 191–200. 
    5. O. Oda, C. Elvezio, M. Sukan, S. Feiner, and B. Tversky. 2015. Virtual Replicas for Remote Assistance in Virtual and Augmented Reality. In Proc. ACM UIST. 405–415. 
    6. J.S. Pierce, B.C. Stearns, and R. Pausch. 1999. Voodoo Dolls: Seamless Interaction at Multiple Scales in Virtual Environments. In Proc. ACM i3D. 141–145. 
    7. M. Sukan, C. Elvezio, S. Feiner, and B. Tversky. 2016. Providing Assistance for Orienting 3D Objects Using Monocular Eyewear. In Proceedings of the 2016 Symposium on Spatial User Interaction (SUI ’16). ACM, 89–98. 
    8. F. Tecchia, L. Alem, and W. Huang. 2012. 3D Helping Hands: A Gesture Based MR System for Remote Collaboration. In Proc. ACM VRCAI. 323–328. 

ACM Digital Library Publication:


Overview Page:


Type: