“HeadSPIN: A One-to-many 3D Video Teleconferencing System” by Jones, Lang, Fyffe, Yu, Busch, et al. …

  • ©Andrew Jones, Magnus Lang, Graham Fyffe, Xueming Yu, Jay Busch, Ian E. McDowall, Mark T. Bolas, and Paul E. Debevec

Title:


    HeadSPIN: A One-to-many 3D Video Teleconferencing System

Presenter(s):


Entry Number: 14


Description:


    When people communicate in person, numerous cues of attention, eye contact, and gaze direction provide important additional channels of information, making in-person meetings more efficient and effective than telephone conversations and 2D teleconferences. Two-dimensional video teleconferencing precludes the impression of accurate eye contact: when a participant looks into the camera, everyone seeing their video stream sees the participant looking toward them; when the participant looks away from the camera (for example, toward other participants in the meeting), no one sees the participant looking at them. In this work, we develop a one-to-many teleconferencing system which uses 3D acquisition, transmission, and display technologies to achieve accurate reproduction of gaze and eye contact. In this system, the face of a single remote participant is scanned at interactive rates using structured light while the participant watches a large 2D screen showing an angularly correct view of the audience. The scanned participant’s geometry is then shown on the 3D display to the audience.


Other Information:


    References

    JONES, A., MCDOWALL, I., YAMADA, H., BOLAS, M., AND DEBEVEC, P. 2007. Rendering for an interactive 360 light field display. ACM Transactions on Graphics 26, 3 (July), 40:1–40:10.

    VIOLA, P., AND JONES, M. J. 2004. Robust real-time face detection. International Journal of Computer Vision 57, 2, 137–154.

    ZHANG, S., AND HUANG, P. 2006. High-resolution, real-time three-dimensional shape measurement. Optical Engineering 45, 12.


Additional Images:

©Andrew Jones, Magnus Lang, Graham Fyffe, Xueming Yu, Jay Busch, Ian E. McDowall, Mark T. Bolas, and Paul E. Debevec ©Andrew Jones, Magnus Lang, Graham Fyffe, Xueming Yu, Jay Busch, Ian E. McDowall, Mark T. Bolas, and Paul E. Debevec ©Andrew Jones, Magnus Lang, Graham Fyffe, Xueming Yu, Jay Busch, Ian E. McDowall, Mark T. Bolas, and Paul E. Debevec ©Andrew Jones, Magnus Lang, Graham Fyffe, Xueming Yu, Jay Busch, Ian E. McDowall, Mark T. Bolas, and Paul E. Debevec

PDF:



Conference:


Overview Page:


Type: