“HoloChat: 3D Avatars on Mobile Light Field Displays” by Liu, Niederberger, Yu, Li and Fattal

  • ©Jing Liu, Armand Niederberger, Jihun Yu, Hao Li, and David Fattal

Title:


    HoloChat: 3D Avatars on Mobile Light Field Displays

Presenter(s):


Entry Number: 14


Description:


    Holographic displays have long inspired science fiction writers and movie makers as the communication platform of the future. Why should we restrict ourselves to a two-dimensional screen if we can transmit our virtual selves in 3D? Despite striking advances in holographic display and 3D capture technologies, we are taking a step further in developing a complete prototype system suitable for mobile deployment (mobile phones, smart watches, tablet devices, etc.). We propose an efficient data-processing framework for 3D face capture, transmission, rendering, and display. Our framework combines the state of the art in mobile light field displays and depth sensor-based realtime facial performance capture. We demonstrate the first mobile holographic communication system through performance-driven digital avatars.

References:


    FATTAL, D., PENG, Z., TRAN, T., VO, S., FIORENTINO, M., BRUG, J., AND BEAUSOLEIL, R. G. 2013. A multi-directional backlight for a wide-angle, glasses-free three-dimensional display. Nature 495, 7441, 348–351.

    LI, H., YU, J., YE, Y., AND BREGLER, C. 2013. Realtime facial animation with on-the-fly correctives. ACM Transactions on Graphics (Proceedings SIGGRAPH 2013) 32, 4 (July).


Additional Images:

©Jing Liu, Armand Niederberger, Jihun Yu, Hao Li, and David Fattal ©Jing Liu, Armand Niederberger, Jihun Yu, Hao Li, and David Fattal ©Jing Liu, Armand Niederberger, Jihun Yu, Hao Li, and David Fattal

ACM Digital Library Publication:



PDF:



Conference:


Type: