“Holographic and Action Capture Techniques” by Rodriguez, Cabo de Leon, Uzzan, Livet, Boyer, et al. …
Conference:
Type(s):
Entry Number: 13
Title:
- Holographic and Action Capture Techniques
Presenter(s):
Description:
Abstract
We present an integrated 3D capturing, visualization and user interaction system composed of a computer vision based 3D capturing device, a scene composer and a large scale holographic display. The system performs in real-time and provides the facilities required for capturing realistic human 3D body models, inserting the human representations inside virtual scenarios, detecting 3D interactions between the body models and the virtual objects present in the scene and visualizing the resulting 3D performance on a true 3D holographic display.
Other Information:
List of referenced works
The display technology is described in the following publications (the papers refer to a smaller scale prototype; a publication on the new display is in preparation):
Full details on the basic technology are given in following patents:
Patent EP 0 693 244 B1 / US Patent 5,801,761; owned by Holografika;
European Patent Application 98 904 307.0 / US Patent 6,201,565 B1; jointly owned by Holografika and Sony;
Patent Application US: 10/276,466 / EP: 01936692.1 / JP: 2001-584933 / CN: 01809764.2 / KR: 2002-7015586 ; owned by Holografika.
White papers and other information on the display technology are also available at the following web sites:
http://www.eptron.es/projects/holonics/holonics.htm http://www.holografika.com
[BAL+06] The HoloVizio System. Tibor Balogh Electronic Imaging, Stereoscopic Displays and Virtual Reality Systems XIII (2006) Vol. 6055
The referenced competing display technology publications are the following:
[DML+00] DODGSON N. A., MOORE J. R., LANG S. R., MARTIN G., CANEPA P.: Time-sequential multi-projector autostereoscopic 3D display. J. Soc. for Information Display 8, 2 (2000), 169?176.
[Dod96] DODGSON N. A.: Analysis of the viewing zone of the Cambridge autostereoscopic display. Applied Optics: Optical Technology & Biomedical Optics 35, 10 (1996), 1705?1710.
[EWO+95] EZRA D., WOODGATE G. J., OMAR B. A., HOLLIMAN N. S., HARROLD J., SHAPIRO L. S.: New autostereoscopic display system. In Stereoscopic Displays and Virtual Reality Systems II (1995), vol. 2409 of SPIE proceedings, pp. 31?40. 2
[FDHN01] FAVALORA G., DORVAL R., HALL D., NAPOLI J.: Volumetric three dimensional display system with rasterization hardware. In Stereoscopic Displays and Virtual Reality Systems VII (2001), vol. 4297 of SPIE Proceedings, pp. 227?235. 2
[HMG03] HUEBSCHMAN M., MUNJULURI B., GARNER H.: Dynamic holographic 3-D image projection. Optics Express 11 (2003), 437?445.
[MMMR00] MCKAY S., MAIR G., MASON S., REVIE K.: Membrane-mirror based autostereoscopic display for teleoperation and telepresence applications. In Stereoscopic Displays and Virtual Reality Systems VII (2000), vol. 3957 of SPIE Proceedings, pp. 198?207.
[MP04] MATUSIK W., PFISTER H.: 3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. ACM Transactions on Graphics 23, 3 (Aug. 2004), 814?824.
[PPK00] PERLIN K., PAXIA S., KOLLIN J. S.: An autostereoscopic display. In SIGGRAPH 2000, Computer Graphics Proceedings (2000), Akeley K., (Ed.), Annual Conference Series, ACM Press / ACM SIGGRAPH / Addison Wesley Longman, pp. 319?326.
[RR05] RELKE I., RIEMANN B.: Three-dimensional multiview large projection system. In Stereoscopic Displays and Virtual Reality Systems XII (2005), vol. 5664 of Proc. SPIE.
[RS00] ROBERTS J. W., SLATTERY O.: Display characteristics and the impact on usability for stereo. In Stereoscopic Displays and Virtual Reality Systems VII (2000), vol. 3957 of SPIE proceedings, p. 128.
[SCC+00] STANLEY M., CONWAY P., COOMBER S., JONES J., SCAT-TERGOOD D., SLINGER C., BANNISTER B., BROWN C., CROSSLAND W., TRAVIS A.: A novel electro-optic modulator system for the production of dynamic images from giga-pixel computer generated holograms. In Practical Holography XIV and Holographic Materials VI (2000), vol. 3956 of SPIE Proceedings, pp. 13?22.
[SHLS+95] ST.-HILLAIRE P., LUCENTE M., SUTTER J., PAPPU R., SPARRELL C. G., BENTON S.: Scaling up the mit holographic video system. In Proc. Fifth International Symposium on Display Holography (1995), SPIE, pp. 374?380.
[vPF96] VAN BERKEL C., PARKER D., FRANKLIN A.: Multiview 3d-lcd. In Stereoscopic Displays and Virtual Reality Systems III (1996), vol. 2653 of SPIE proceedings, p. 32.
[WEH+98] WOODGATE G. J., EZRA D., HARROLD J., HOLLIMAN N. S., JONES G. R., MOSELEY R. R.: Autostereoscopic 3d display systems with observer tracking. Image Communication – Special Issue on 3D Video Technology (EURASIP – 1998) (1998), 131.
[WHJ+00] WOODGATE G. J., HARROLD J., JACOBS A. M. S., MOSELEY R. R., EZRA D.: Flat-panel autostereoscopic displays: characterisation and enhancement. In Stereoscopic Displays and Virtual Reality Systems VII (2000), vol. 3957 of SPIE proceedings, p. 153.
[ALL+06] The Grimage Platform: A Mixed Reality Environment for Interactions. J. Allard, J.-S. Franco, C. Ménier, E. Boyer and B. Raffin. In Proceedings of International Conference on Computer Vision Systems, 2006 (ICVS’06).
[FRC+04] A Distributed Approach for Real-Time 3D Modeling. J.-S. Franco, C. Menier, E. Boyer and B. Raffin. IEEE CVPR Workshop on Real-Time 3D Sensors and their Applications, 2004.
[FRC+03] Exact Polyhedral Visual Hulls. J.-S. Franco and E. Boyer. In Proceedings of British Machine Vision Conference, 2003 (BMVC’03).
[LAU+94] The Visual Hull Concept for Silhouette-Based Image Understanding. A. Laurentini. IEEE Transactions on PAMI, 1994.
Keyword(s):
- 3D human action capturing
- 3D display
- virtual reality
- interactive
Acknowledgements:
Research partially supported by the HOLONICS project (EU- FP6-511318), funded under the European FP6/IST program.