“Grimage: Markerless 3D Interactions” by Allard, Menier, Raffin, Boyer and Faure

  • ©Jérémie Allard, Clément Menier, Bruno Raffin, Edmond Boyer, and François Faure

  • ©Jérémie Allard, Clément Menier, Bruno Raffin, Edmond Boyer, and François Faure

  • ©Jérémie Allard, Clément Menier, Bruno Raffin, Edmond Boyer, and François Faure

Conference:


Entry Number: 11

Title:


    Grimage: Markerless 3D Interactions

Presenter(s):


Description:


    Abstract

    Grimage glues multi-camera 3D modeling, physical simulation and parallel execution for a new immersive experience. Put your hands or any object into the interaction space. It is instantaneously modeled in 3D and injected into a virtual world populated with solid and soft objects. Push them, catch them and squeeze them.

Other Information:


    References

    ALLARD, J., AND RAFFIN, B. 2005. A Shader-Based Parallel Rendering Framework. In IEEE Visualization Conference.

    ALLARD, J., AND RAFFIN, B. 2006. Distributed Physical Based Simulations for Large VR Applications. In IEEE Virtual Reality Conference.

    ALLARD, J., GOURANTON, V., LECOINTRE, L., LIMET, S., MELIN, E., RAFFIN, B., AND ROBERT, S. 2004. FlowVR: a Middleware for Large Scale Virtual Reality Applications. In Euro-Par 2004 Parallel Processing: 10th International Euro-Par Conference, 497–505. http://flowvr.sf.net.

    ALLARD, J., COTIN, S., FAURE, F., BENSOUSSAN, P.-J., POYER, F., DURIEZ, C., DELINGETTE, H., AND GRISONI, L. 2007. SOFA: an Open Source Framework for Medical Simulation. In Medicine Meets Virtual Reality (MMVR). http://www.sofa-framework.org.

    BOROVIKOV, E., SUSSMAN, A., AND DAVIS, L. 2003. A High Performance Multi-Perspective Vision Studio. In 17th Annual ACM International Conference on Supercomputing, San Fran- cisco (USA).

    CARRANZA, J., THEOBALT, C., MAGNOR, M., AND SEIDEL, H. 2003. Freeviewpoint video of human actors. In Proceedings of ACM SIGGRAPH 03, 569–577.

    CHEUNG, G., KANADE, T., BOUGUET, J.-Y., AND HOLLER, M. 2000. A real time system for robust 3d voxel reconstruction of human motions. In Computer Vision and Pattern Recognition 00, vol. II, 714 – 720.

    FRANCO, J., AND BOYER, E. 2003. Exact Polyhedral Visual Hulls. In Proceedings of BMVC2003.

    FRANCO, J.-S., MÉNIER, C., BOYER, E., AND RAFFIN, B. 2004. A Distributed Approach for Real Time 3D Modeling. In Proceedings of the IEEE Workshop on Real Time 3D Sensors and Their Use.

    GOLDLÜCKE, B., AND MAGNOR, M. 2003. Real-Time Microfacet Billboarding for Free-Viewpoint Video Rendering. Proc. IEEE International Conference on Image Processing (ICIP’03), Barcelona, Spain (September), 713–716.

    GROSS, M., WUERMLIN, S., NAEF, M., LAMBORAY, E., SPAGNO, C., KUNZ, A., KOLLER-MEIER, E., SVOBODA, T., GOOL, L. V., S. LANG, K. S., MOERE, A. V., AND STAADT, O. 2003. Blue-C: A Spatially Immersive Display and 3D Video Portal for Telepresence. In Proceedings of ACM SIGGRAPH 03.

    HASENFRATZ, J.-M., LAPIERRE, M., AND SILLION, F. 2004. A real-time system for full body interaction with virtual worlds. 147–156.

    HILTON, A., AND STARCK, J. 2004. Multiple view reconstruction of people. In 3DPVT ’04: Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium on (3DPVT’04), IEEE Computer Society, Washington, DC, USA, 357–364.

    KANADE, T., RANDER, P., AND NARAYANAN, P. 1997. Virtualized Reality: Constructing Virtual Worlds from Real Scenes. IEEE Multimedia, Immersive Telepresence 4, 1 (January), 34–47.

    KRUEGER, M. W., GIONFRIDDO, T., AND HINRICHSEN, K. 1985. Videoplace – an artificial reality. In CHI ’85: Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, 35–40.

    LI, M., MAGNOR, M., AND SEIDEL, H.-P. 2003. Hardware-Accelerated Visual Hull Reconstruction and Rendering. In Proceedings of Graphics Interface’2003.

    LI, M., MAGNOR, M., AND SEIDEL, H.-P. 2004. A hybrid hardware-accelerated algorithm for high quality rendering of visual hulls. In GI ’04: Proceedings of the 2004 conference on Graphics interface, Canadian Human-Computer Communications Society, School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada, 41–48.

    MATUSIK, W., AND PFISTER, H. 2004. 3D TV: A Scalable System for Real-Time Acquisition, Transmission, and Autostereoscopic Display of Dynamic Scenes. In Proceedings of ACM SIG- GRAPH 04.

    WU, X., TAKIZAWA, O., AND MATSUYAMA, T. 2006. Parallel Pipeline Volume Intersection for Real-Time 3D Shape Reconstruction on a PC Cluster. In Proceedings of the Fourth IEEE International Conference on Computer Vision Systems (ICVS’06), IEEE Computer Society, Washington, DC, USA.

Keyword(s):


  • Markerless 3D Modeling
  • 3D Interactions
  • Soft Objects Simulation
  • Multi-cameras
  • PC Cluster

    • Additional Images:

    ©Jérémie Allard, Clément Menier, Bruno Raffin, Edmond Boyer, and François Faure ©Jérémie Allard, Clément Menier, Bruno Raffin, Edmond Boyer, and François Faure

    Acknowledgements:


      Thanks to all people that participated to the development of the various components of this project: Nicolas Turro, INRIA, Florian Geffray, INRIA, David Knossow, INRIA, Everton Hermann, INRIA, Jean-François Cuniberto, INRIA, Fredéric Devernay, INRIA, Remi Ronfard, INRIA, Herv Mathieu, INRIA, Stéphane Cotin, CIMIT, Pierre-Jean Bensoussan, INRIA, François Poyer, INRIA, Christian Duriez, INRIA, Hervé Delingette, INRIA, Laurent Grisoni, INRIA. This work was supported by our institutions: INRIA, U-Grenoble, the Laboratoire d’Informatique de Grenoble (LIG), the Laboratoire Jean Kuntzmann (LJK), and MGH/CIMIT. These works have been partly funded by the RNTL project Geobench, the ACI Cyber-II, the ACI Ocetre, the ARA DALIA, the European project Holonics and the European project Odyseus

    PDF:


    Overview Page:


    Type: