“Garden: A Mixed Reality Experience” by Sing, Xie, Randall and Vidyasagaran

  • ©

Conference:


Type(s):


Title:


    Garden: A Mixed Reality Experience

Presenter(s):


Description:


    Garden is a mixed reality (MR) experience on the Project Tango mounted with the Durovis Dive headset. It allows the player to walk around freely in large spaces and avoid obstacles, while immersed in the virtual world. It achieves this using real-time 3d reconstruction to bring the real world into virtual space. The real world is represented using minecraft-style voxels for easy rendering and texturing. We spawn game elements on tables and on the floors using the scanned geometry to recognize flat features. We also allow users to interact with these objects using just their hands and feet. With these features combined, we enable users to intuitively explore and interact with an alternate, virtual space as they do in the real world.

References:


    1. Google’s Project Tango. Google. https://www.google.com/atap/project-tango/.
    2. Klingensmith, M., Dryanovski, I., Srinivasa, S., and Xiao, J. 2015. Chisel: Real Time Large Scale 3D Reconstruction Onboard a Mobile Device using Spatially Hashed Signed Distance Fields. Robotics: Science and Systems XI.
    3. Matterport 3D Models of Real Interior Spaces. Matterport. http://matterport.com/.
    4. Microsoft HoloLens. Microsoft HoloLens. https://www.microsoft.com/microsoft-hololens/en-us.
    5. Miksik, O., Torr, P. H., Vineet, V., et al. 2015. The Semantic Paintbrush. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems – CHI ’15.
    6. Newcombe, R. A., Davison, A. J., Izadi, S., et al. 2011. KinectFusion: Real-time dense surface mapping and tracking. 2011 10th IEEE International Symposium on Mixed and Augmented Reality. 
    7. Ondruska, P., Kohli, P., and Izadi, S. 2015. MobileFusion: Real-Time Volumetric Surface Reconstruction and Dense Tracking on Mobile Phones. IEEE Trans. Visual. Comput. Graphics IEEE Transactions on Visualization and Computer Graphics 21, 11, 1251–1258. 
    8. Piekarski, W. and Thomas, B. 2002. ARQuake: the outdoor augmented reality gaming system. Communications of the ACM Commun. ACM 45, 1. 
    9. Minecraft. minecraft.net – Home. http://minecraft.net/.

ACM Digital Library Publication:


Overview Page: