“LiDARMAN: Reprogramming Reality with Egocentric Laser Depth Scanning” by Miyaki and Rekimoto

  • ©Takashi Miyaki and Jun Rekimoto


    LiDARMAN: Reprogramming Reality with Egocentric Laser Depth Scanning


Entry Number: 15


    This paper introduces a method to reprogram reality by substituting visual perception. According to several studies in psychology, our construction of reality is only a subjective experience, and we have an ability to adapt the modified perception unconsciously. As we use a Light Detection And Ranging (LiDAR) sensor to provide altered vision, the system can provide a novel 3D reconstructed view from outside of the body. We explore factors that affect the behavior of the user with the out-of-body vision using a prototype of our proposed system LiDARMAN. Three different representations (1st person camera, 3rd person camera, plan view) are investigated to explore potential applications such like navigation, security, or remote collaboration.


    ARDOUIN, J., L´E CUYER, A., MARCHAL, M., RIANT, C., AND MARCHAND, E. 2012. FlyVIZ: A Novel Display Device to Provide Humans with 360° Vision by Coupling Catadioptric Camera with HMD. In Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology, ACM, VRST ’12, 41–44.

    FAN, K., HUBER, J., NANAYAKKARA, S., AND INAMI, M. 2014. SpiderVision: Extending the Human Field of View for Augmented Awareness. In Proceedings of the 5th Augmented Human International Conference, ACM, AH ’14, 49:1–49:8.

    HAIGH-HUTCHINSON, M. 2009. Real-Time Cameras: A Guide for Game Designers and Developers. CRC Press.

    KASAHARA, S., AND REKIMOTO, J. 2014. Jackin: Integrating first-person view with out-of-body vision generation for human-human augmentation. In Proceedings of the 5th Augmented Human International Conference, ACM, AH ’14, 46:1–46:8.

    MAZZONI, P., AND KRAKAUER, J. W. 2006. An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation. The Journal of Neuroscience 26, 14 (Apr.), 3642–3645.

    STRATTON, G. M. 1897. Vision without inversion of the retinal image. Psychological Review 4, 4, 341–360.

    UEXK¨U LL, J. V. 1934. A Foray into the Worlds of Animals and Humans: with A Theory of Meaning. Univ Of Minnesota Press, Nov.

Additional Images:

©Takashi Miyaki and Jun Rekimoto

ACM Digital Library Publication: