“Journal of My Journey: Seamless Interaction in Virtuality and Reality with Digital Fabrication and Sensory Feedback” by Jie Then, Lui, Tsai Chen, Yin Lim and Han

  • ©Miguel Ying Jie Then, Ching Lui, Yvone Tsai Chen, Zin Yin Lim, and Ping-Hsuan Han

Conference:


Entry Number: 09

Title:


    Journal of My Journey: Seamless Interaction in Virtuality and Reality with Digital Fabrication and Sensory Feedback

Program Title:


    Immersive Pavilion

Presenter(s):


Description:


    Whether in virtuality or reality, the decisions or actions pursue the goal we acquire in the virtual or real world. Besides, the decision or action that the users make in virtuality or reality only affects one physical or virtual environment. Previous works have revealed the concept of substitutional reality that utilizes the physical environment to enhance the immersive experience. However, there was no trace that the event in virtuality has parallel happened in the physical space. We present Journal of My Journey, an extended reality system with digital fabrication and sensory feedback for seamless interaction in virtuality and reality. The user’s behavior in the virtuality does affect reality. To show the ideal, we developed an immersive game to explore the possibilities of bringing sensory feedback from the real world to help with puzzle-solving in the game and exporting the output of the decisions made by the players perform in the virtual world into reality by using digital fabrication.

References:


    1. Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. (2016). https://doi.org/10.1145/2858036.2858226
    2. Yang-Sheng Chen, Ping-Hsuan Han, Kong-Chang Lee, Chiao-En Hsieh, Jui-Chun Hsiao, Che-Ju Hsu, Kuan-Wen Chen, Chien-Hsing Chou, and Yi-Ping Hung. 2018. Lotus: Enhancing the Immersive Experience in Virtual Environment with Mist-Based Olfactory Display. (2018). https://doi.org/10.1145/3275495.3275503
    3. Lung-Pan Cheng, Li Chang, Sebastian Marwecki, and Patrick Baudisch. 2018. ITurk: Turning Passive Haptics into Active Haptics by Making Users Reconfigure Props in Virtual Reality. (2018). https://doi.org/10.1145/3173574.3173663
    4. Lung-Pan Cheng, Eyal Ofek, Christian Holz, Hrvoje Benko, and Andrew D. Wilson. 2017. Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. (2017). https://doi.org/10.1145/3025453.3025753
    5. Ping-Hsuan Han, Yang-Sheng Chen, Kong-Chang Lee, Hao-Cheng Wang, Chiao-En Hsieh, Jui-Chun Hsiao, Chien-Hsing Chou, and Yi-Ping Hung. 2018. Haptic around: Multiple Tactile Sensations for Immersive Environment and Interaction in Virtual Reality. (2018). https://doi.org/10.1145/3281505.3281507
    6. Adalberto L. Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. (2015). https://doi.org/10.1145/2702123.2702389
    7. Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. (2018). https://doi.org/10.1145/3173574.3173660

ACM Digital Library Publication:


Overview Page:


Type: