“Cybersickness Reduction via Gaze-contingent Image Deformation”
Conference:
Type(s):
Title:
- Cybersickness Reduction via Gaze-contingent Image Deformation
Presenter(s)/Author(s):
Abstract:
We introduce a novel technique to mitigate cybersickness by gaze-contingent geometrical distortions that reduce vection. Based on pre-study insights, we formulate a perceptual model that defines noticeability limits for these modifications. Our technique, implemented as a real-time post-processing step in current rendering frameworks, was favored over alternatives in VR scenarios.
References:
[1]
Isayas Berhe Adhanom, Nathan Navarro Griffin, Paul MacNeilage, and Eelke Folmer. 2020. The Effect of a Foveated Field-of-view Restrictor on VR Sickness. In IEEE Conf. Virtual Reality and 3D User Interfaces. IEEE, 645–652.
[2]
Stephen J Anderson, Kathy T Mullen, and Robert F Hess. 1991. Human peripheral spatial resolution for achromatic and chromatic stimuli: limits imposed by optical and retinal factors. The Journal of physiology 442, 1 (1991), 47–64.
[3]
Kaitlyn R Bankieris, Vikranth Rao Bejjanki, and Richard N Aslin. 2017. Sensory cue-combination in the context of newly learned categories. Scientific Reports 7, 1 (2017).
[4]
Jelte E Bos, Sjoerd C de Vries, Martijn L van Emmerik, and Eric L Groen. 2010. The effect of internal and external fields of view on visually induced motion sickness. Applied ergonomics 41, 4 (2010), 516–521.
[5]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101.
[6]
Scott Daly. 2001. Engineering observations from spatiovelocity and spatiotemporal visual models. In Vision Models and Applications to Image and Video Processing.
[7]
Paul DiZio and James Lackner. 1997. Circumventing side effects of immersive virtual environments. Advances in human factors/ergonomics 21 (1997), 893–896.
[8]
Sarah D’Amour, Laurence R Harris, Stefan Berti, and Behrang Keshavarz. 2021. The role of cognitive factors and personality traits in the perception of illusory self-motion (vection). Attention, Perception, & Psychophysics 83 (2021), 1804–1817.
[9]
Sigm Exner. 1886. Ein Versuch ?ber die Netzhautperipherie als Organ zur Wahrnehmung von Bewegungen. Archiv f?r die gesamte Physiologie des Menschen und der Tiere 38, 1 (1886), 217–218.
[10]
Fast Optical Flow 2023. NVIDIA Optical Flow SDK. https://developer.nvidia.com/optical-flow-sdk. Accessed: 2024-01-17.
[11]
David Finlay. 1982. Motion perception in the peripheral visual field. Perception 11, 4 (1982), 457–462.
[12]
Colin Groth, Jan-Philipp Tauscher, Nikkel Heesen, Susana Castillo, and Marcus Magnor. 2021a. Visual Techniques to Reduce Cybersickness in Virtual Reality. In IEEE Conf. Virtual Reality and 3D User Interfaces. 486–487.
[13]
Colin Groth, Jan-Philipp Tauscher, Nikkel Heesen, Steve Grogorick, Susana Castillo, and Marcus Magnor. 2021b. Mitigation of Cybersickness in Immersive 360?Videos. In IEEE VR Workshop on Immersive Sickness Prevention. 169–177.
[14]
Colin Groth, Jan-Philipp Tauscher, Nikkel Heesen, Max Hattenbach, Susana Castillo, and Marcus Magnor. 2022. Omnidirectional Galvanic Vestibular Stimulation in Virtual Reality. IEEE Trans. Vis. Comput. Graph. 28, 5 (2022), 2234–2244.
[15]
Xuanru Guo, Shinji Nakamura, Yoshitaka Fujii, Takeharu Seno, and Stephen Palmisano. 2021. Effects of luminance contrast, averaged luminance and spatial frequency on vection. Experimental Brain Research 239 (2021), 3507–3525.
[16]
S?bastien Hillaire, Anatole L?cuyer, R?mi Cozot, and G?ry Casiez. 2008. Depth-of-field blur effects for first-person navigation in virtual environments. IEEE computer graphics and applications 28, 6 (2008), 47–55.
[17]
Ping Hu, Qi Sun, Piotr Didyk, Li-Yi Wei, and Arie E. Kaufman. 2019. Reducing Simulator Sickness with Perceptual Camera Control. ACM Trans. Graph. 38, 6, Article 210 (2019), 12 pages.
[18]
Yu Imaoka, Andri Flury, and Eling D De Bruin. 2020. Assessing saccadic eye movements with head-mounted display virtual reality technology. Frontiers in Psychiatry 11 (2020), 1–19.
[19]
Anton Kaplanyan, Anton Sochenov, Thomas Leimkuehler, Mikhail Okunev, Todd Goodall, and Gizem Rufo. 2019. DeepFovea: Neural Reconstruction for Foveated Rendering and Video Compression using Learned Statistics of Natural Videos. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 38, 4 (2019), 212:1–212:13.
[20]
Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 1993. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. The Int. Journal of Aviation Psychology 3, 3 (1993), 203–220.
[21]
Juno Kim, Stephen Palmisano, Wilson Luu, and Shinichi Iwasaki. 2021. Effects of linear visual-vestibular conflict on presence, perceived scene stability and cybersickness in the Oculus Go and Oculus Quest. Front. Virtual Real. 2 (2021), 42.
[22]
Song Min Kim and Gerard J. Kim. 2022. Sparse Peripheral Counter-vection Flow Visualization with Reverse Optical Flow for VR Sickness Reduction. In International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 798–799.
[23]
Oleg V Komogortsev and Alex Karpov. 2013. Automated classification and scoring of smooth pursuit eye movements in the presence of fixations and saccades. Behavior research methods 45 (2013), 203–215.
[24]
Joseph J LaViola Jr. 2000. A discussion of cybersickness in virtual environments. ACM SIGCHI Bulletin 32, 1 (2000), 47–56.
[25]
John Leigh and David Zee. 2015. The Neurology of Eye Movements. Oxford University Press.
[26]
JJ-W Lin, Henry Been-Lirn Duh, Donald E Parker, Habib Abi-Rached, and Thomas A Furness. 2002. Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. In Proc. IEEE Virtual Reality. IEEE, 164–171.
[27]
Yun-Xuan Lin, Rohith Venkatakrishnan, Roshan Venkatakrishnan, Elham Ebrahimi, Wen-Chieh Lin, and Sabarish V. Babu. 2020a. How the Presence and Size of Static Peripheral Blur Affects Cybersickness in Virtual Reality. ACM Trans. Appl. Percept. 17, 4, Article 16 (2020), 18 pages.
[28]
Yun-Xuan Lin, Rohith Venkatakrishnan, Roshan Venkatakrishnan, Elham Ebrahimi, Wen-Chieh Lin, and Sabarish V. Babu. 2020b. How the Presence and Size of Static Peripheral Blur Affects Cybersickness in Virtual Reality. ACM Trans. Appl. Percept. 17, 4, Article 16 (Nov. 2020), 18 pages.
[29]
Ruding Lou, Richard So, and Dominique Bechmann. 2022. Geometric Deformation for Reducing Optic Flow and Cybersickness Dose Value in VR. In Eurographics 2022 – Posters.
[30]
Wilson Luu, Barbara Zangerl, Michael Kalloniatis, and Juno Kim. 2021. Effects of stereopsis on vection, presence and cybersickness in head-mounted display (HMD) virtual reality. Scientific reports 11, 1 (2021), 12373.
[31]
Brandy Murovec, Julia Spaniol, Jennifer L Campos, and Behrang Keshavarz. 2021. Multisensory effects on illusory self-motion (vection): The role of visual, auditory, and tactile cues. Multisensory Research 34, 8 (2021), 869–890.
[32]
Tamami Nakano, Makoto Kato, Yusuke Morito, Seishi Itoi, and Shigeru Kitazawa. 2013. Blink-related momentary activation of the default mode network while viewing videos. Proc. Natl. Acad. Sci. USA 110, 2 (2013), 702–706.
[33]
David G. Narciso, Maximino Bessa, Miguel C. Melo, Ant?nio Coelho, and Jos? Vasconcelos-Raposo. 2019. Immersive 360? video user experience: impact of different variables in the sense of presence and cybersickness. Univers. Access Inf. Soc. (2019).
[34]
Guangyu Nie, Yue Liu, and Yongtian Wang. 2017. Prevention of Visually Induced Motion Sickness Based on Dynamic Real-Time Content-Aware Non-salient Area Blurring. In IEEE Int. Symp. Mixed and Augmented Reality Adjunct. 75–78.
[35]
Guang-Yu Nie, Henry Been-Lirn Duh, Yue Liu, and Yongtian Wang. 2019. Analysis on Mitigation of Visually Induced Motion Sickness by Applying Dynamical Blurring on a User’s Retina. TVCG (2019).
[36]
James F O’Hanlon, Michael E McCauley, et al. 1974. Motion sickness incidence as a function of the frequency and acceleration of vertical sinusoidal motion. Aerospace medicine 45, 4 (1974), 366–369.
[37]
Su Han Park, Bin Han, and Gerard Jounghyun Kim. 2022. Mixing in reverse optical flow to mitigate vection and simulation sickness in virtual reality. In Proceedings of the Conference on Human Factors in Computing Systems (CHI). Article 189, 11 pages.
[38]
Anjul Patney, Marco Salvi, Joohwan Kim, Anton Kaplanyan, Chris Wyman, Nir Benty, David Luebke, and Aaron Lefohn. 2016. Towards Foveated Rendering for Gaze-Tracked Virtual Reality. ACM Trans. Graph. 35, 6, Article 179 (Nov. 2016), 12 pages.
[39]
James T Reason and Joseph John Brand. 1975. Motion sickness. Academic press.
[40]
A Fleming Seay, David M Krum, Larry Hodges, and William Ribarsky. 2001. Simulator sickness and presence in a high FOV virtual environment. In Proc. IEEE Virtual Reality. IEEE, 299–300.
[41]
Takeharu Seno, Hiroyuki Ito, and Shoji Sunaga. 2009. The object and background hypothesis for vection. Vision research 49, 24 (2009), 2973–2982.
[42]
Craig Sherman. 2002. Motion sickness: review of causes and preventive strategies. Journal of travel medicine 9, 5 (2002), 251–256.
[43]
Misha Sra, Abhinandan Jain, and Pattie Maes. 2019. Adding Proprioceptive Feedback to Virtual Reality Experiences Using Galvanic Vestibular Stimulation. In Conf. Human Factors in Computing Systems. 1–14.
[44]
Qi Sun, Anjul Patney, Li-Yi Wei, Omer Shapira, Jingwan Lu, Paul Asente, Suwen Zhu, Morgan McGuire, David Luebke, and Arie Kaufman. 2018. Towards virtual reality infinite walking: dynamic saccadic redirection. ACM Trans. Graph. 37, 4 (2018).
[45]
Arjan C ter Horst, Mathieu Koppen, Luc P. J. Selen, and W. Pieter Medendorp. 2015. Reliability-based weighting of visual and vestibular cues in displacement estimation. PloS one 10, 12 (2015), 1–15.
[46]
Benjamin Thompson, Bruce C Hansen, Robert F Hess, and Nikolaus F Troje. 2007. Peripheral vision: Good for biological motion, bad for signal noise segregation? Journal of Vision 7, 10 (2007), 1–12.
[47]
William Thompson, Roland Fleming, Sarah Creem-Regehr, and Jeanine Kelly Stefanucci. 2011. Visual Perception from a Computer Graphics Perspective. CRC Press.
[48]
Okan Tarhan Tursun, Elena Arabadzhiyska-Koleva, Marek Wernikowski, Rados?aw Mantiuk, Hans-Peter Seidel, Karol Myszkowski, and Piotr Didyk. 2019. Luminance-contrast-aware foveated rendering. ACM Trans. Graph. 38, 4 (2019), 1–14.
[49]
Wenjun Zeng, Scott Daly, and Shawmin Lei. 2000. Point-wise extended visual masking for JPEG-2000 image compression. In International Conference on Image Processing, Vol. 1. 657–660.
[50]
Andr? Zenner, Kora Persephone Regitz, and Antonio Kr?ger. 2021. Blink-suppressed hand redirection. In IEEE Conf. Virtual Reality and 3D User Interfaces. 75–84.
