“Perceptual Evaluation of Steered Retinal Projection”
Conference:
Type(s):
Title:
- Perceptual Evaluation of Steered Retinal Projection
Presenter(s)/Author(s):
Abstract:
This study introduces the first perceptual testbed for Steered Retinal Projection (SRP), a display technology that combines retinal projection and pupil steering. We investigate the trade space for SRP viewing experience among eye dynamics, eye-tracking, and pupil steering. We also present a detection probability model for pupil steering artifact.
References:
[1]
Avi M. Aizenman, George A. Koulieris, Agostino Gibaldi, Vibhor Sehgal, Dennis M. Levi, and Martin S. Banks. 2023. The Statistics of Eye Movements and Binocular Disparities during VR Gaming: Implications for Headset Design. ACM Trans. Graph. 42, 1, Article 7 (jan 2023), 15 pages. https://doi.org/10.1145/3549529
[2]
Arthur Bradley, Larry Thibos, and David Still. 1990. Visual Acuity Measured with Clinical Maxwellian-View Systems: Effects of Beam Entry Location. Optometry and Vision Science 67, 11 (1990), 811?817. https://journals.lww.com/optvissci/fulltext/1990/11000/visual_acuity_measured_with_clinical.4.aspx
[3]
Doris I Braun, Alexander C Sch?tz, and Karl R Gegenfurtner. 2017. Visual sensitivity for luminance and chromatic stimuli during the execution of smooth pursuit and saccadic eye movements. Vision Research 136 (2017), 57?69.
[4]
Shaoyu Chen, Budmonde Duinkharjav, Xin Sun, Li-Yi Wei, Stefano Petrangeli, Jose Echevarria, Claudio Silva, and Qi Sun. 2022. Instant Reality: Gaze-Contingent Perceptual Optimization for 3D Virtual Reality Streaming. IEEE Transactions on Visualization and Computer Graphics 28, 5 (2022), 2157?2167. https://doi.org/10.1109/TVCG.2022.3150522
[5]
Steven A. Cholewiak, Zeynep Ba?g?ze, Ozan Cakmakci, David M. Hoffman, and Emily A. Cooper. 2020. A perceptual eyebox for near-eye displays. Opt. Express 28, 25 (Dec 2020), 38008?38028. https://doi.org/10.1364/OE.408404
[6]
Weiwei Dai, Ivan Selesnick, John-Ross Rizzo, Janet Rucker, and Todd Hudson. 2016. A parametric model for saccadic eye movement. In 2016 IEEE Signal Processing in Medicine and Biology Symposium (SPMB). IEEE, Philadelphia, PA, USA, 1?6.
[7]
Budmonde Duinkharjav, Praneeth Chakravarthula, Rachel Brown, Anjul Patney, and Qi Sun. 2022a. Image Features Influence Reaction Time: A Learned Probabilistic Perceptual Model for Saccade Latency. ACM Trans. Graph. 41, 4, Article 144 (jul 2022), 15 pages. https://doi.org/10.1145/3528223.3530055
[8]
Budmonde Duinkharjav, Kenneth Chen, Abhishek Tyagi, Jiayi He, Yuhao Zhu, and Qi Sun. 2022b. Color-Perception-Guided Display Power Reduction for Virtual Reality. ACM Trans. Graph. 41, 6, Article 210 (nov 2022), 16 pages. https://doi.org/10.1145/3550454.3555473
[9]
Budmonde Duinkharjav, Benjamin Liang, Anjul Patney, Rachel Brown, and Qi Sun. 2023. The Shortest Route is Not Always the Fastest: Probability-Modeled Stereoscopic Eye Movement Completion Time in VR. ACM Trans. Graph. 42, 6, Article 220 (dec 2023), 14 pages. https://doi.org/10.1145/3618334
[10]
Phillip Guan, Olivier Mercier, Michael Shvartsman, and Douglas Lanman. 2022. Perceptual Requirements for Eye-Tracked Distortion Correction in VR. In ACM SIGGRAPH 2022 Conference Proceedings (Vancouver, BC, Canada) (SIGGRAPH ?22). Association for Computing Machinery, New York, NY, USA, Article 51, 8 pages. https://doi.org/10.1145/3528233.3530699
[11]
Michel Guillon, Kathryn Dumbleton, Panagiotis Theodoratos, Marine Gobbe, C Benjamin Wooley, and Kurt Moody. 2016. The effects of age, refractive status, and luminance on pupil size. Optometry and vision science 93, 9 (2016), 1093.
[12]
John M Henderson, James R Brockmole, and Daniel A Gajewski. 2008. Differential detection of global luminance and contrast changes across saccades and flickers during active scene perception. Vision Research 48, 1 (2008), 16?29.
[13]
David M. Hoffman, Ahna R. Girshick, Kurt Akeley, and Martin S. Banks. 2008. Vergence?accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision 8, 3 (03 2008), 33?33. https://doi.org/10.1167/8.3.33
[14]
Saad Idrees, Matthias P. Baumann, Felix Franke, Thomas A. M?nch, and Ziad M. Hafed. 2020. Perceptual saccadic suppression starts in the retina. Nature Communications 11, 1 (24 Apr 2020), 1977. https://doi.org/10.1038/s41467-020-15890-w
[15]
Changwon Jang, Kiseung Bang, Gang Li, and Byoungho Lee. 2018. Holographic Near-Eye Display with Expanded Eye-Box. ACM Trans. Graph. 37, 6, Article 195 (dec 2018), 14 pages. https://doi.org/10.1145/3272127.3275069
[16]
Changwon Jang, Kiseung Bang, Seokil Moon, Jonghyun Kim, Seungjae Lee, and Byoungho Lee. 2017. Retinal 3D: Augmented Reality near-Eye Display via Pupil-Tracked Light Field Projection on Retina. ACM Trans. Graph. 36, 6, Article 190 (nov 2017), 13 pages. https://doi.org/10.1145/3130800.3130889
[17]
Pauline Kang, Paul Gifford, Philomena McNamara, Jenny Wu, Stephanie Yeo, Bonney Vong, and Helen Swarbrick. 2010. Peripheral Refraction in Different Ethnicities. Investigative Ophthalmology & Visual Science 51, 11 (11 2010), 6059?6065. https://doi.org/10.1167/iovs.09-4747
[18]
D. H. Kelly. 1979. Motion and vision. I. Stabilized images of stationary gratings. J. Opt. Soc. Am. 69, 9 (Sep 1979), 1266?1274. https://doi.org/10.1364/JOSA.69.001266
[19]
Jonghyun Kim, Manu Gopakumar, Suyeon Choi, Yifan Peng, Ward Lopes, and Gordon Wetzstein. 2022. Holographic Glasses for Virtual Reality. In ACM SIGGRAPH 2022 Conference Proceedings (Vancouver, BC, Canada) (SIGGRAPH ?22). Association for Computing Machinery, New York, NY, USA, Article 33, 9 pages. https://doi.org/10.1145/3528233.3530739
[20]
Jonghyun Kim, Youngmo Jeong, Michael Stengel, Kaan Ak?it, Rachel Albert, Ben Boudaoud, Trey Greer, Joohwan Kim, Ward Lopes, Zander Majercik, Peter Shirley, Josef Spjut, Morgan McGuire, and David Luebke. 2019. Foveated AR: Dynamically-Foveated Augmented Reality Display. ACM Trans. Graph. 38, 4, Article 99 (jul 2019), 15 pages. https://doi.org/10.1145/3306346.3322987
[21]
Seong-Bok Kim and Jae-Hyeung Park. 2018. Optical see-through Maxwellian near-to-eye display with an enlarged eyebox. Opt. Lett. 43, 4 (Feb 2018), 767?770. https://doi.org/10.1364/OL.43.000767
[22]
Joel S. Kollin and Michael R. Tidwell. 1995. Optical engineering challenges of the virtual retinal display. In Novel Optical Systems Design and Optimization, Jose M. Sasian (Ed.). Vol. 2537. International Society for Optics and Photonics, SPIE, San Diego, CA, United States, 48 ? 60. https://doi.org/10.1117/12.216403
[23]
Robert Konrad, Nitish Padmanaban, Keenan Molner, Emily A. Cooper, and Gordon Wetzstein. 2017. Accommodation-Invariant Computational near-Eye Displays. ACM Trans. Graph. 36, 4, Article 88 (jul 2017), 12 pages. https://doi.org/10.1145/3072959.3073594
[24]
Brooke Krajancich, Petr Kellnhofer, and Gordon Wetzstein. 2021. A Perceptual Model for Eccentricity-Dependent Spatio-Temporal Flicker Fusion and Its Applications to Foveated Graphics. ACM Trans. Graph. 40, 4, Article 47 (jul 2021), 11 pages. https://doi.org/10.1145/3450626.3459784
[25]
Gregory Kramida. 2016. Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics 22, 7 (2016), 1912?1931. https://doi.org/10.1109/TVCG.2015.2473855
[26]
John Krauskopf. 1980. Discrimination and detection of changes in luminance. Vision Research 20, 8 (1980), 671?677. https://doi.org/10.1016/0042-6989(80)90091-7
[27]
Seungjae Lee, Mengfei Wang, Gang Li, Lu Lu, Yusufu Sulai, Changwon Jang, and Barry Silverstein. 2020. Foveated near-eye display for mixed reality using liquid crystal photonics. Scientific Reports 10, 1 (30 Sep 2020), 16127. https://doi.org/10.1038/s41598-020-72555-w
[28]
Robert LiKamWa, Zhen Wang, Aaron Carroll, Felix Xiaozhu Lin, and Lin Zhong. 2014. Draining our glass: an energy and heat characterization of Google Glass. In Proceedings of 5th Asia-Pacific Workshop on Systems (Beijing, China) (APSys ?14). Association for Computing Machinery, New York, NY, USA, Article 10, 7 pages. https://doi.org/10.1145/2637166.2637230
[29]
Junguo Lin, Dewen Cheng, Cheng Yao, and Yongtian Wang. 2017a. Retinal projection head-mounted display. Frontiers of Optoelectronics 10, 1 (01 Mar 2017), 1?8. https://doi.org/10.1007/s12200-016-0662-8
[30]
Junguo Lin, Dewen Cheng, Cheng Yao, and Yongtian Wang. 2017b. Retinal projection head-mounted display. Frontiers of Optoelectronics 10 (2017), 1?8.
[31]
Tiegang Lin, Tao Zhan, Junyu Zou, Fan Fan, and Shin-Tson Wu. 2020. Maxwellian near-eye display with an expanded eyebox. Opt. Express 28, 26 (Dec 2020), 38616?38625. https://doi.org/10.1364/OE.413471
[32]
Rafa? K. Mantiuk, Maliha Ashraf, and Alexandre Chapiro. 2022. StelaCSF: A Unified Model of Contrast Sensitivity as the Function of Spatio-Temporal Frequency, Eccentricity, Luminance and Area. ACM Trans. Graph. 41, 4, Article 145 (jul 2022), 16 pages. https://doi.org/10.1145/3528223.3530115
[33]
Ethel Matin. 1974. Saccadic suppression: A review and an analysis.Psychological Bulletin 81, 12 (1974), 899 ? 917.
[34]
Y. K. Nio, N. M. Jansonius, V. Fidler, E. Geraghty, S. Norrby, and A. C. Kooijman. 2002. Spherical and irregular aberrations are important for the optimal performance of the human eye. Ophthalmic and Physiological Optics 22, 2 (2002), 103?112. https://doi.org/10.1046/j.1475-1313.2002.00019.x
[35]
Lucy Owen, Jonathan Browder, Benjamin Letham, Gideon Stocek, Chase Tymms, and Michael Shvartsman. 2021. Adaptive Nonparametric Psychophysics. arxiv:2104.09549 [stat.ME]
[36]
Anjul Patney, Marco Salvi, Joohwan Kim, Anton Kaplanyan, Chris Wyman, Nir Benty, David Luebke, and Aaron Lefohn. 2016. Towards Foveated Rendering for Gaze-Tracked Virtual Reality. ACM Trans. Graph. 35, 6, Article 179 (dec 2016), 12 pages. https://doi.org/10.1145/2980179.2980246
[37]
Dale Purves and Stephen Mark Williams. 2001. Neuroscience. 2nd edition. Sinauer Associates 2001. http://lib.ugent.be/catalog/ebk01:3450000000002013
[38]
Kavitha Ratnam, Robert Konrad, Douglas Lanman, and Marina Zannoli. 2019. Retinal image quality in near-eye pupil-steered systems. Opt. Express 27, 26 (Dec 2019), 38289?38311. https://doi.org/10.1364/OE.27.038289
[39]
John G Robson. 1966. Spatial and temporal contrast-sensitivity functions of the visual system. Josa 56, 8 (1966), 1141?1142.
[40]
JAJ Roufs. 1972. Dynamic properties of vision?II. Theoretical relationships between flicker and flash thresholds. Vision Research 12, 2 (1972), 279?292.
[41]
Weitao Song, Xinan Liang, Shiqiang Li, Parikshit Moitra, Xuewu Xu, Emmanuel Lassalle, Yuanjin Zheng, Yongtian Wang, Ram?n Paniagua-Dom?nguez, and Arseniy I Kuznetsov. 2023. Retinal Projection Near-Eye Displays with Huygens? Metasurfaces. Advanced Optical Materials 11, 5 (2023), 2202348.
[42]
S.B. Stevenson, F.C. Volkmann, J.P. Kelly, and L.A. Riggs. 1986. Dependence of visual suppression on the amplitudes of saccades and blinks. Vision Research 26, 11 (1986), 1815?1824. https://doi.org/10.1016/0042-6989(86)90133-1
[43]
Larry N. Thibos, Ming Ye, Xiaoxiao Zhang, and Arthur Bradley. 1992. The chromatic eye: a new reduced-eye model of ocular chromatic aberration in humans. Appl. Opt. 31, 19 (Jul 1992), 3594?3600. https://doi.org/10.1364/AO.31.003594
[44]
MPS To, Roland J Baddeley, T Troscianko, and DJ Tolhurst. 2011. A general rule for sensory cue summation: Evidence from photographic, musical, phonetic and cross-modal stimuli. Proceedings of the Royal Society B: Biological Sciences 278, 1710 (2011), 1365?1372.
[45]
Cara Tursun and Piotr Didyk. 2022. Perceptual Visibility Model for Temporal Contrast Changes in Periphery. ACM Trans. Graph. 42, 2, Article 20 (nov 2022), 16 pages. https://doi.org/10.1145/3564241
[46]
Keiji Uchikawa and Masayuki Sato. 1995. Saccadic suppression of achromatic and chromatic responses measured by increment-threshold spectral sensitivity. JOSA A 12, 4 (1995), 661?666.
[47]
A. Van Meeteren and C.J.W. Dunnewold. 1983. Image quality of the human eye for eccentric entrance pupils. Vision Research 23, 5 (1983), 573?579. https://doi.org/10.1016/0042-6989(83)90133-5
[48]
Andrew Watson. 1986. Temporal Sensitivity. Handbook of perception and human performance 1, 6 (02 1986), 1?43.
[49]
Andrew B. Watson and John I. Yellott. 2012. A unified formula for light-adapted pupil size. Journal of Vision 12, 10 (09 2012), 12?12. https://doi.org/10.1167/12.10.12
[50]
Gerald Westheimer. 1966. The maxwellian view. Vision Research 6, 11 (1966), 669?682. https://doi.org/10.1016/0042-6989(66)90078-2
[51]
Gerald Westheimer. 2008. Directional sensitivity of the retina: 75 years of Stiles?Crawford effect. Proceedings of the Royal Society B: Biological Sciences 275, 1653 (2008), 2777?2786. https://doi.org/10.1098/rspb.2008.0712
[52]
Felix A Wichmann and N Jeremy Hill. 2001. The psychometric function: I. Fitting, sampling, and goodness of fit. Perception & psychophysics 63, 8 (2001), 1293?1313.
[53]
Jianghao Xiong, Yannanqi Li, Kun Li, and Shin-Tson Wu. 2021. Aberration-free pupil steerable Maxwellian display for augmented reality with cholesteric liquid crystal holographic lenses. Opt. Lett. 46, 7 (Apr 2021), 1760?1763. https://doi.org/10.1364/OL.422559
[54]
Chenchen Zhang, Dewen Cheng, Junguo Lin, and Yongtian Wang. 2020. Retinal projection display system based on MEMS scanning projector and conicoid curved semi-reflective mirror. In AOPC 2020: Display Technology; Photonic MEMS, THz MEMS, and Metamaterials; and AI in Optics and Photonics, Vol. 11565. SPIE, Beijing, China, 20?25.
[55]
Junyu Zou, Lingshan Li, and Shin-Tson Wu. 2022. Gaze-Matched Pupil Steering Maxwellian-View Augmented Reality Display with Large Angle Diffractive Liquid Crystal Lenses. Advanced Photonics Research 3, 5 (2022), 2100362. https://doi.org/10.1002/adpr.202100362
