“Near-eye varifocal augmented reality display using see-through screens”
Conference:
Type(s):
Title:
- Near-eye varifocal augmented reality display using see-through screens
Session/Category Title: Displays
Presenter(s)/Author(s):
Abstract:
We present a new optical design for see-through near-eye displays that is simple, compact, varifocal, and provides a wide field of view with clear peripheral vision and large eyebox. Key to this effort is a novel see-through rear-projection screen. We project an image to the see-through screen using an off-axis path, which is then relayed to the user’s eyes through an on-axis partially-reflective magnifying surface. Converting the off-axis path to a compact on-axis imaging path simplifies the optical design. We establish fundamental trade-offs between the quantitative parameters of resolution, field of view, and the form-factor of our design. We demonstrate a wearable binocular near-eye display using off-the-shelf projection displays, custom-designed see-through spherical concave mirrors, and see-through screen designs using either custom holographic optical elements or polarization-selective diffusers.
References:
1. Gerhard Ackermann and Juergen Eichler. 2007. Holography: A Practical Approach. Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim. Cross Ref
2. Kurt Akeley, Simon J Watt, Ahna Reza Girshick, and Martin S Banks. 2004. A stereo display prototype with multiple focal distances. In ACM transactions on graphics (TOG), Vol. 23. ACM, 804–813.
3. Peter D Burns. 2000. Slanted-edge MTF for digital camera and scanner analysis. In Is and Ts Pics Conference. SOCIETY FOR IMAGING SCIENCE & TECHNOLOGY, 135–138.
4. Ozan Cakmakci and Jannick Rolland. 2006. Head-worn displays: a review. Journal of Display Technology 2, 3 (2006). Cross Ref
5. FW Campbell and G Westheimer. 1960. Dynamics of accommodation responses of the human eye. The Journal of Physiology 151, 2 (1960), 285–295. Cross Ref
6. Jee-Gong Chang and Yu-Bin Fang. 2007. Dot-pattern design of a light guide in an edge-lit backlight using a regional partition approach. Optical Engineering 46, 4 (2007).
7. Dewen Cheng, Yongtian Wang, Hong Hua, and MM Talha. 2009. Design of an optical see-through head-mounted display with a low f-number and large field of view using a freeform prism. Applied Optics 48, 14 (2009).
8. Kenneth J Ciuffreda, Arkady Selenow, Bin Wang, Balamurali Vasudevan, George Zikos, and Steven R Ali. 2006. Bothersome blur: A functional unit of blur perception. Vision research 46, 6 (2006), 895–901.
9. Antonio J Del Águila-Carrasco, Iván Marín-Franch, Paula Bernal-Molina, José J Esteve-Taboada, Philip B Kruger, Robert Montés-Micó, and Norberto López-Gil. 2017. Accommodation Responds to Optical Vergence and Not Defocus Blur AloneAccommodation Responds to Optical Vergence. Investigative Ophthalmology & Visual Science 58, 3 (2017), 1758–1763. Cross Ref
10. Justin G Droessler and Donald J Rotier. 1990. Tilted cat helmet-mounted display. Optical Engineering 29, 8 (1990).
11. D. Dunn, C. Tippets, K. Torell, P. Kellnhofer, K. Akşit, P. Didyk, K. Myszkowski, D. Luebke, and H. Fuchs. 2017. Wide Field Of View Varifocal Near-Eye Display Using See-Through Deformable Membrane Mirrors. IEEE Transactions on Visualization and Computer Graphics (2017).
12. Leon Eisen, Michael Meyklyar, Michael Golub, Asher A. Friesem, Ioseph Gurwich, and Victor Weiss. 2006. Planar configuration for image projection. Applied Optics 45, 17 (2006).
13. HJ Gerritsen, WJ Hannan, and EG Ramberg. 1968. Elimination of speckle noise in holograms with redundancy. Applied optics 7, 11 (1968), 2301–2311.
14. Pinhas Gilboa. 1991. Designing the right visor. In Medical Imaging. International Society for Optics and Photonics.
15. Patrick Görrn, Michelle Sander, Jens Meyer, Michael Kröger, Eike Becker, H-H Johannes, Wolfgang Kowalsky, and Thomas Riedl. 2006. Towards see-through displays: fully transparent thin-film transistors driving transparent organic light-emitting diodes. Advanced Materials 18, 6 (2006).
16. Claire Gu, Jenn-Ren Lien, Foster Dai, and John Hong. 1996. Diffraction Properties of Volume Holographic Diffusers. Journal of the Optical Society of America A, Optics and Image Science 13, 8 (08 1996). Cross Ref
17. Mickael Guillaumee, Seyed Payam Vahdati, Eric Tremblay, Arnaud Mader, Gabriel Bernasconi, Victor J. Cadarso, Jonas Grossenbacher, Juergen Brugger, Randall Sprague, and Christophe Moser. 2014. Curved Holographic Combiner for Color Head Worn Display. Journal of Display Technology 10, 6 (2014). Cross Ref
18. M Kivanc Hedili, Mark O Freeman, and Hakan Urey. 2013. Microlens array-based high-gain screen design for direct projection head-up displays. Applied Optics 52, 6 (2013).
19. Chia Wei Hsu, Bo Zhen, Wenjun Qiu, Ofer Shapira, Brendan G DeLacy, John D Joannopoulos, and Marin Soljačić. 2014. Transparent displays enabled by resonant nanoparticle scattering. Nature Communications 5 (2014).
20. Xinda Hu and Hong Hua. 2014. High-resolution optical see-through multi-focal-plane head-mounted display using freeform optics. Optics express 22, 11 (2014).
21. Hong Hua. 2017. Enabling Focus Cues in Head-Mounted Displays. Proc. IEEE 105, 5 (2017), 805–824. Cross Ref
22. Hong Hua and Bahram Javidi. 2014. A 3D integral imaging optical see-through head-mounted display. Optics express 22, 11 (2014).
23. Fu-Chung Huang, Kevin Chen, and Gordon Wetzstein. 2015. The light field stereoscope: immersive computer graphics via factored near-eye light field displays with focus cues. ACM Transactions on Graphics (TOG) 34, 4 (2015).
24. Daisuke Iwai, Shoichiro Mihara, and Kosuke Sato. 2015. Extended depth-of-field projector by fast focal sweep projection. IEEE Transactions on Visualization and Computer Graphics 21, 4 (2015), 462–470. Cross Ref
25. Paul V Johnson, Jared AQ Parnell, Joohwan Kim, Christopher D Saunter, Gordon D Love, and Martin S Banks. 2016. Dynamic lens and monovision 3D displays to improve viewer comfort. Optics Express 24, 11 (2016).
26. Hee-jae Kim, Sung-Keun Lee, Mei-Lan Piao, Nam Kim, and Jae-Hyeung Park. 2015. Three-dimensional holographic head mounted display using holographic optical element. In Consumer Electronics (ICCE), 2015 IEEE International Conference on. IEEE, 132–133.
27. Robert Konrad, Emily A Cooper, and Gordon Wetzstein. 2016. Novel optical configurations for virtual reality: evaluating user preference and performance with focus-tunable and monovision near-eye displays. In Human Factors in Computing Systems.
28. Robert Konrad, Nitish Padmanaban, Keenan Molner, Emily A Cooper, and Gordon Wetzstein. 2017. Accommodation-invariant computational near-eye displays. ACM Transactions on Graphics (TOG) 36, 4 (2017), 88.
29. Gregory Kramida and Varshney Amitabh. 2016. Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics 22, 7 (2016). Cross Ref
30. Bernard Kress and Meimei Shin. 2013. Diffractive and holographic optics as optical combiners in head mounted displays. In Pervasive and Ubiquitous Computing Adjunct Publication.
31. Bernard Kress and Thad Starner. 2013. A review of head-mounted displays (HMD) technologies and applications for consumer electronics. In SPIE Defense, Security, and Sensing. International Society for Optics and Photonics.
32. Philip B Kruger, Sujata Nowbotsing, Karan R Aggarwala, and Steven Mathews. 1995. Small amounts of chromatic aberration influence dynamic accommodation. Optometry & Vision Science 72, 9 (1995), 656–666. Cross Ref
33. Douglas Lanman and David Luebke. 2013. Near-eye light field displays. ACM Transactions on Graphics (TOG) 32, 6 (2013).
34. Seungjae Lee, Changwon Jang, Seokil Moon, Jaebum Cho, and Byoungho Lee. 2016. Additive light field displays: realization of augmented reality with holographic optical elements. ACM Transactions on Graphics (TOG) 35, 4 (2016).
35. Gang Li, Dukho Lee, Youngmo Jeong, Jaebum Cho, and Byoungho Lee. 2016. Holographic display for see-through augmented reality using mirror-lens holographic optical element. Optics letters 41, 11 (2016).
36. Peter Lincoln, Alex Blate, Montek Singh, Andrei State, Mary C. Whitton, Turner Whitted, and Henry Fuchs. 2017. Scene-adaptive high dynamic range display for low latency augmented reality. In Proceedings of the 21st ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. ACM, 15.
37. Gabriel Lippmann. 1908. Epreuves reversibles. photographies integrals. Comptes-Rendus Academie des Sciences 146 (1908).
38. Sheng Liu, Dewen Cheng, and Hong Hua. 2008. An optical see-through head mounted display with addressable focal planes. In International Symposium on Mixed and Augmented Reality.
39. Chenguang Ma, Jinli Suo, Qionghai Dai, Ramesh Raskar, and Gordon Wetzstein. 2013. High-rank coded aperture projection for extended depth of field. In Computational Photography (ICCP). IEEE.
40. Kevin J MacKenzie, David M Hoffman, and Simon J Watt. 2010. Accommodation to multiple-focal-plane displays: Implications for improving stereoscopic displays and for accommodation control. Journal of vision 10, 8 (2010), 22–22. Cross Ref
41. Andrew Maimone, Andreas Georgiou, and Joel Kollin. 2017. Holographic Near-Eye Displays for Virtual and Augmented Reality. ACM Transactions on Graphics 36 (2017).
42. Andrew Maimone, Douglas Lanman, Kishore Rathinavel, Kurtis Keller, David Luebke, and Henry Fuchs. 2014. Pinlight Displays: Wide Field of View Augmented Reality Eyeglasses Using Defocused Point Light Sources. ACM Trans. Graph. 33, 4 (2014).
43. Belen Masia, Gordon Wetzstein, Piotr Didyk, and Diego Gutierrez. 2013. A survey on computational displays: Pushing the boundaries of optics, computation, and perception. Computers & Graphics 37, 8 (2013), 1012–1038.
44. Nathan Matsuda, Alexander Fix, and Douglas Lanman. 2017. Focal surface displays. ACM Transactions on Graphics (TOG) 36, 4 (2017), 86.
45. Nitish Padmanaban, Robert Konrad, Tal Stramer, Emily A Cooper, and Gordon Wetzstein. 2017. Optimizing virtual reality for all users through gaze-contingent and adaptive focus displays. Proceedings of the National Academy of Sciences (2017), 201617251. Cross Ref
46. Donghao Ren, Tibor Goldschwendt, YunSuk Chang, and Tobias Höllerer. 2016. Evaluating wide-field-of-view augmented reality with mixed reality simulation. In Virtual Reality (VR), 2016 IEEE. IEEE, 93–102.
47. Jannick P Rolland and Henry Fuchs. 2000. Optical versus video see-through head-mounted displays in medical visualization. Presence: Teleoperators and Virtual Environments 9, 3 (2000).
48. Donald J Rotier. 1989. Optical approaches to the helmet mounted display. In 1989 Orlando Symposium. International Society for Optics and Photonics. Cross Ref
49. Graham Saxby and Stanislovas Zacharovas. 2016. Practical Holography (fourth edition ed.). CRC Press, Taylor & Francis Group, LLC, 6000 Broken Sound Parkway, NW, Suite 300, Boca Raton, FL 33487–2742.
50. Helge Seetzen, Wolfgang Heidrich, Wolfgang Stuerzlinger, Greg Ward, Lorne White-head, Matthew Trentacoste, Abhijeet Ghosh, and Andrejs Vorozcovs. 2004. High dynamic range display systems. ACM Transactions on Graphics (TOG) 23, 3 (2004).
51. Jong-Wook Seo and Taeho Kim. 2008. Double-layer projection display system using scattering polarizer film. Japanese Journal of Applied Physics 47, 3R (2008). Cross Ref
52. Fergal P Shevlin. 2012. Speckle reduction in laser-illuminated picoprojectors. In Proc. SPIE, Vol. 8252. 825206. Cross Ref
53. Takashi Shibata, Takashi Kawai, Keiji Ohta, Masaki Otsuki, Nobuyuki Miyake, Yoshihiro Yoshihara, and Tsuneto Iwasaki. 2005. Stereoscopic 3-D display with optical correction for the reduction of the discrepancy between accommodation and convergence. Journal of the Society for Information Display 13, 8 (2005), 665–671. Cross Ref
54. Shoaib R Soomro and Hakan Urey. 2016. Design, fabrication and characterization of transparent retro-reflective screen. Optics Express 24, 21 (2016).
55. T Sugihara and T Miyasato. 1998. A Lightweight 3-D HMD with Accommodative Compensation. In SID Symposium Digest of Technical Papers, Vol. 29. Wiley Online Library, 927–930. Cross Ref
56. Ivan E Sutherland. 1968. A head-mounted three dimensional display. In Proceedings of the December 9–11, 1968, Fall Joint Computer Conference, part I. ACM.
57. Elen Tolstik, Alexander Winkler, Vladislav Matusevich, Richard Kowarschik, Uladzimir V. Mahilny, Dzianis N. Marmysh, Yuri Ivanovich Matusevich, and Leonid Petrovich Krul. 2009. PMMA-PQ Photopolymers for Head-Up-Displays. IEEE Photonics Technology Letters 21, 12 (2009). Cross Ref
58. Adrian RL Travis, Timothy A Large, Neil Emerton, and Steven N Bathiche. 2013. Wedge optics in flat panel displays. Proc. IEEE 101, 1 (2013). Cross Ref
59. Yu-Hsiang Tsai, Mao-Hsiu Huang, Ting-Wei Huang, Kuo-Lung Lo, Mang Ou-Yang, et al. 2015. Image quality affected by diffraction of aperture structure arrangement in transparent active-matrix organic light-emitting diode displays. Applied Optics 54, 28 (2015).
60. Hakan Urey. 2000. Optical advantages in retinal scanning displays. In AeroSense 2000. International Society for Optics and Photonics.
61. Takeru Utsugi and Masahiro Yamaguchi. 2013. Reduction of the recorded speckle noise in holographic 3D printer. Optics express 21, 1 (2013), 662–674.
62. Junhua Wang, Yuechao Liang, and Min Xu. 2016. Design of a See-Through Head-Mounted Display with a Freeform Surface. Journal of the Optical Society of Korea 19, 6 (2016).
63. Technical Staff Wearality. 2015. Wearality Sky Field of View. White Paper. http://wearality.com/WearalitySkyFieldOfView.pdf
64. Paul Webb. 1964. Bioastronautics data book. (1964).
65. Andrew J Woods, Tom Docherty, and Rolf Koch. 1993. Image distortions in stereoscopic video systems. In IS&T/SPIE’s Symposium on Electronic Imaging: Science and Technology. International Society for Optics and Photonics.
66. Akira Yamamoto, Yujiro Yanai, Michio Nagai, Ryo Suzuki, and Yoji Ito. 2016. 16-3: A Novel Transparent Screen Using Cholesteric Liquid Crystal Dots. Digest of Technical Papers 47, 1 (2016).
67. Fei Yang, Yuri Murakami, and Masahiro Yamaguchi. 2012. Digital color management in full-color holographic three-dimensional printer. Applied optics 51, 19 (2012), 4343–4352.
68. Jiwoon Yeom, Jinsoo Jeong, Changwon Jang, Keehoon Hong, Soon-gi Park, and Byoungho Lee. 2014. Reflection-type integral imaging system using a diffuser holographic optical element. Optics express 22, 24 (2014), 29617–29626.
