“Beaming Displays” by Itoh, Kaminokado and Akşit
Conference:
Type(s):
Interest Area:
- New Technologies
Title:
- Beaming Displays
Session/Category Title: TVCG Session on VR
Presenter(s)/Author(s):
Abstract:
Existing near-eye display designs struggle to balance between multiple trade-offs such as form factor, weight, computational requirements, and battery life. These design trade-offs are major obstacles on the path towards an all-day usable near-eye display. In this work, we address these trade-offs by, paradoxically, removing the display from near-eye displays. We present the beaming displays, a new type of near-eye display system that uses a projector and an all passive wearable headset. We modify an off-the-shelf projector with additional lenses. We install such a projector to the environment to beam images from a distance to a passive wearable headset. The beaming projection system tracks the current position of a wearable headset to project distortion-free images with correct perspectives. In our system, a wearable headset guides the beamed images to a user’s retina, which are then perceived as an augmented scene within a user’s field of view. In addition to providing the system design of the beaming display, we provide a physical prototype and show that the beaming display can provide resolutions as high as consumer-level near-eye displays. We also discuss the different aspects of the design space for our proposal.
References:
1.
K. Akşit, “Patch scanning displays: spatiotemporal enhancement for displays”, Optics Express, vol. 28, no. 2, pp. 2107-2121, 2020.
2.
K. Akşit, P. Chakravarthula, K. Rathinavel, Y. Jeong, R. Albert, H. Fuchs, et al., “Manufacturing application-driven foveated near-eye displays”, IEEE transactions on visualization and computer graphics, vol. 25, no. 5, pp. 1928-1939, 2019.
3.
A. Bauer, E. M. Schiesser and J. P. Rolland, “Starting geometry creation and design method for freeform optics”, Nature communications, vol. 9, no. 1, pp. 1-11, 2018.
4.
H. Benko, E. Ofek, F. Zheng and A. D. Wilson, “Fovear: Combining an optically see-through near-eye display with projector-based spatial augmented reality”, Proc. of the 28th ACM UIST, pp. 129-135, 2015.
5.
H. Benko, A. D. Wilson and F. Zannier, “Dyadic projected spatial augmented reality”, Proceedings of the 27th annual ACM symposium on User interface software and technology, pp. 645-655, 2014.
6.
O. Bimber and R. Raskar, “Modern approaches to augmented reality”, ACM SIGGRAPH 2006 Courses, pp. 1-es, 2006.
7.
P. D. Burns et al., “Slanted-edge mtf for digital camera and scanner analysis”, Is and Ts Pics Conference, pp. 135-138, 2000.
8.
J. De Smet, A. Avci, P. Joshi, D. Schaubroeck, D. Cuypers and H. De Smet, “Progress toward a liquid crystal contact lens display”, Journal of the Society for Information Display, vol. 21, no. 9, pp. 399-406, 2013.
9.
A. C. Dirican and M. Göktürk, “Involuntary postural responses of users as input to attentive computing systems: An investigation on head movements”, Computers in Human Behavior, vol. 28, no. 5, pp. 1634-1647, 2012.
10.
M. R. Foreman and P. Török, “Computational methods in vectorial imaging”, Journal of Modern Optics, vol. 58, no. 5–6, pp. 339-364, 2011.
11.
T. Hamasaki and Y. Itoh, “Varifocal occlusion for optical see-through head-mounted displays using a slide occlusion mask”, IEEE TVCG, vol. 25, no. 5, pp. 1961-1969, 2019.
12.
M. K. Hedili, M. O. Freeman and H. Urey, “Microlens array-based high-gain screen design for direct projection head-up displays”, Applied optics, vol. 52, no. 6, pp. 1351-1357, 2013.
13.
F. Herpich, R. L. M. Guarese, L. M. R. Tarouco et al., “A comparative analysis of augmented reality frameworks aimed at the development of educational applications”, Creative Education, vol. 8, no. 09, pp. 1433, 2017.
14.
C. W. Hsu, B. Zhen, W. Qiu, O. Shapira, B. G. DeLacy, J. D. Joannopoulos, et al., “Transparent displays enabled by resonant nanoparticle scattering”, Nature communications, vol. 5, no. 1, pp. 1-6, 2014.
15.
D. Iwai, S. Mihara and K. Sato, “Extended depth-of-field projector by fast focal sweep projection”, IEEE transactions on visualization and computer graphics, vol. 21, no. 4, pp. 462-470, 2015.
16.
D. Kade, K. Akşit, H. Ürey and O. Özcan, “Head-mounted mixed reality projection display for games production and entertainment”, Personal and Ubiquitous Computing, vol. 19, no. 3–4, pp. 509-521, 2015.
17.
T. Kaminokado, Y. Hiroi and Y. Itoh, “Stainedview: Variable-intensity light-attenuation display with cascaded spatial color filtering for improved color fidelity”, IEEE TVCG, pp. 3576-3586, 2020.
18.
T. Kawahara, D. Iwai and K. Sato, “Dynamic path planning of flying projector considering collision avoidance with observer and bright projection”, Proceedings of the 23rd International Conference on Intelligent User Interfaces Companion, pp. 1-2, 2018.
19.
G. A. Koulieris, K. Akşit, M. Stengel, R. K. Mantiuk, K. Mania and C. Richardt, “Near-eye display and tracking technologies for virtual and augmented reality” in Computer Graphics Forum, Wiley Online Library, vol. 38, pp. 493-519, 2019.
20.
B. C. Kress, “Optical waveguide combiners for ar headsets: features and limitations” in Digital Optical Technologies 2019, J. International Society for Optics and Photonics, vol. 11062, pp. 110620, 2019.
21.
G. Kuo, L. Waller, R. Ng and A. Maimone, “High resolution étendue expansion for holographic displays”, ACM Transactions on Graphics (TOG), vol. 39, no. 4, pp. 66-1, 2020.
22.
S. Lan, X. Zhang, M. Taghinejad, S. Rodrigues, K.-T. Lee, Z. Liu, et al., “Metasurfaces for near-eye augmented reality”, ACS Photonics, vol. 6, no. 4, pp. 864-870, 2019.
23.
T. Langlotz, J. Sutton, S. Zollmann and H. Itoh, “Yuta & Regenbrecht. Chromaglasses: Computational glasses for compensating colour blindness”, Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, vol. 390, pp. 1-390, 2018.
24.
R. LiKamWa, Z. Wang, A. Carroll, F. X. Lin and L. Zhong, “Draining our glass: An energy and heat characterization of google glass”, Proceedings of 5th Asia-Pacific Workshop on Systems, pp. 1-7, 2014.
25.
P. Lincoln, A. Blate, M. Singh, T. Whitted, A. State and H. Lastra, “Anselmo & Fuchs. From motion to photons in 80 microseconds: Towards minimal latency for virtual and augmented reality”, IEEE Trans. on Visualization and Computer Graphics, vol. 22, no. 4, pp. 1367-1376, 2016.
26.
P. S. Martin, “Mojo vision nanoleds for invisible computing” in Light-Emitting Devices Materials and Applications XXIV, International Society for Optics and Photonics, vol. 11302, pp. 1130204, 2020.
27.
Y. Mikawa, T. Sueishi, Y. Watanabe and M. Ishikawa, “Variolight: Hybrid dynamic projection mapping using high-speed projector and optical axis controller”, SIGGRAPH Asia 2018 Emerging Technologies, pp. 1-2, 2018.
28.
L. Miyashita, Y. Watanabe and M. Ishikawa, “High-speed image rotator for blur-canceling roll camera”, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 6047-6052, 2015.
29.
A. Mohan, G. Woo, S. Hiura, Q. Smithwick and R. Raskar, “Bokode: imperceptible visual tags for camera based interaction from a distance”, ACM SIGGRAPH 2009 papers, pp. 1-8, 2009.
30.
G. Narita, Y. Watanabe and M. Ishikawa, “Dynamic projection mapping onto deforming non-rigid surface using deformable dot cluster marker”, IEEE transactions on visualization and computer graphics, vol. 23, no. 3, pp. 1235-1248, 2016.
31.
K. Okumura, H. Oku and M. Ishikawa, “Lumipen: Projection-based mixed reality for dynamic objects”, 2012 IEEE International Conference on Multimedia and Expo, pp. 699-704, 2012.
32.
J. Rekimoto and K. Nagao, “The world through the computer: Computer augmented interaction with real world environments”, Proceedings of the 8th annual ACM symposium on User interface and software technology, pp. 29-36, 1995.
33.
J. P. Rolland, K. P. Thompson, H. Urey and M. Thomas, See-through head worn display (hwd) architectures., 2012.
34.
L. Sidenmark and H. Gellersen, “Eye head and torso coordination during gaze shifts in virtual reality”, ACM Transactions on Computer-Human Interaction (TOCHI), vol. 27, no. 1, pp. 1-40, 2019.
35.
S. R. Soomro and H. Urey, “Design fabrication and characterization of transparent retro-reflective screen”, Optics express, vol. 24, no. 21, pp. 24232-24241, 2016.
36.
I. E. Sutherland, “A head-mounted three dimensional display”, Proceedings of the December 9–11 1968 fall joint computer conference part I, pp. 757-764, 1968.
37.
L. Wang, H. Xu, S. Tabata, Y. Hu, Y. Watanabe and M. Ishikawa, “Highspeed focal tracking projection based on liquid lens”, Special Interest Group on Computer Graphics and Interactive Techniques Conference Emerging Technologies, pp. 1-2, 2020.
38.
A. Woods, “3-d displays in the home”, Information Display, vol. 25, no. 7, pp. 8-12, 2009.
39.
A. Yamamoto, Y. Yanai, M. Nagai, R. Suzuki and Y. Ito, “16–3: A novel transparent screen using cholesteric liquid crystal dots”, SID Symposium Digest of Technical Papers, vol. 47, pp. 185-188, 2016.
