“Pinlight displays: wide field of view augmented reality eyeglasses using defocused point light sources” by Maimone, Lanman, Rathinavel, Keller, Luebke, et al. …

  • ©Andrew Maimone, Douglas Lanman, Kishore Rathinavel, Kurtis Keller, David P. Luebke, and Henry Fuchs




    Pinlight displays: wide field of view augmented reality eyeglasses using defocused point light sources


Session Title: Computational Sensing & Display



    We present a novel design for an optical see-through augmented reality display that offers a wide field of view and supports a compact form factor approaching ordinary eyeglasses. Instead of conventional optics, our design uses only two simple hardware components: an LCD panel and an array of point light sources (implemented as an edge-lit, etched acrylic sheet) placed directly in front of the eye, out of focus. We code the point light sources through the LCD to form miniature see-through projectors. A virtual aperture encoded on the LCD allows the projectors to be tiled, creating an arbitrarily wide field of view. Software rearranges the target augmented image into tiled sub-images sent to the display, which appear as the correct image when observed out of the viewer’s accommodation range. We evaluate the design space of tiled point light projectors with an emphasis on increasing spatial resolution through the use of eye tracking. We demonstrate feasibility through software simulations and a real-time prototype display that offers a 110° diagonal field of view in the form factor of large glasses and discuss remaining challenges to constructing a practical display.


    1. Benoêt-Pasanau, C., Goudail, F., Chavel, P., Cano, J.-P., and Ballet, J. 2010. Minimization of diffraction peaks of spatial light modulators using Voronoi diagrams. Opt. Express 18, 14, 15223–15235.Google ScholarCross Ref
    2. Brown, M., Majumder, A., and Yang, R. 2005. Camera-based calibration techniques for seamless multiprojector displays. Visualization and Computer Graphics, IEEE Transactions on 11, 2 (March), 193–206. Google ScholarDigital Library
    3. Cakmakci, O., Thompson, K., Vallee, P., Cote, J., and Rolland, J. P. 2010. Design of a free-form single-element head-worn display. Proc. SPIE 7618, Emerging Liquid Crystal Technologies V, 761803-761803-6.Google Scholar
    4. Chaing, H.-C., Ho, T.-Y., and Sheu, C.-R., 2005. Structure for reducing the diffraction effect in periodic electrode arrangements and liquid crystal device including the same. US Patent. US 6977705.Google Scholar
    5. Cheng, D., Wang, Y., Hua, H., and Sasian, J. 2011. Design of a wide-angle, lightweight head-mounted display using free-form optics tiling. Opt. Lett. 36, 11 (Jun), 2098–2100.Google ScholarCross Ref
    6. Hagood, N., Barton, R., Brosnihan, T., Fijol, J., Gandhi, J., Halfman, M., Payne, R., and Steyn, J. L. 2007. 35.51: Late-news paper: A direct-view mems display for mobile applications. SID Symposium Digest of Technical Papers 38, 1, 1278–1281.Google ScholarCross Ref
    7. Hiura, S., Mohan, A., and Raskar, R. 2010. Krill-eye: Superposition compound eye for wide-angle imaging via grin lenses. IPSJ Transactions on Computer Vision and Applications, 186–199.Google Scholar
    8. Jurik, J., Jones, A., Bolas, M., and Debevec, P. 2011. Prototyping a light field display involving direct observation of a video projector array. In IEEE International Workshop on Projector-Camera Systems (PROCAMS).Google Scholar
    9. Kress, B., and Starner, T. 2013. A review of head-mounted displays (HMD) technologies and applications for consumer electronics. In Proc. SPIE, vol. 8720.Google Scholar
    10. Lanman, D., and Luebke, D. 2013. Near-eye light field displays. ACM Trans. Graph. 32, 6 (Nov.), 220:1–220:10. Google ScholarDigital Library
    11. Levola, T. 2006. Diffractive optics for virtual displays. In Journal of the Society for Information Display.Google Scholar
    12. Maimone, A., and Fuchs, H. 2013. Computational augmented reality eyeglasses. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on, 29–38.Google Scholar
    13. Mohan, A., Woo, G., Hiura, S., Smithwick, Q., and Raskar, R. 2009. Bokode: Imperceptible visual tags for camera based interaction from a distance. In ACM SIGGRAPH 2009 Papers, ACM, New York, NY, USA, SIGGRAPH ’09, 98:1–98:8. Google ScholarDigital Library
    14. Pamplona, V. F., Mohan, A., Oliveira, M. M., and Raskar, R. 2010. Netra: Interactive display for estimating refractive errors and focal range. In ACM SIGGRAPH 2010 Papers, ACM, New York, NY, USA, SIGGRAPH ’10, 77:1–77:8. Google ScholarDigital Library
    15. Pamplona, V. F., Passos, E. B., Zizka, J., Oliveira, M. M., Lawson, E., Clua, E., and Raskar, R. 2011. Catra: Interactive measuring and modeling of cataracts. In ACM SIGGRAPH 2011 Papers, ACM, New York, NY, USA, SIGGRAPH ’11, 47:1–47:8. Google ScholarDigital Library
    16. Son, J.-Y., Saveljev, V. V., Kim, D.-S., Kwon, Y.-M., and Kim, S.-H. 2007. Three-dimensional imaging system based on a light-emitting diode array. Optical Engineering 46, 10, 103205-103205-4.Google ScholarCross Ref
    17. Świrski, L., Bulling, A., and Dodgson, N. A. 2012. Robust real-time pupil tracking in highly off-axis images. In Proceedings of ETRA. Google ScholarDigital Library
    18. Travis, A., Large, T., Emerton, N., and Bathiche, S. 2013. Wedge optics in flat panel displays. Proceedings of the IEEE 101, 1, 45–60.Google ScholarCross Ref

ACM Digital Library Publication: