“iLamps: geometrically aware and self-configuring projectors” by Raskar, van Baar, Beardsley, Willwacher, Rao, et al. …

  • ©Ramesh Raskar, Jeroen van Baar, Paul Beardsley, Thomas Willwacher, Srinivas Rao, and Clifton Forlines




    iLamps: geometrically aware and self-configuring projectors



    Projectors are currently undergoing a transformation as they evolve from static output devices to portable, environment-aware, communicating systems. An enhanced projector can determine and respond to the geometry of the display surface, and can be used in an ad-hoc cluster to create a self-configuring display. Information display is such a prevailing part of everyday life that new and more flexible ways to present data are likely to have significant impact. This paper examines geometrical issues for enhanced projectors, relating to customized projection for different shapes of display surface, object augmentation, and co-operation between multiple units.We introduce a new technique for adaptive projection on nonplanar surfaces using conformal texture mapping. We describe object augmentation with a hand-held projector, including interaction techniques. We describe the concept of a display created by an ad-hoc cluster of heterogeneous enhanced projectors, with a new global alignment scheme, and new parametric image transfer methods for quadric surfaces, to make a seamless projection. The work is illustrated by several prototypes and applications.


    1. AGARWAL, P., AMENTA, N., ARONOV, B., AND SHARIR, M. 1996. Largest Placements and Motion Planning of a Convex Polygon. In 2nd International Workshop on Algorithmic Foundation of Robotics, 1996, 28–37.Google Scholar
    2. BIER, E. A., STONE, M. C., PIER, K., BUXTON, W., AND DEROSE, T. D. 1993. Toolglass and Magic Lenses: The See-Through Interface. In Proceedings of ACM SIGGRAPH 1993, 73–80. Google Scholar
    3. BIMBER, O., GATESY, S., WITMER, L., RASKAR, R., AND ENCARNAO, E. 2002. Merging Fossil Specimens with Computer-Generated Information. In IEEE Computer, 32–39. Google Scholar
    4. BROWN, M. S., AND SEALES, W. B. 2002. A Practical and Flexible Large Format Display System. In The Tenth Pacific Conference on Computer Graphics and Applications, 178–183. Google Scholar
    5. CANESTA, 2002. Miniature Laser Projector Keyboard. http://www.canesta.com, Cited December 2002.Google Scholar
    6. CHEN, Y., CHEN, H., CLARK, D. W., LIU, Z., WALLACE, G., AND LI, K. 2000. Automatic Alignment of High-Resolution Multi-Projector Displays Using An Un-Calibrated Camera. In IEEE Visualization 2000, 125–130. Google ScholarDigital Library
    7. CHEN, H., SUKTHANKAR, R., WALLACE, G., AND LI, K. 2002. Scalable Alignment of Large-Format Multi-Projector Displays Using Camera Homography Trees. In Proceedings of Visualization, 2002, 135–142. Google ScholarDigital Library
    8. CROSS, G., AND ZISSERMAN, A. 1998. Quadric Surface Reconstruction from Dual-Space Geometry. In Proceedings of 6th International Conference on Computer Vision(Bombay, India), 25–31. Google Scholar
    9. CROWLEY, J., COUTAZ, J., AND BERARD, F. 2000. Things That See. Communications of the ACM (Mar.), 54–64. Google Scholar
    10. DAVIS, J. 1998. Mosaics of Scenes with Moving Objects. In IEEE Computer Vision and Pattern Recognition (CVPR), 354–360. Google Scholar
    11. HERELD, M., JUDSON, I. R., AND STEVENS, R. L. 2000. Introduction to Building Projection-based Tiled Display Systems. IEEE Computer Graphics and Applications 20, 4, 22–28. Google ScholarDigital Library
    12. HUMPHREYS, G., ELDRIDGE, M., B., I., STOLL, G., EVERETT, M., AND HANRAHAN, P. 2001. WireGL: A Scalable Graphics System for Clusters. In Proceedings of SIGGRAPH 2001, 129–140. Google ScholarDigital Library
    13. JARVIS, K. 1997. Real Time 60Hz Distortion Correction on a Silicon Graphics IG. Real Time Graphics 5, 7 (Feb.), 6–7.Google Scholar
    14. JAYNES, C., WEBB, S., STEELE, R., BROWN, M., AND SEALES, B. 2001. Dynamic Shadow Removal from Front Projection Displays,. In IEEE Visualization 2001, 152–157. Google ScholarDigital Library
    15. JENOPTIK, 2002. Laser Projector. http://www.jenoptik.com, Cited December 2002.Google Scholar
    16. KJELDSEN, R., PINHANEZ, C., PINGALI, G., HARTMAN, J., LEVAS, T., AND PODLASECK, M. 2002. Interacting with Steerable Projected Displays. In Proc. of the 5th International Conference on Automatic Face and Gesture Recognition, 12–17. Google Scholar
    17. LEVY, B., PETITJEAN, S., RAY, N., AND MAILLOT, J. 2002. Least Squares Conformal Maps for Automatic Texture Atlas Generation. In ACM Transactions on Graphics, vol. 21, 3, 162–170. Google ScholarDigital Library
    18. LU, C., HAGER, G., AND MJOLSNESS, E. 2000. Fast and Globally Convergent Pose Estimation from Video Images. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 6, 610–622. Google ScholarDigital Library
    19. MAJUMDER, A., HE, Z., TOWLES, H., AND WELCH, G. 2000. Color Calibration of Projectors for Large Tiled Displays. In IEEE Visualization 2000, 102–108.Google Scholar
    20. PINHANEZ, C. 2001. The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. In Ubiquitous Computing 2001 (Ubicomp”01), 12–17. Google Scholar
    21. RASKAR, R., AND BEARDSLEY, P. 2001. A Self Correcting Projector. In IEEE Computer Vision and Pattern Recognition (CVPR), 626–631.Google Scholar
    22. RASKAR, R., WELCH, G., CUTTS, M., LAKE, A., STESIN, L., AND FUCHS, H. 1998. The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays. In Proceedings of ACM SIGGRAPH 1998, 179–188. Google Scholar
    23. RASKAR, R., BROWN, M., RUIGANG, Y., CHEN, W., WELCH, G., TOWLES, H., SEALES, B., AND FUCHS, H. 1999. Multiprojector Displays using Camera-based Registration. In IEEE Visualization, 161–168. Google Scholar
    24. RASKAR, R., WELCH, G., LOW, K., AND BANDYOPADHYAY, B. 2001. Shader Lamps: Animating Real Objects With Image-Based Illumination. In Rendering Techniques 2001, The Eurographics Workshop on Rendering, 89–102. Google Scholar
    25. RASKAR, R., VANBAAR, J., AND CHAI, X. 2002. A Low Cost Projector Mosaic with Fast Registration. In Fifth Asian Conference on Computer Vision, 114–119.Google Scholar
    26. RASKAR, R. 2000. Immersive Planar Display using Roughly Aligned Projectors. In IEEE VR 2000, 27–34. Google ScholarDigital Library
    27. REKIMOTO, J., AND NAGAO, K. 1995. The World Through the Computer: Computer Augmented Interaction with Real World Environments. In Proceedings of UIST’95, 29–36. Google Scholar
    28. REKIMOTO, J., AND SAITOH, M. 1999. Augmented Surfaces: A Spatially Continuous Workspace for Hybrid Computing Environments. In Proceedings of CHI’99, 378–385. Google Scholar
    29. REKIMOTO, J. 1999. A Multiple-device Approach for Supporting Whiteboard-based Interactions. In Proceedings of CHI’98, 344–351. Google Scholar
    30. SAMANTA, R., ZHENG, J., FUNKHOUSER, T., LI, K., AND SINGH, J. P. 1999. Load Balancing for Multi-Projector Rendering Systems. In SIGGRAPH/Eurographics Workshop on Graphics Hardware, 12–19. Google Scholar
    31. SHASHUA, A., AND TOELG, S. 1997. The Quadric Reference Surface: Theory and Applications. In IJCV, vol. 23(2), 185–189. Google ScholarDigital Library
    32. SIEMENS, 2002. Siemens Mini Beamer. http://w4.siemens.de/en2/html/press//newsdesk_archive/2002/-foe02121b.html, Cited December 2002.Google Scholar
    33. SUKTHANKAR, R., STOCKTON, R., AND MULLIN, P. 2001. Smarter Presentations: Exploiting Homography in Camera-Projector Systems. In International Conference on Computer Vision, 82–87.Google Scholar
    34. SYMBOL, 2002. Laser Projection Display. http://www.symbol.com/products/oem/lpd.html, Cited December 2002.Google Scholar
    35. TRAVIS, A., PAYNE, F., ZHONG, J., AND MOORE, J. 2002. Flat panel display using projection within a wedge-shaped waveguide. http://ds.dial.pipex.com/cam3d/technology/technology01.html, Cited December 2002.Google Scholar
    36. TRIMENSION SYSTEMS LTD, 2002. http://www.trimension-inc.com/, Cited Dec 2002.Google Scholar
    37. UNDERKOFFLER, J., ULLMER, B., AND ISHII, H. 1999. Emancipated Pixels: Real-world Graphics in the Luminous Room. In Proceedings of ACM SIGGRAPH 1999, 385–392. Google Scholar
    38. WATSON, B., AND HODGES, L. 1989. A Fast Algorithm for Rendering Quadratic Curves on Raster Displays. In Proc. 27th Annual SE ACM Conference, 160–165.Google Scholar
    39. WELLNER, P. 1993. Interacting with paper on the DigitalDesk. Communications of the ACM 36, 7, 86–97. Google ScholarDigital Library
    40. WEXLER, Y., AND SHASHUA, A. 1999. Q-warping: Direct Computation of Quadratic Reference Surfaces. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June, 1999, 333–338.Google Scholar
    41. YANG, R., GOTZ, D., HENSLEY, J., TOWLES, H., AND BROWN, M. 2001. PixelFlex: A Reconfigurable Multi-Projector Display System. In IEEE Visualization 01, 68–75. Google ScholarDigital Library
    42. YOTSUKURA, T., MORISHIMA, S., NIELSEN, F., BINSTED, K., AND PINHANEZ, C. 2002. Hyper Mask – Talking Head Projected onto Real Object. The Visual Computer 18, 2, 111–120.Google ScholarDigital Library

ACM Digital Library Publication: