“iLamps: geometrically aware and self-configuring projectors” by Raskar, van Baar, Beardsley, Willwacher, Rao, et al. …

Projectors are currently undergoing a transformation as they evolve from static output devices to portable, environment-aware, communicating systems. An enhanced projector can determine and respond to the geometry of the display surface, and can be used in an ad-hoc cluster to create a self-configuring display. Information display is such a prevailing part of everyday life that new and more flexible ways to present data are likely to have significant impact. This paper examines geometrical issues for enhanced projectors, relating to customized projection for different shapes of display surface, object augmentation, and co-operation between multiple units.We introduce a new technique for adaptive projection on nonplanar surfaces using conformal texture mapping. We describe object augmentation with a hand-held projector, including interaction techniques. We describe the concept of a display created by an ad-hoc cluster of heterogeneous enhanced projectors, with a new global alignment scheme, and new parametric image transfer methods for quadric surfaces, to make a seamless projection. The work is illustrated by several prototypes and applications.

1. AGARWAL, P., AMENTA, N., ARONOV, B., AND SHARIR, M. 1996. Largest Placements and Motion Planning of a Convex Polygon. In 2nd International Workshop on Algorithmic Foundation of Robotics, 1996, 28–37.Google Scholar
2. BIER, E. A., STONE, M. C., PIER, K., BUXTON, W., AND DEROSE, T. D. 1993. Toolglass and Magic Lenses: The See-Through Interface. In Proceedings of ACM SIGGRAPH 1993, 73–80. Google Scholar
3. BIMBER, O., GATESY, S., WITMER, L., RASKAR, R., AND ENCARNAO, E. 2002. Merging Fossil Specimens with Computer-Generated Information. In IEEE Computer, 32–39. Google Scholar
4. BROWN, M. S., AND SEALES, W. B. 2002. A Practical and Flexible Large Format Display System. In The Tenth Pacific Conference on Computer Graphics and Applications, 178–183. Google Scholar
5. CANESTA, 2002. Miniature Laser Projector Keyboard. http://www.canesta.com, Cited December 2002.Google Scholar
6. CHEN, Y., CHEN, H., CLARK, D. W., LIU, Z., WALLACE, G., AND LI, K. 2000. Automatic Alignment of High-Resolution Multi-Projector Displays Using An Un-Calibrated Camera. In IEEE Visualization 2000, 125–130. Google ScholarDigital Library
7. CHEN, H., SUKTHANKAR, R., WALLACE, G., AND LI, K. 2002. Scalable Alignment of Large-Format Multi-Projector Displays Using Camera Homography Trees. In Proceedings of Visualization, 2002, 135–142. Google ScholarDigital Library
8. CROSS, G., AND ZISSERMAN, A. 1998. Quadric Surface Reconstruction from Dual-Space Geometry. In Proceedings of 6th International Conference on Computer Vision(Bombay, India), 25–31. Google Scholar
9. CROWLEY, J., COUTAZ, J., AND BERARD, F. 2000. Things That See. Communications of the ACM (Mar.), 54–64. Google Scholar
10. DAVIS, J. 1998. Mosaics of Scenes with Moving Objects. In IEEE Computer Vision and Pattern Recognition (CVPR), 354–360. Google Scholar
11. HERELD, M., JUDSON, I. R., AND STEVENS, R. L. 2000. Introduction to Building Projection-based Tiled Display Systems. IEEE Computer Graphics and Applications 20, 4, 22–28. Google ScholarDigital Library
12. HUMPHREYS, G., ELDRIDGE, M., B., I., STOLL, G., EVERETT, M., AND HANRAHAN, P. 2001. WireGL: A Scalable Graphics System for Clusters. In Proceedings of SIGGRAPH 2001, 129–140. Google ScholarDigital Library
13. JARVIS, K. 1997. Real Time 60Hz Distortion Correction on a Silicon Graphics IG. Real Time Graphics 5, 7 (Feb.), 6–7.Google Scholar
14. JAYNES, C., WEBB, S., STEELE, R., BROWN, M., AND SEALES, B. 2001. Dynamic Shadow Removal from Front Projection Displays,. In IEEE Visualization 2001, 152–157. Google ScholarDigital Library
15. JENOPTIK, 2002. Laser Projector. http://www.jenoptik.com, Cited December 2002.Google Scholar
16. KJELDSEN, R., PINHANEZ, C., PINGALI, G., HARTMAN, J., LEVAS, T., AND PODLASECK, M. 2002. Interacting with Steerable Projected Displays. In Proc. of the 5th International Conference on Automatic Face and Gesture Recognition, 12–17. Google Scholar
17. LEVY, B., PETITJEAN, S., RAY, N., AND MAILLOT, J. 2002. Least Squares Conformal Maps for Automatic Texture Atlas Generation. In ACM Transactions on Graphics, vol. 21, 3, 162–170. Google ScholarDigital Library
18. LU, C., HAGER, G., AND MJOLSNESS, E. 2000. Fast and Globally Convergent Pose Estimation from Video Images. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 6, 610–622. Google ScholarDigital Library
19. MAJUMDER, A., HE, Z., TOWLES, H., AND WELCH, G. 2000. Color Calibration of Projectors for Large Tiled Displays. In IEEE Visualization 2000, 102–108.Google Scholar
20. PINHANEZ, C. 2001. The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. In Ubiquitous Computing 2001 (Ubicomp”01), 12–17. Google Scholar
21. RASKAR, R., AND BEARDSLEY, P. 2001. A Self Correcting Projector. In IEEE Computer Vision and Pattern Recognition (CVPR), 626–631.Google Scholar
22. RASKAR, R., WELCH, G., CUTTS, M., LAKE, A., STESIN, L., AND FUCHS, H. 1998. The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays. In Proceedings of ACM SIGGRAPH 1998, 179–188. Google Scholar
23. RASKAR, R., BROWN, M., RUIGANG, Y., CHEN, W., WELCH, G., TOWLES, H., SEALES, B., AND FUCHS, H. 1999. Multiprojector Displays using Camera-based Registration. In IEEE Visualization, 161–168. Google Scholar
24. RASKAR, R., WELCH, G., LOW, K., AND BANDYOPADHYAY, B. 2001. Shader Lamps: Animating Real Objects With Image-Based Illumination. In Rendering Techniques 2001, The Eurographics Workshop on Rendering, 89–102. Google Scholar
25. RASKAR, R., VANBAAR, J., AND CHAI, X. 2002. A Low Cost Projector Mosaic with Fast Registration. In Fifth Asian Conference on Computer Vision, 114–119.Google Scholar
26. RASKAR, R. 2000. Immersive Planar Display using Roughly Aligned Projectors. In IEEE VR 2000, 27–34. Google ScholarDigital Library
27. REKIMOTO, J., AND NAGAO, K. 1995. The World Through the Computer: Computer Augmented Interaction with Real World Environments. In Proceedings of UIST’95, 29–36. Google Scholar
28. REKIMOTO, J., AND SAITOH, M. 1999. Augmented Surfaces: A Spatially Continuous Workspace for Hybrid Computing Environments. In Proceedings of CHI’99, 378–385. Google Scholar
29. REKIMOTO, J. 1999. A Multiple-device Approach for Supporting Whiteboard-based Interactions. In Proceedings of CHI’98, 344–351. Google Scholar
30. SAMANTA, R., ZHENG, J., FUNKHOUSER, T., LI, K., AND SINGH, J. P. 1999. Load Balancing for Multi-Projector Rendering Systems. In SIGGRAPH/Eurographics Workshop on Graphics Hardware, 12–19. Google Scholar
31. SHASHUA, A., AND TOELG, S. 1997. The Quadric Reference Surface: Theory and Applications. In IJCV, vol. 23(2), 185–189. Google ScholarDigital Library
32. SIEMENS, 2002. Siemens Mini Beamer. http://w4.siemens.de/en2/html/press//newsdesk_archive/2002/-foe02121b.html, Cited December 2002.Google Scholar
33. SUKTHANKAR, R., STOCKTON, R., AND MULLIN, P. 2001. Smarter Presentations: Exploiting Homography in Camera-Projector Systems. In International Conference on Computer Vision, 82–87.Google Scholar
34. SYMBOL, 2002. Laser Projection Display. http://www.symbol.com/products/oem/lpd.html, Cited December 2002.Google Scholar
35. TRAVIS, A., PAYNE, F., ZHONG, J., AND MOORE, J. 2002. Flat panel display using projection within a wedge-shaped waveguide. http://ds.dial.pipex.com/cam3d/technology/technology01.html, Cited December 2002.Google Scholar
36. TRIMENSION SYSTEMS LTD, 2002. http://www.trimension-inc.com/, Cited Dec 2002.Google Scholar
37. UNDERKOFFLER, J., ULLMER, B., AND ISHII, H. 1999. Emancipated Pixels: Real-world Graphics in the Luminous Room. In Proceedings of ACM SIGGRAPH 1999, 385–392. Google Scholar
38. WATSON, B., AND HODGES, L. 1989. A Fast Algorithm for Rendering Quadratic Curves on Raster Displays. In Proc. 27th Annual SE ACM Conference, 160–165.Google Scholar
39. WELLNER, P. 1993. Interacting with paper on the DigitalDesk. Communications of the ACM 36, 7, 86–97. Google ScholarDigital Library
40. WEXLER, Y., AND SHASHUA, A. 1999. Q-warping: Direct Computation of Quadratic Reference Surfaces. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June, 1999, 333–338.Google Scholar
41. YANG, R., GOTZ, D., HENSLEY, J., TOWLES, H., AND BROWN, M. 2001. PixelFlex: A Reconfigurable Multi-Projector Display System. In IEEE Visualization 01, 68–75. Google ScholarDigital Library
42. YOTSUKURA, T., MORISHIMA, S., NIELSEN, F., BINSTED, K., AND PINHANEZ, C. 2002. Hyper Mask – Talking Head Projected onto Real Object. The Visual Computer 18, 2, 111–120.Google ScholarDigital Library