“Beyond the Surface: 3D Interactions for Tabletop Systems” by Chan, Wu, Kao, Lin, Ko, et al. …

  • ©Li-Wei Chan, Hsiang-Tao Wu, Hui-Shan Kao, Home-Ru Lin, Ju-Chun Ko, Mike Y. Chen, Jane Hsu, and Yi-Ping Hung


Entry Number: 08


    Beyond the Surface: 3D Interactions for Tabletop Systems



    Current tabletop systems are designed to sense 2D interactions taken place on the tabletop surface, such as finger touches and tangible objects. The ability to interact above the tabletop surface makes it possible to support 3D interactions. For example, an architect can examine a 2D blueprint of a building shown on the tabletop display while inspecting 3D views of the building by moving a mobile display above the tabletop. Recent approaches to localize objects in 3D requires visible markers or the use of embedded sensors [Song et al. 2009]. The use of visible markers often interferes with the content users are focusing on, limiting its usefulness and applicability.

    In this work, we propose a new 3D tabletop system that overcomes this limitation by using invisible markers. We combine an infrared (IR) projector and a regular, color projector to simultaneously project visible content with invisible markers. Embedded IR cameras are used to localize objects above the table top surface. In addition, we use programmable marker patterns to refine object localization at both far distance and closeup.

Other Information:


    SONG, H., GROSSMAN, T., FITZMAURICE, G., GUIMBRETIERE, F., KHAN, A., ATTAR, R., AND KURTENBACH, G. 2009. Penlight: combining a mobile projector and a digital pen for dynamic visual overlay. In CHI ’09, ACM, 143–152.