Glowing Pathfinder Bugs: A Natural Haptic 3D Interface for Interacting Intuitively with Virtual Environments






  • Glowing Pathfinder Bugs is an interactive art project primarily aimed at children and created by the digital arts group Squidsoup. It uses projection to visualize virtual bugs on a real sandpit. The bugs are aware of their surroundings and respond to its form in their vicinity. By altering the topography of the sand, participants affect the bugs’ environment in real time, facilitating direct communication between them and computer-generated creatures.

    This highly malleable and tactile physical environment lets us define and carve out the landscape in which the creatures exist in real time. Thus, virtual creatures and real people coexist and communicate through a shared tactile environment. Participants can use natural modes of play, kinesthetic intelligence, and their sense of tactility to collaboratively interact with creatures inhabiting a hybrid parallel world.

    This paper describes the project and analyzes how children in particular respond to the experience; it looks at the types of physical formations that tend to be built and notes how children instinctively anthropomorphize the bugs, treating projected imagery as living creatures – though with a ludic twist.


  • I. Squidsoup,

    2. E. Ackerman, “Playthings That Do Things: A Young Kid’s ‘Incredibles’!,” Proceedings of JDC 2005, Boulder, Colorado, 1-8 (2005).

    3. H. Ishii and B. Ullmer, “Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms,” Proceedings of the SIG CHI Conference on Human Factors in Computing Systems, 234-241 (1996).

    4. E. Lupton, “Skin: New Design Organics,” Skin: Surface, Substance and Design (New York: Princeton Architectural Press, 2002).

    5. Freq2,

    6. Kinesthetic Intelligence,

    7. Sandscape,

    8. A. Parkes, V. LeClerc, H. Ishii, “Glume: Exploring Materiality in a Soft Augmented Modular Modeling System,” Extended Abstracts of Conference on Human Factors in Computing Systems, ACM Press, 12n-1216 (2006).

    9. H. Ishii, et al., “Sandscape: Bringing Clay and Sand into Digital Design – Continuous Tangible User Interfaces,” BT Technology journal, Vol. 22, No. 4, 287-299 (2004).

    IO. J. Seevinck and E. Edmonds, “Emergence and the Art System ‘Plus Minus Now,”‘ Design Studies, Vol. 29, No. 6, 541-555 (2008).

    II. D. Harrison, et al., “Shift-Life: Experiencing the Big Idea,” Proceedings of the Digital Arts and Culture Conference, (2009).

    12. Point Grey Bumblebee,

    13. J. Hillman, Re-visioning Psychology (New York: Harper and Row, 1976) p. 16.

    14. Squidsoup, Glowing Pathfinder Bugs,