“Recompose – Direct and Gestural Interaction with an Actuated Surface” by Leithinger, Lakatos, DeVincenzi and Blackshaw

  • ©Daniel Leithinger, Dávid Lakatos, Anthony DeVincenzi, and Matthew Blackshaw

  • ©Daniel Leithinger, Dávid Lakatos, Anthony DeVincenzi, and Matthew Blackshaw


    Recompose – Direct and Gestural Interaction with an Actuated Surface


Entry Number: 13


    We present Recompose, a new system for manipulation of an actuated surface. By collectively utilizing the body as a tool for direct manipulation alongside gestural input for functional manipulation, we show how a user is afforded unprecedented control over an actuated surface. Our invention consists of the actuated surface and the interaction technique utilizing free-hand and touch gestures to manipulate the 3D geometry of the pin array, thus changing the of shape of the virtual object.

    Previous related work has utilized physical materials as a direct interface for CAD modeling. The physical material in these projects is modified by the user’s hands, but cannot be programmatically changed. We propose to combine previous work in tangible CAD modeling and actuated tangible interfaces to overcome this limitation.

    We believe that the combination of direct manipulation, I/O coincidence, an instantaneous feedback loop, and gestural input is a largely unexplored research area. Recompose explores this area, through a system, which leverages the strengths of these interaction techniques.


    Ishii, H. and Ullmer, B. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI ’97). ACM, New York, NY, USA, 234-241.

    Benko, H., Ishak, E.W., and Feiner, S. 2005. Cross-dimensional gestural interaction techniques for hybrid immersive environments. In Proceedings of IEEE Virtual Reality – VR ’05, (2005), 209-216.

    Wilson, A. 2006. Robust computer vision-based detection of pinching for one and two-handed gesture input. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST ’06). ACM, New York, NY, USA, 255-258.

ACM Digital Library Publication: