“Manipulating simulated objects with real-world gestures using a force and position sensitive screen” by Minsky

A flexible interface to computing environments can be provided by gestural input. We describe a prototype system that recognizes some types of single-finger gestures and uses these gestures to manipulate displayed objects. An experimental gesture input device yields information about single finger gestures in terms of position, pressure, and shear forces on a screen. The gestures are classified by a “gesture parser” and used to control actions in a fingerpainting program, an interactive computing system designed for young children, and an interactive digital logic simulation.

1. Abelson, Harold, and Andrea DiSessa. Turtle Geometry. MIT Press, 1981.
2. Schmandt, C. and Hulteen, E. “The Intelligent Voice-Interactive Interface”. Proc. Human Factors in Computer Systems, Gaithersburg, MD, 1982
3. Hardebeck, Edward F. “Gestural Input to Computers through Visual Recognition of Body Silhouettes”. Atari Cambridge Research Internal Memo 3, Atari Cambridge Research, January 1984.
4. Loomis, Jeffrey, Poizner, Howard, Bellugi, Ursula, Blakemore, Alynn, and John Hollerbach. “Computer Graphic Modeling of American Sign Language”. Proc. Siggraph ’83, Computer Graphics 17, no. 3, July 1983.
5. Papert, Seymour A. Mindstorms. Basic Books, New York, 1980.
6. Perlman, Radia. “Tortis: Toddler’s Own Recursive Turtle Interpreter System” Logo Memo 9, Logo Laboratory, Massachusetts Institute of Technology, Cambridge, July 1974.
7. Perlman, Radia. “How to Use the Slot Machine”. Logo Working Paper 43, Logo Laboratory, Massachusetts Institute of Technology, Cambridge, January 1976.
8. Atari VCS Adventure. Software product of Atari, Inc., Sunnyvale, CA, 1979.
9. Rocky’s Boots. Software Product of The Learning Co., Portola Valley, CA, 1982.