“Specifying gestures by example” by Rubine

Gesture-Based interfaces offer an alternative to traditional keyboard, menu, and direct manipulation interfaces. The ability to specify objects, an operation, and additional parameters with a single intuitive gesture appeals to both novice and experienced users. Unfortunately, gesture-based interfaces have not been extensively researched, partly because they are difficult to create. This paper describes GRANDMA, a toolkit for rapidly adding gestures to direct manipulation interfaces. The trainable single-stroke gesture recognizer used by GRANDMA is also described.

1. BUXTON, W. Chunking and phrasing and the design of human-computer dialogues. In Information Processing 86 (North Holland, 1986), Elsevier Science Publishers B.V.
2. BUXTON, W., SNIDERMAN, R., REEVES, W., PATEL, S., AND BAECKER, R. The evolution of the SSSP scoreediting tools. In Foundations of Computer Music, C. Roads and J. Strawn, Eds. MIT Press, Cambridge, Mass., 1985, ch. 22, pp. 387-392.
3. COLEMAN, M. L. Text editing on a graphic display device using hand-drawn proofreader’s symbols. In Pertinent Concepts in Computer Graphics, Proceedings of the Second University of Illinois Conference on Computer Graphics, M. Faiman and j. Nievergelt, Eds. University of Illinois Press, Urbana, Chicago, London, 1969, pp. 283-290.
4. Cox, B. J. Object Oriented Programming: An Evolutionary Approach. Addison-Wesley, 1986.
5. DUDA, R., AND HART, 1a. Pattern Classification and Scene Analysis. Wiley Interscience, 1973.
6. GUY ON, I., ALBRECHT, P., CUN, Y. L., DENKER, J., AND HUBBARD, W. Design of a neural network character recognizer for a touch terminal. Pattern Recognition (forthcoming).
7. HENRY, T., HUDSON, S., AND NEWELL, G. Integrating gesture and snapping into a user interface toolkit. In UIST ’90 (1990), ACM, pp. 112-122.
8. KRASNER, G. E., AND POPE, S. T. A description of the Model-View-Controller user interface paradigm in the Smalltalk-80 system. Journal of Object Oriented Programming i, 3 (Aug. 1988), 26–49.
9. KURTENBACH, G., AND BUXTON, W. GEdit: A test bed for editing by contiguous gestures. To be published in SIGCHI Bulletin, 1991.
10. LEE, S., BUXTON, W., AND SMITH, K. A multi-touch three dimensional touch tablet. In Proceedings of CHI’85 Conference on Human Factors in Computing Systems (1985), ACM, pp. 21-25.
11. LIPSCOMB, J. S. A trainable gesture recognizer. Pattern Recognition (i 991 ). Also available as IBM Tech Report RC ! 6448 (#73078).
12. McAVlNNEY, P. Telltale gestures. Byte 15, 7 (July 1990), 237-240.
13. MINSKY, M. R. Manipulating simulated objects with real-world gestures using a force and position sensitive screen. Computer Graphics 18, 3 (July 1984), 195- 203.
14. MYERS, B. A., GIUSE, D., DANNENBERG, R. B., ZAN- DEN, B. V., KOSBIE, D., PERVIN, E., MICKISH, A., AND MARCHAL, P. Comprehensive support for graphical, highly-interactive user interfaces: The Garnet user interface development environment. IEEE Computer 23, 11 (Nov 1990).
15. NEWMAN, W., AND SPROULL, R. Principles oflnteractive Computer Graphics. McGraw-Hill, 1979.
16. NEXT. The NeXT System Reference Manual. NEXT, Inc., ! 989.
17. PALAY, A., HANSEN, W., KAZAR, M., SHERMAN, M., WADLOW, M., NEUENDORFFER, T., STERN, Z., BADER, M., AND PETERS, T. The Andrew toolkit: An overview. In Proceedings of the USENIX Technical Conference (Dallas, February 1988), pp. 11-23.
18. RHYNE, J. R., AND WOLF, C. G. Gestural interfaces for information processing applications. Tech. Rep. RC12179, IBM T.J. Watson Research Center, IBM Corporation, EO. Box 218, Yorktown Heights, NY 10598, Sept. 1986.
19. RUBINE, D. Integrating gesture recognition and direct manipulation. In Proceedings of the Summer ’91 USENIX Technical Conference ( 1991 ).
20. RUBINE, D. The Automatic Recognition of Gestures. PhD thesis, School of Computer Science, Carnegie Mellon University, forthcoming, 1991.
21. SUEN, C., BERTHOD, M., AND MORI, S. Automatic recognition of handprinted characters: The state of the art. Proceedings of the IEEE 68, 4 (April 1980), 469-487.
22. ZIMMERMAN, T., LANIER, J., BLANcHARD, C., BRYSON, S., AND HARVILL, Y. A hand gesture interface device. CHI+G! (1987), 189-192.