“MathPad2: a system for the creation and exploration of mathematical sketches” by LaViola and Zeleznik

We present mathematical sketching, a novel, pen-based, modeless gestural interaction paradigm for mathematics problem solving. Mathematical sketching derives from the familiar pencil-and-paper process of drawing supporting diagrams to facilitate the formulation of mathematical expressions; however, with a mathematical sketch, users can also leverage their physical intuition by watching their hand-drawn diagrams animate in response to continuous or discrete parameter changes in their written formulas. Diagram animation is driven by implicit associations that are inferred, either automatically or with gestural guidance, from mathematical expressions, diagram labels, and drawing elements. The modeless nature of mathematical sketching enables users to switch freely between modifying diagrams or expressions and viewing animations. Mathematical sketching can also support computational tools for graphing, manipulating and solving equations; initial feedback from a small user group of our mathematical sketching prototype application, MathPad2, suggests that it has the potential to be a powerful tool for mathematical problem solving and visualization.

1. ALVARADO, C. J. 2000. A Natural Sketching Environment: Bringing the Computer into Early Stages of Mechanical Design. Master’s thesis, Massachusetts Institute of Technology.Google Scholar
2. BLOSTEIN, D., AND GRBAVEC, A. 2001. Recognition of mathematical notation. In Handbook of Character Recognition and Document Image Analysis, World Scientific, H. Bunke and P. Wang, Eds., 557–582.Google Scholar
3. BORNING, A. 1979. ThingLab: A Constraint-Oriented Simulation Laboratory. PhD thesis, Stanford University. Google ScholarDigital Library
4. CHAN, K.-F., AND YEUNG, D.-Y. 2000. An efficient syntactic approach to structural analysis of on-line handwritten mathematical expressions. Pattern Recognition 33, 3, 375–384.Google ScholarCross Ref
5. CHAN, K.-F., AND YEUNG, D.-Y. 2000. Mathematical expression recognition: A survey. International Journal on Document Analysis and Recognition 3, 1, 3–15.Google ScholarCross Ref
6. CHAN, K.-F., AND YEUNG, D.-Y. 2001. Pencalc: A novel application of on-line mathematical expression recognition technology. In Proceedings of the Sixth International Conference on Document Analysis and Recognition, 774–778. Google ScholarDigital Library
7. CONNELL, S. D., AND JAIN, A. K. 2000. Template-based on-line character recognition. Pattern Recognition 34, 1, 1–14.Google ScholarCross Ref
8. CONNELL, S. D., AND JAIN, A. K. 2002. Writer adaptation for online handwriting recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 3, 329–346. Google ScholarDigital Library
9. DAMM, C. H., HANSEN, K. M., AND THOMSEN, M. 2000. Tool support for cooperative object-oriented design: Gesture-based modelling on an electronic whiteboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press, 518–525. Google ScholarDigital Library
10. FORSBERG, A., DIETERICH, M., AND ZELEZNIK, R. 1998. The music notepad. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology, ACM Press, 203–210. Google ScholarDigital Library
11. GROSS, M. D., AND DO, E. Y.-L. 1996. Ambiguous intentions: A paper-like interface for creative design. In Proceedings of the 9th Annual ACM Symposium on User Interface Software and Technology, ACM Press, 183–192. Google ScholarDigital Library
12. HECHT, E. 2000. Physics: Calculus. Brooks/Cole.Google Scholar
13. IGARASHI, T., MATSUOKA, S., AND TANAKA, H. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., 409–416. Google ScholarDigital Library
14. KARA, L. B., GENNARI, L., AND STRAHOVICH, T. F. 2004. A sketch-based interface for the design and analysis of simple vibratory mechanical systems. In Proceedings of ASME International Design Engineering Technical Conferences.Google ScholarCross Ref
15. LALEUF, J. R., AND SPALTER, A. M. 2001. A component repository for learning objects: A progress report. In Proceedings of the First ACM/IEEE-CS Joint Conference on Digital Libraries, ACM Press, 33–40. Google ScholarDigital Library
16. LANDAY, J. A., AND MYERS, B. A. 1995. Interactive sketching for the early stages of user interface design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press/Addison-Wesley Publishing Co., 43–50. Google ScholarDigital Library
17. LEE, H.-J., AND WANG, J.-S. 1995. Design of a mathematical expression recognition system. In Proceedings of the Third International Conference on Document Analysis and Recognition, IEEE Press, 1084–1087. Google ScholarDigital Library
18. LI, X., AND YEUNG, D.-Y. 1997. On-line handwritten alphanumeric character recognition using dominant points in strokes. Pattern Recognition 30, 1, 31–44. Google ScholarDigital Library
19. MATSAKIS, N. E. 1999. Recognition of Handwritten Mathematical Expressions. Master’s thesis, Massachusetts Institute of Technology.Google Scholar
20. MILLER, E. G., AND VIOLA, P. A. 1998. Ambiguity and constraint in mathematical expression recognition. In Proceedings of the Fifteenth National Conference on Artificial Intelligence, 784–791. Google ScholarDigital Library
21. MORAN, T. P., CHIU, P., AND VAN MELLE, W. 1997. Pen-based interaction techniques for organizing material on an electronic whiteboard. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology, ACM Press, 45–54. Google ScholarDigital Library
22. MYNATT, E. D., IGARASHI, T., EDWARDS, W. K., AND LAMARCA, A. 1999. Flatland: New dimensions in office white-boards. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press, 346–353. Google ScholarDigital Library
23. SMITHIES, S., NOVINS. K., AND ARVO, J. 1999. A handwriting-based equation editor. In Proceedings of Graphics Interface’99, 84–91. Google ScholarDigital Library
24. SPALTER, A. M., AND SIMPSON, R. M. 2000. Integrating interactive computer-based learning experiences into established curricula: A case study. In Proceedings of the 5th Annual SIGCSE/SIGCUE ITiCSE Conference on Innovation and Technology in Computer Science Education, ACM Press, 116–119. Google ScholarDigital Library
25. VARBERG, D., AND PURCELL, E. J. 1992. Calculus with Analytic Geometry. Prentice Hall.Google Scholar
26. YOUNG, H. D. 1992. University Physics. Addison-Wesley Publishing Company.Google Scholar
27. ZANIBBI, R., NOVINS, K., ARVO, J., AND ZANIBBI, K. 2001. Aiding manipulation of handwritten mathematical expressions through style-preserving morphs. In Proceedings of Graphics Interface 2001, 127–134. Google ScholarDigital Library
28. ZANIBBI, R., BLOSTEIN, D., AND CORDY, J. 2002. Recognizing mathematical expressions using tree transformation. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 11, 1–13. Google ScholarDigital Library
29. ZELEZNIK, R. C., HERNDON, K. P., AND HUGHES, J. F. 1996. Sketch: An interface for sketching 3D scenes. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, ACM Press, 163–170. Google ScholarDigital Library