“TapShot: screenshot snippets as GUI shortcuts” by Gohlke, Hlatky and Loviscach

  • ©Kristian Gohlke, Michael Hlatky, and Jörn Loviscach



Entry Number: 97


    TapShot: screenshot snippets as GUI shortcuts



    During extended sessions with a graphical user interface (GUI), users often apply a small set of commands with high frequency. A majority of direct manipulation tasks on a GUI are carried out using the mouse, particularly when keyboard shortcuts are not provided or the user is not familiar with them. Thus, to invoke a certain command, the user is required to aim the mouse pointer at a given onscreen widget and click with the mouse. If the overall task requires a user to click on the same widget repeatedly as part of a sequence of different interleaved micro-tasks, the overall performance suffers, as each point-and-click action requires a considerable amount of time for correctly aiming at the respective control.


    Besacier, G., and Vernier, F. 2009. Toward user interface virtualization: legacy applications and innovative interaction systems. In Proc. of EICS ’09, 157–166. Google ScholarDigital Library
    Myers, B. A., Peck, C. H., Nichols, J., Kong, D., and Miller, R. 2001. Interacting at a distance using semantic snarfing. In Proc. of UbiComp ’01, 305–314. Google ScholarDigital Library
    Yeh, T., Chang, T.-H., and Miller, R. C. 2009. Sikuli: using GUI screenshots for search and automation. In Proc. of UIST ’09, 183–192. Google ScholarDigital Library

ACM Digital Library Publication:

Overview Page: