“In-air Typing Interface for Mobile Devices with Vibration Feedback” by Niikura, Hirobe, Cassinelli, Watanabe, Komuro, et al. …

  • ©Takehiro Niikura, Yuki Hirobe, Alvaro Cassinelli, Yoshihiro Watanabe, Takashi Komuro, and Masatoshi Ishikawa

Title:


    In-air Typing Interface for Mobile Devices with Vibration Feedback

Presenter(s):


Entry Number: 15


Description:


    Recently the miniaturization of mobile devices has progressed and such devices are difficult to have input interface that has wide operation area on their surface. Conventional input interface on a cell phone, such as a touch panel or keypad, has limited operation area. There has been many approaches to handle this problem, but they require users to wear some physical devices[Harrison and Hudson 2009] or to use in some specific environments[Roeber et al. 2003].

    We propose vision-based 3D input interface for mobile devices which does not require wide space on the device’s surface, other physical devices or specific environments. Users can operate the device by the movement of a fingertip in the air. Since the fingertip near the camera moves fast in the image, we use a high-framerate camera for stable tracking. Applying a frequency filter to the scale change of the fingertip image, the system detects the small keystroke action in the air. To realize input interface in which we can type letters fast, we attached a vibration motor on device and vibration feedback is conveyed.


Other Information:


    References

    BAKER, S., AND MATTHEWS, I. 2004. Lucas-kanade 20 years on: A unifying framework. International Journal of Computer Vision 56, 3, 221–255.

    HARRISON, C., AND HUDSON, S. E. 2009. Abracadabra: Wireless, high-precision, and unpowered finger input for very small mobile devices. In Proceedings of the 22nd Annual ACM Symposium on UIST, ACM, 121–124.

    ROEBER, H., BACUS, J., AND TOMASI, C. 2003. Typing in thin air the canesta projection keyboard – a new method of interaction with electronic devices. CHI03 extended abstracts on Human factors in computing systems, 712–713.


Additional Images:

©Takehiro Niikura, Yuki Hirobe, Alvaro Cassinelli, Yoshihiro Watanabe, Takashi Komuro, and Masatoshi Ishikawa

PDF:



Conference:


Type: