“ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition” – ACM SIGGRAPH HISTORY ARCHIVES

“ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition”

  • ©

Conference:


Experience Type(s):


Title:


    ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition

Organizer(s)/Presenter(s):



Description:


    ZoomTouch is a robot-human interaction system that allows an operator or a group of people to control the robotic arm via video calls application from anywhere in the world using DNN-based hand tracking. No glove or special hand tracking device, the camera is all you need.

References:


    [1]
    Bin Fang, Di Guo, Fuchun Sun, Huaping Liu, and Yupei Wu. 2015. A robotic hand-arm teleoperation system using human arm/hand with a novel data glove. In 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 2483–2488.
    [2]
    Hongyi Liu and Lihui Wang. 2018. Gesture recognition for human-robot collaboration: A review. International Journal of Industrial Ergonomics 68 (2018), 355–367.
    [3]
    E. Tsykunov, R. Agishev, R. Ibrahimov, L. Labazanova, A. Tleugazy, and D. Tsetserukou. 2019. SwarmTouch: Guiding a Swarm of Micro-Quadrotors With Impedance Control Using a Wearable Tactile Interface. IEEE Transactions on Haptics 12, 3 (2019), 363–374.
    [4]
    Vibol Yem, Hiroyuki Kajimoto, Katsunari Sato, and Hidekazu Yoshihara. 2019. A System of Tactile Transmission on the Fingertips with Electrical-Thermal and Vibration Stimulation. In Human Interface and the Management of Information. Information in Intelligent Systems, Sakae Yamamoto and Hirohiko Mori (Eds.). Springer International Publishing, Cham, 101–113.


ACM Digital Library Publication:


Overview Page:



Submit a story:

If you would like to submit a story about this experience or presentation, please contact us: historyarchives@siggraph.org