“BNNAction-Net: Binary Neural Network on Hands Gesture Recognitions” by Fontana, Di Matteo, Cinque, Placidi and Marini – ACM SIGGRAPH HISTORY ARCHIVES

“BNNAction-Net: Binary Neural Network on Hands Gesture Recognitions” by Fontana, Di Matteo, Cinque, Placidi and Marini

  • ©

Conference:


Type(s):


Title:

    BNNAction-Net: Binary Neural Network on Hands Gesture Recognitions

Session/Category Title:   Interactive Techniques


Presenter(s)/Author(s):



Abstract:


    We have developed a Hand Gestures Recognition model using deep learning that significantly outperforms the efficiency of current state-of-the-art models by utilizing binary neural networks. This advancement enables the implementation of our model on standalone head-mounted displays and wearable devices.

References:


    [1]
    Xiangning Chen, Chen Liang, Da Huang, Esteban Real, Kaiyuan Wang, Yao Liu, Hieu Pham, Xuanyi Dong, Thang Luong, Cho-Jui Hsieh, Yifeng Lu, and Quoc V. Le. 2023. Symbolic Discovery of Optimization Algorithms. arxiv:2302.06675 [cs.LG]

    [2]
    Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015).

    [3]
    Boyuan Jiang, MengMeng Wang, Weihao Gan, Wei Wu, and Junjie Yan. 2019. Stm: Spatiotemporal and motion encoding for action recognition. In Proceedings of the IEEE/CVF international conference on computer vision. 2000?2009.

    [4]
    Gongfa Li, Hao Wu, Guozhang Jiang, Shuang Xu, and Honghai Liu. 2018. Dynamic gesture recognition in the internet of things. Ieee Access 7 (2018), 23713?23724.

    [5]
    Ji Lin, Chuang Gan, and Song Han. 2019. Tsm: Temporal shift module for efficient video understanding. In Proceedings of the IEEE/CVF international conference on computer vision. 7083?7093.

    [6]
    Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, and Ali Farhadi. 2016. Xnor-net: Imagenet classification using binary convolutional neural networks. In European conference on computer vision. Springer, 525?542.

    [7]
    Zhengwei Wang, Qi She, and Aljosa Smolic. 2021. Action-net: Multipath excitation for action recognition. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 13214?13223.

    [8]
    Zihan Xu, Mingbao Lin, Jianzhuang Liu, Jie Chen, Ling Shao, Yue Gao, Yonghong Tian, and Rongrong Ji. 2021. Recu: Reviving the dead weights in binary neural networks. In Proceedings of the IEEE/CVF international conference on computer vision. 5198?5208.

    [9]
    Yifan Zhang, Congqi Cao, Jian Cheng, and Hanqing Lu. 2018. Egogesture: a new dataset and benchmark for egocentric hand gesture recognition. IEEE Transactions on Multimedia 20, 5 (2018), 1038?1050.


ACM Digital Library Publication:



Overview Page:



Submit a story:

If you would like to submit a story about this presentation, please contact us: historyarchives@siggraph.org