“Local Scale Adaptation for Augmenting Hand Shape Models” by Kalshetti and Chaudhuri
Conference:
Type:
Entry Number: 62
Title:
- Local Scale Adaptation for Augmenting Hand Shape Models
Presenter(s)/Author(s):
Abstract:
The accuracy of hand pose and shape recovery algorithms depends on how closely the geometric hand model resembles the user’s hand. Most existing methods rely on learned shape space, e.g. MANO; but this shape model fails to generalize to unseen hand shapes with large deviations from the training set. We introduce a new hand shape model, aMANO, that augments MANO by introducing local scale adaptation that enables modeling substantially different hand sizes. We use both MANO and aMANO for calibrating the shape to new users from a stream of depth images and observe the improvement of aMANO over MANO. We believe that our new hand shape model is a significant step in improving the robustness and accuracy of existing hand tracking solutions.
References:
Alec Jacobson, Ilya Baran, Jovan Popović, and Olga Sorkine. 2011. Bounded Biharmonic Weights for Real-Time Deformation. ACM TOG 30, 4 (2011), 78:1–78:8.Google Scholar
Alec Jacobson and Olga Sorkine. 2011. Stretchable and Twistable Bones for Skeletal Shape Deformation. ACM TOG 30, 6 (2011), 165:1–165:8.Google Scholar
Javier Romero, Dimitrios Tzionas, and Michael J. Black. 2017. Embodied Hands: Modeling and Capturing Hands and Bodies Together. ACM TOG 36, 6 (2017), 245:1–245:17.Google ScholarDigital Library
David Joseph Tan, Tom Cashman, Jonathan Taylor, Andrew Fitzgibbon, Daniel Tarlow, Sameh Khamis, Shahram Izadi, and Jamie Shotton. 2016. Fits Like a Glove: Rapid and Reliable Hand Shape Personalization. In CVPR.Google Scholar
Anastasia Tkach, Andrea Tagliasacchi, Edoardo Remelli, Mark Pauly, and Andrew Fitzgibbon. 2017. Online generative model personalization for hand tracking. ACM TOG 36, 6 (2017), 1–11.Google ScholarDigital Library
Jonathan Tompson, Murphy Stein, Yann Lecun, and Ken Perlin. 2014. Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks. ACM TOG 33(2014).Google Scholar
S. Yuan, Q. Ye, B. Stenger, S. Jain, and T. Kim. 2017. BigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysis. In CVPR. 2605–2613.Google Scholar
