“Rig animation with a tangible and modular input device” by Glauser, Ma, Panozzo, Jacobson, Hilliges, et al. …
Conference:
Type(s):
Title:
- Rig animation with a tangible and modular input device
Session/Category Title: USER INTERFACES
Presenter(s)/Author(s):
Moderator(s):
Abstract:
We propose a novel approach to digital character animation, combining the benefits of tangible input devices and sophisticated rig animation algorithms. A symbiotic software and hardware approach facilitates the animation process for novice and expert users alike. We overcome limitations inherent to all previous tangible devices by allowing users to directly control complex rigs using only a small set (5-10) of physical controls. This avoids oversimplification of the pose space and excessively bulky device configurations. Our algorithm derives a small device configuration from complex character rigs, often containing hundreds of degrees of freedom, and a set of sparse sample poses. Importantly, only the most influential degrees of freedom are controlled directly, yet detailed motion is preserved based on a pose interpolation technique. We designed a modular collection of joints and splitters, which can be assembled to represent a wide variety of skeletons. Each joint piece combines a universal joint and two twisting elements, allowing to accurately sense its configuration. The mechanical design provides a smooth inverse kinematics-like user experience and is not prone to gimbal locking. We integrate our method with the professional 3D software Autodesk Maya® and discuss a variety of results created with characters available online. Comparative user experiments show significant improvements over the closest state-of-the-art in terms of accuracy and time in a keyframe posing task.
References:
1. Achibet, M., Casiez, G., Lécuyer, A., and Marchal, M. 2015. Thing: Introducing a tablet-based interaction technique for controlling 3d hand models. In Proc. CHI. Google ScholarDigital Library
2. Ahn, J., and Wohn, K. 2004. Motion level-of-detail: A simplification method on crowd scene. In Proc. Computer Animation and Social Agents.Google Scholar
3. Au, O. K.-C., Tai, C.-L., Chu, H.-K., Cohen-Or, D., and Lee, T.-Y. 2008. Skeleton extraction by mesh contraction. ACM Trans. Graph. 27, 3. Google ScholarDigital Library
4. Baran, I., Vlasic, D., Grinspun, E., and Popović, J. 2009. Semantic deformation transfer. ACM Trans. Graph. 28, 3. Google ScholarDigital Library
5. Botsch, M., and Sorkine, O. 2008. On linear variational surface deformation methods. IEEE Transactions on Visualization and Computer Graphics 14, 1, 213–230. Google ScholarDigital Library
6. Buck, I., Finkelstein, A., Jacobs, C., Klein, A., Salesin, D. H., Seims, J., Szeliski, R., and Toyama, K. 2000. Performance-driven hand-drawn animation. In Proc. NPAR. Google ScholarDigital Library
7. Celsys, Inc., 2013. QUMARION. http://www.clip-studio.com.Google Scholar
8. Chien, C.-y., Liang, R.-H., Lin, L.-F., Chan, L., and Chen, B.-Y. 2015. Flexibend: Enabling interactivity of multi-part, deformable fabrications using single shape-sensing strip. In Proc. UIST. Google ScholarDigital Library
9. Esposito, C., Paley, W. B., and Ong, J. 1995. Of mice and monkeys: a specialized input device for virtual body animation. In Proc. I3D. Google ScholarDigital Library
10. Fender, A., Müller, J., and Lindlbauer, D. 2015. Creature teacher: A performance-based animation system for creating cyclic movements. In Proc. SUI. Google ScholarDigital Library
11. Feng, T.-C., Gunawardane, P., Davis, J., and Jiang, B. 2008. Motion capture data retrieval using an artist’s doll. In Proc. ICPR, 1–4.Google Scholar
12. Gleicher, M. 1998. Retargetting motion to new characters. In Proc. SIGGRAPH. Google ScholarDigital Library
13. Guay, M., Cani, M.-P., and Ronfard, R. 2013. The line of action: An intuitive interface for expressive character posing. ACM Trans. Graph. 32, 6 (Nov.), 205:1–205:8. Google ScholarDigital Library
14. Guay, M., Ronfard, R., Gleicher, M., and Cani, M.-P. 2015. Space-time sketching of character animation. ACM Trans. Graph. 34, 4 (July), 118:1–118:10. Google ScholarDigital Library
15. Gurobi Optimization, I., 2015. Gurobi optimizer reference manual.Google Scholar
16. Hahn, F., Martin, S., Thomaszewski, B., Sumner, R., Coros, S., and Gross, M. 2012. Rig-space physics. ACM Trans. Graph.. Google ScholarDigital Library
17. Hahn, F., Mutzel, F., Coros, S., Thomaszewski, B., Nitti, M., Gross, M., and Sumner, R. W. 2015. Sketch abstractions for character posing. In Proc. SCA. Google ScholarDigital Library
18. Held, R., Gupta, A., Curless, B., and Agrawala, M. 2012. 3d puppetry: A kinect-based interface for 3d animation. In Proc. UIST, ACM, New York, NY, USA, 423–434. Google ScholarDigital Library
19. Holden, D., Saito, J., and Komura, T. 2015. Learning an inverse rig mapping for character animation. In Proc. SCA. Google ScholarDigital Library
20. Huang, W., 2015. Deformation learning solver. https://github.com/WebberHuang/DeformationLearningSolver.Google Scholar
21. Ishii, H., and Ullmer, B. 1997. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proc. CHI. Google ScholarDigital Library
22. Jacob, R. J. K., Sibert, L. E., McFarlane, D. C., and Mullen, Jr., M. P. 1994. Integrality and separability of input devices. ACM Trans. Comput.-Hum. Interact. 1, 1 (Mar.), 3–26. Google ScholarDigital Library
23. Jacobson, A., Baran, I., Kavan, L., Popović, J., and Sorkine, O. 2012. Fast automatic skinning transformations. ACM Trans. Graph.. Google ScholarDigital Library
24. Jacobson, A., Deng, Z., Kavan, L., and Lewis, J. 2014. Skinning: Real-time shape deformation. In ACM SIGGRAPH 2014 Courses. Google ScholarDigital Library
25. Jacobson, A., Panozzo, D., Glauser, O., Pradalier, C., Hilliges, O., and Sorkine-Hornung, O. 2014. Tangible and modular input device for character articulation. ACM Transactions on Graphics (proceedings of ACM SIGGRAPH) 33, 4, 82:1–82:12. Google ScholarDigital Library
26. Jin, M., Gopstein, D., Gingold, Y., and Nealen, A. 2015. Animesh: Interleaved animation, modeling, and editing. ACM Trans. Graph.. Google ScholarDigital Library
27. Kabsch, W. 1976. A solution for the best rotation to relate two sets of vectors. Acta Crystallographica Section A: Crystal Physics, Diffraction, Theoretical and General Crystallography 32, 5, 922–923.Google ScholarCross Ref
28. Knep, B., Hayes, C., Sayre, R., and Williams, T. 1995. Dinosaur input device. In Proc. CHI, 304–309. Google ScholarDigital Library
29. Le, B. H., and Deng, Z. 2014. Robust and accurate skeletal rigging from mesh sequences. ACM Trans. Graph. 33, 4, 84. Google ScholarDigital Library
30. Lewis, J. P., and Anjyo, K.-i. 2010. Direct manipulation blendshapes. IEEE Comput. Graph. Appl. 30, 4 (July), 42–50. Google ScholarDigital Library
31. Lewis, J. P., Cordner, M., and Fong, N. 2000. Pose space deformation: A unified approach to shape interpolation and skeleton-driven deformation. In Proc. SIGGRAPH. Google ScholarDigital Library
32. Masliah, M. R., and Milgram, P. 2000. Measuring the allocation of control in a 6 degree-of-freedom docking experiment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI ’00, 25–32. Google ScholarDigital Library
33. Maya, 2014. Autodesk, http://www.autodesk.com/maya.Google Scholar
34. Nakagaki, K., Follmer, S., and Ishii, H. 2015. Lineform: Actuated curve interfaces for display, interaction, and constraint. In Proc. UIST. Google ScholarDigital Library
35. Öztireli, A. C., Baran, I., Popa, T., Dalstein, B., Sumner, R. W., and Gross, M. 2013. Differential blending for expressive sketch-based posing. In Proc. SCA. Google ScholarDigital Library
36. Rhodin, H., Tompkin, J., Kim, K. I., Kiran, V., Seidel, H.-P., and Theobalt, C.Google Scholar
37. Savoye, Y., and Meyer, A. 2008. Multi-layer level of detail for character animation. In Workshop in Virtual Reality Interactions and Physical Simulation “VRIPHYS” (2008).Google Scholar
38. Schaefer, S., and Yuksel, C. 2007. Example-based skeleton extraction. In Proc. SGP. Google ScholarDigital Library
39. Shiratori, T., Mahler, M., Trezevant, W., and Hodgins, J. 2013. Expressing animated performances through puppeteering. In Proc. 3DUI.Google Scholar
40. Sumner, R., and Popović, J. 2004. Deformation transfer for triangle meshes. ACM Trans. Graph. 23, 3, 399–405. Google ScholarDigital Library
41. Sumner, R. W., Zwicker, M., Gotsman, C., and Popović, J. 2005. Mesh-based inverse kinematics. ACM Trans. Graph.. Google ScholarDigital Library
42. Tagliasacchi, A., Alhashim, I., Olson, M., and Zhang, H. 2012. Mean curvature skeletons. Comput. Graph. Forum 31, 5. Google ScholarDigital Library
43. Yoshizaki, W., Sugiura, Y., Chiou, A. C., Hashimoto, S., Inami, M., Igarashi, T., Akazawa, Y., Kawachi, K., Kagami, S., and Mochimaru, M. 2011. An actuated physical puppet as an input device for controlling a digital manikin. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI ’11, 637–646. Google ScholarDigital Library
44. Zhai, S., and Milgram, P. 1998. Quantifying coordination in multiple dof movement and its application to evaluating 6 dof input devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, CHI ’98, 320–327. Google ScholarDigital Library
