“Vibration-minimizing motion retargeting for robotic characters” by Hoshyari, Xu, Knoop, Coros and Bächer
Conference:
Type(s):
Title:
- Vibration-minimizing motion retargeting for robotic characters
Session/Category Title: Motion is in Control
Presenter(s)/Author(s):
Abstract:
Creating animations for robotic characters is very challenging due to the constraints imposed by their physical nature. In particular, the combination of fast motions and unavoidable structural deformations leads to mechanical oscillations that negatively affect their performances. Our goal is to automatically transfer motions created using traditional animation software to robotic characters while avoiding such artifacts. To this end, we develop an optimization-based, dynamics-aware motion retargeting system that adjusts an input motion such that visually salient low-frequency, large amplitude vibrations are suppressed. The technical core of our animation system consists of a differentiable dynamics simulator that provides constraint-based two-way coupling between rigid and flexible components. We demonstrate the efficacy of our method through experiments performed on a total of five robotic characters including a child-sized animatronic figure that features highly dynamic drumming and boxing motions.
References:
1. Steven S An, Theodore Kim, and Doug L James. 2008. Optimizing cubature for efficient integration of subspace deformations. ACM Trans. Graph. 27, 5 (2008), 165. Google ScholarDigital Library
2. Uri M. Ascher and Linda R. Petzold. 1998. Computer Methods for Ordinary Differential Equations and Differential-Algebraic Equations (1st ed.). Society for Industrial and Applied Mathematics, Philadelphia, PA, USA. Google ScholarDigital Library
3. Moritz Bächer, Stelian Coros, and Bernhard Thomaszewski. 2015. LinkEdit: Interactive Linkage Editing Using Symbolic Kinematics. ACM Trans. Graph. 34, 4, Article 99 (July 2015), 8 pages. Google ScholarDigital Library
4. David Baraff. 1996. Linear-time dynamics using Lagrange multipliers. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. ACM, 137–146. Google ScholarDigital Library
5. Jernej Barbič, Marco da Silva, and Jovan Popović. 2009. Deformable object animation using reduced optimal control. ACM Trans. Graph. 28, 3 (2009), 53. Google ScholarDigital Library
6. Jernej Barbič and Yili Zhao. 2011. Real-time large-deformation substructuring. ACM Trans. Graph. 30, 4, 91. Google ScholarDigital Library
7. Jernej Barbič and Doug L. James. 2005. Real-Time Subspace Integration for St. Venant-Kirchhoff Deformable Models. ACM Trans. Graph. 24, 3 (July 2005), 982–990. Google ScholarDigital Library
8. J. Baumgarte. 1972. Stabilization of constraints and integrals of motion in dynamical systems. Computer Methods in Applied Mechanics and Engineering 1, 1 (1972), 1–16.Google ScholarCross Ref
9. James M. Bern, Kai-Hung Chang, and Stelian Coros. 2017. Interactive design of animated plushies. ACM Trans. Graph. 36, 4 (2017), 80:1–80:11. Google ScholarDigital Library
10. K. E. Brenan, S. L. Campbell, and L. R. Petzold. 1996. Numerical Solution of Initial-Value Problems in Differential-Algebraic Equations. SIAM.Google Scholar
11. Yang Cao, Shengtai Li, Linda Petzold, and Radu Serban. 2003. Adjoint sensitivity analysis for differential-algebraic equations: The adjoint DAE system and its numerical solution. SIAM Journal on Scientific Computing 24, 3 (2003), 1076–1089. Google ScholarDigital Library
12. Duygu Ceylan, Wilmot Li, Niloy J. Mitra, Maneesh Agrawala, and Mark Pauly. 2013. Designing and Fabricating Mechanical Automata from Mocap Sequences. ACM Trans. Graph. 32, 6, Article 186 (Nov. 2013), 11 pages. Google ScholarDigital Library
13. Desai Chen, David I. W. Levin, Wojciech Matusik, and Danny M. Kaufman. 2017. Dynamics-aware Numerical Coarsening for Fabrication Design. ACM Trans. Graph. 36, 4, Article 84 (July 2017), 15 pages. Google ScholarDigital Library
14. Stelian Coros, Bernhard Thomaszewski, Gioacchino Noris, Shinjiro Sueda, Moira Forberg, Robert W. Sumner, Wojciech Matusik, and Bernd Bickel. 2013. Computational Design of Mechanical Characters. ACM Trans. Graph. 32, 4, Article 83 (2013), 12 pages. Google ScholarDigital Library
15. Tao Du, Adriana Schulz, Bo Zhu, Bernd Bickel, and Wojciech Matusik. 2016. Computational multicopter design. ACM Trans. Graph. 35, 6 (2016), 227:1–227:10. Google ScholarDigital Library
16. D Economou, C Lee, C Mavroidis, and I Antoniadis. 2000. Robust vibration suppression in flexible payloads carried by robot manipulators using digital filtering of joint trajectories. In Intl. Symposium on Robotics and Automation. 244–249.Google Scholar
17. Nico Galoppo, Miguel A. Otaduy, William Moss, Jason Sewall, Sean Curtis, and Ming C. Lin. 2009. Controlling Deformable Material with Dynamic Morph Targets. In Proceedings of the 2009 Symposium on Interactive 3D Graphics and Games (I3D ’09). ACM, New York, NY, USA, 39–47. Google ScholarDigital Library
18. Damien Gauge, Stelian Coros, Sandro Mani, and Bernhard Thomaszewski. 2014. Interactive Design of Modular Tensegrity Characters. In The Eurographics / ACM SIGGRAPH Symposium on Computer Animation, SCA 2014, Copenhagen, Denmark, 2014. 131–138. Google ScholarDigital Library
19. Moritz Geilinger, Roi Poranne, Ruta Desai, Bernhard Thomaszewski, and Stelian Coros. 2018. Skaterbots: Optimization-based design and motion synthesis for robotic creatures with legs and wheels. ACM Trans. Graph. 37, 4 (2018), 160. Google ScholarDigital Library
20. Sehoon Ha, Stelian Coros, Alexander Alspach, Joohyung Kim, and Katsu Yamane. 2017. Joint optimization of robot design and motion parameters using the implicit function theorem. In Robotics: Science and Systems.Google Scholar
21. Kris K Hauser, Chen Shen, and James F O’Brien. 2003. Interactive Deformation Using Modal Analysis with Constraints.. In Graphics Interface, Vol. 3. 16–17.Google Scholar
22. Vladímir Villaverde Huertas and Boris Rohal’-Ilkiv. 2012. Vibration suppression of a flexible structure. Procedia Engineering 48 (2012), 233–241.Google ScholarCross Ref
23. Doug L James and Dinesh K Pai. 2002. DyRT: dynamic response textures for real time deformation simulation with graphics hardware. ACM Trans. Graph. 21, 3, 582–585. Google ScholarDigital Library
24. Junggon Kim and Nancy S Pollard. 2011. Fast simulation of skeleton-driven deformable body characters. ACM Trans. Graph. 30, 5 (2011), 121. Google ScholarDigital Library
25. Theodore Kim and Doug L James. 2012. Physics-based character skinning using multidomain subspace deformations. IEEE transactions on visualization and computer graphics 18, 8 (2012), 1228–1240. Google ScholarDigital Library
26. Seunghwan Lee, Ri Yu, Jungnam Park, Mridul Aanjaneya, Eftychios Sifakis, and Jehee Lee. 2018. Dexterous manipulation and control with volumetric muscles. ACM Trans. Graph. 37, 4 (2018), 57. Google ScholarDigital Library
27. Siwang Li, Jin Huang, Fernando de Goes, Xiaogang Jin, Hujun Bao, and Mathieu Desbrun. 2014. Space-time editing of elastic motion through material optimization and reduction. ACM Trans. Graph. 33, 4 (2014), 108. Google ScholarDigital Library
28. Jacques Louis Lions. 1971. Optimal control of systems governed by partial differential equations. Vol. 170. Springer Berlin.Google Scholar
29. Libin Liu, KangKang Yin, Bin Wang, and Baining Guo. 2013. Simulation and control of skeleton-driven soft body characters. ACM Trans. Graph. 32, 6 (2013), 215. Google ScholarDigital Library
30. Mickaël Ly, Romain Casati, Florence Bertails-Descoubes, Mélina Skouras, and Laurence Boissieux. 2018. Inverse Elastic Shell Design with Contact and Friction. ACM Trans. Graph. 37, 6, Article 201 (Dec. 2018), 16 pages. Google ScholarDigital Library
31. Antoine McNamara, Adrien Treuille, Zoran Popović, and Jos Stam. 2004. Fluid control using the adjoint method. ACM Trans. Graph. 23, 3 (2004), 449–456. Google ScholarDigital Library
32. Vittorio Megaro, Bernhard Thomaszewski, Maurizio Nitti, Otmar Hilliges, Markus Gross, and Stelian Coros. 2015. Interactive design of 3D-printable robotic creatures. ACM Trans. Graph. 34, 6 (2015), 216. Google ScholarDigital Library
33. Vittorio Megaro, Jonas Zehnder, Moritz Bächer, Stelian Coros, Markus Gross, and Bernhard Thomaszewski. 2017. A Computational Design Tool for Compliant Mechanisms. ACM Trans. Graph. 36, 4, Article 82 (July 2017), 12 pages. Google ScholarDigital Library
34. Matthias Müller, Bruno Heidelberger, Matthias Teschner, and Markus Gross. 2005. Meshless Deformations Based on Shape Matching. ACM Trans. Graph. 24, 3 (July 2005), 471–478. Google ScholarDigital Library
35. Jorge Nocedal and Stephen J. Wright. 2006. Numerical Optimization, second edition. World Scientific.Google Scholar
36. Carmine Maria Pappalardo and Domenico Guida. 2018. Use of the Adjoint Method for Controlling the Mechanical Vibrations of Nonlinear Systems. Machines 6, 2 (2018), 19.Google ScholarCross Ref
37. Jesús Pérez, Bernhard Thomaszewski, Stelian Coros, Bernd Bickel, José A. Canabal, Robert Sumner, and Miguel A. Otaduy. 2015. Design and Fabrication of Flexible Rod Meshes. ACM Trans. Graph. 34, 4, Article 138 (July 2015), 12 pages. Google ScholarDigital Library
38. Jovan Popović, Steven M Seitz, and Michael Erdmann. 2003. Motion sketching for control of rigid-body simulations. ACM Trans. Graph. 22, 4 (2003), 1034–1054. Google ScholarDigital Library
39. Christian Schulz, Christoph von Tycowicz, Hans-Peter Seidel, and Klaus Hildebrandt. 2014. Animating deformable objects using sparse spacetime constraints. ACM Trans. Graph. 33, 4 (2014), 109. Google ScholarDigital Library
40. Tamar Shinar, Craig Schroeder, and Ronald Fedkiw. 2008. Two-way coupling of rigid and deformable bodies. In Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Eurographics Association, 95–103. Google ScholarDigital Library
41. Weiguang Si, Sung-Hee Lee, Eftychios Sifakis, and Demetri Terzopoulos. 2014. Realistic biomechanical simulation and control of human swimming. ACM Trans. Graph. 34, 1 (2014), 10. Google ScholarDigital Library
42. Mélina Skouras, Bernhard Thomaszewski, Stelian Coros, Bernd Bickel, and Markus H. Gross. 2013. Computational design of actuated deformable characters. ACM Trans. Graph. 32, 4 (2013), 82:1–82:10. Google ScholarDigital Library
43. Breannan Smith, Fernando de Goes, and Theodore Kim. 2018. Stable Neo-Hookean Flesh Simulation. ACM Trans. Graph. 37, 2 (2018), 12:1–12:15. Google ScholarDigital Library
44. Peng Song, Xiaofei Wang, Xiao Tang, Chi-Wing Fu, Hongfei Xu, Ligang Liu, and Niloy J. Mitra. 2017. Computational design of wind-up toys. ACM Trans. Graph. 36, 6 (2017), 238:1–238:13. Google ScholarDigital Library
45. Jie Tan, Yuting Gu, Greg Turk, and C. Karen Liu. 2011. Articulated swimming creatures. ACM Trans. Graph. 30, 4 (2011), 58:1–58:12. Google ScholarDigital Library
46. Bernhard Thomaszewski, Stelian Coros, Damien Gauge, Vittorio Megaro, Eitan Grinspun, and Markus Gross. 2014. Computational Design of Linkage-based Characters. ACM Trans. Graph. 33, 4, Article 64 (July 2014), 9 pages. Google ScholarDigital Library
47. Maxime Tournier, Matthieu Nesme, Benjamin Gilles, and François Faure. 2015. Stable constrained dynamics. ACM Trans. Graph. 34, 4 (2015), 132:1–132:10. Google ScholarDigital Library
48. Adrien Treuille, Antoine McNamara, Zoran Popović, and Jos Stam. 2003. Keyframe control of smoke simulations. ACM Trans. Graph. 22, 3 (2003), 716–723. Google ScholarDigital Library
49. Nobuyuki Umetani, Yuki Koyama, Ryan Schmidt, and Takeo Igarashi. 2014. Pteromys: interactive design and optimization of free-formed free-flight model airplanes. ACM Trans. Graph. 33, 4 (2014), 65:1–65:10. Google ScholarDigital Library
50. Christoph von Tycowicz, Christian Schulz, Hans-Peter Seidel, and Klaus Hildebrandt. 2013. An efficient construction of reduced deformable objects. ACM Trans. Graph. 32, 6 (2013), 213. Google ScholarDigital Library
51. Andrew Witkin and David Baraff. 1997. Physically Based Modeling: Principles and Practice. In ACM SIGGRAPH 1997 Courses (SIGGRAPH ’97). New York, NY, USA.Google Scholar
52. Chris Wojtan, Peter J Mucha, and Greg Turk. 2006. Keyframe control of complex particle systems using the adjoint method. In ACM SIGGRAPH/Eurographics symposium on Computer animation. Eurographics Association, 15–23. Google ScholarDigital Library
53. Hongyi Xu and Jernej Barbič. 2016. Pose-space subspace dynamics. ACM Trans. Graph. 35, 4 (2016), 35. Google ScholarDigital Library
54. Hongyi Xu, Espen Knoop, Stelian Coros, and Moritz Bächer. 2018. Bend-it: Design and Fabrication of Kinetic Wire Characters. ACM Trans. Graph. 37, 6 (2018), 239:1–239:15. Google ScholarDigital Library
55. Ran Zhang, Thomas Auzinger, Duygu Ceylan, Wilmot Li, and Bernd Bickel. 2017. Functionality-aware retargeting of mechanisms to 3D shapes. ACM Trans. Graph. 36, 4 (2017), 81:1–81:13. Google ScholarDigital Library
56. Tong Zhou, Andrew A Goldenberg, and Jean W Zu. 2002. Modal force based input shaper for vibration suppression of flexible payloads. In Robotics and Automation, 2002. Proceedings. ICRA’02. IEEE International Conference on, Vol. 3. IEEE, 2430–2435.Google ScholarCross Ref
