“Synthesizing animations of human manipulation tasks” by Yamane, Kuffner and Hodgins

  • ©Katsu Yamane, James Kuffner, and Jessica K. Hodgins




    Synthesizing animations of human manipulation tasks



    Even such simple tasks as placing a box on a shelf are difficult to animate, because the animator must carefully position the character to satisfy geometric and balance constraints while creating motion to perform the task with a natural-looking style. In this paper, we explore an approach for animating characters manipulating objects that combines the power of path planning with the domain knowledge inherent in data-driven, constraint-based inverse kinematics. A path planner is used to find a motion for the object such that the corresponding poses of the character satisfy geometric, kinematic, and posture constraints. The inverse kinematics computation of the character’s pose resolves redundancy by biasing the solution toward natural-looking poses extracted from a database of captured motions. Having this database greatly helps to increase the quality of the output motion. The computed path is converted to a motion trajectory using a model of the velocity profile. We demonstrate the effectiveness of the algorithm by generating animations across a wide range of scenarios that cover variations in the geometric, kinematic, and dynamic models of the character, the manipulated object, and obstacles in the scene.


    1. ARIKAN, O., AND FORSYTH, D. A. 2002. Synthesizing constrained motions from examples. ACM Trans. on Graphics 21, 3, 483–490. Google ScholarDigital Library
    2. ARIKAN, O., FORSYTH, D. A., AND O’BRIEN, J. F. 2003. Motion synthesis from annotations. ACM Trans. on Graphics 22, 3, 402–408. Google ScholarDigital Library
    3. ARYA, S., MOUNT, D. M., NETANYAHU, N. S., SILVERMAN, R., AND WU, A. Y. 1998. An optimal algorithm for approximate nearest neighbor searching. Journal of the ACM 45, 891–923. Google ScholarDigital Library
    4. ATKESON, C., AND HOLLERBACH, J. 1985. Kinematic features of unrestrained vertical arm movements. Journal of Neuroscience, 9, 318–2330.Google Scholar
    5. BANDI, S. 1998. Discrete Object Space Methods for Computer Animation. PhD thesis, Swiss Federal Institute of Technology.Google Scholar
    6. BARRAQUAND, J., AND LATOMBE, J.-C. 1990. Robot motion planning: A distributed representation approach. Int. Journal of Robotics Research 10, 6 (December), 628–649. Google ScholarDigital Library
    7. BINDIGANAVALE, R., GRANIERI, J., WEI, S., ZHAO, X., AND BADLER, N. 1994. Posture interpolation with collision avoidance. In Proc. of Computer Animation ’94, 13–20.Google Scholar
    8. BOULIC, R., MAS, R., AND THALMANN, D. 1997. Complex character positioning based on a compatible flow model of multiple supports. IEEE Trans. on Visualization and Computer Graphics (July-Sept), 245–261. Google ScholarDigital Library
    9. BRUDERLIN, A., AND CALVERT, T. W. 1989. Goal-directed, dynamic animation of human walking. In Computer Graphics (Proc. SIGGRAPH 89), vol. 23, 233–242. Google ScholarDigital Library
    10. CHING, W., AND BADLER, N. 1992. Fast motion planning for anthropometric figures with many degrees of freedom. In Proc. IEEE Int’l Conf. on Robotics and Automation, 2340–2345.Google ScholarCross Ref
    11. GLEICHER, M. 1997. Motion editing with spacetime constraints. 1997 Symposium on Interactive 3D Graphics, 139–148. Google ScholarDigital Library
    12. GLEICHER, M. 1998. Retargeting motion to new characters. In Proc. SIGGRAPH 98, 33–42. Google ScholarDigital Library
    13. JUNG, M. R., BADLER, N., AND NOMA, T. 1994. Animated human agents with motion planning capability for 3D-space postural goals. J. Visualization and Comp. Animation 5, 4, 225–246.Google ScholarCross Ref
    14. KALISIAK, M., AND VANDE PANNE, M. 2000. A grasp-based motion planning algorithm for character animation. In Proc. Comp. Animation and Simulation 2000, Springer-Verlag, 43–58.Google Scholar
    15. KAVRAKI, L., ŠVESTKA, P., LATOMBE, J. C., AND OVERMARS, M. H. 1996. Probabilistic roadmaps for path planning in high-dimensional configuration space. IEEE Trans. on Robotics and Automation 12, 4, 566–580.Google ScholarCross Ref
    16. KAWATO, M. 1999. Internal models for motor control and trajectory planning. Current Opinion in Neurobiology 9, 718–727.Google ScholarCross Ref
    17. KOGA, Y., KONDO, K., KUFFNER, J., AND LATOMBE, J.-C. 1994. Planning motions with intentions. In Proc. SIGGRAPH 94, 395–408. Google ScholarDigital Library
    18. KOVAR, L., GLEICHER, M., AND PIGHIN, F. 2002. Motion graphs. ACM Trans. on Graphics 21, 3, 473–482. Google ScholarDigital Library
    19. KUFFNER, J., KAGAMI, S., NISHIWAKI, K., INABA, M., AND INOUE, H. 2002. Dynamically-stable motion planning for humanoid robots. Autonomous Robots 12, 105–118. Google ScholarDigital Library
    20. KUFFNER, J. 1999. Autonomous Agents for Real-time Animation. PhD thesis, Stanford University. Google ScholarDigital Library
    21. LATOMBE, J. C. 1991. Robot Motion Planning. Kluwer Academic Publishers, Boston, MA. Google ScholarDigital Library
    22. LAVALLE, S., AND KUFFNER, J. 2001. Randomized kinodynamic planning. Int’l Journal of Robotics Research 20, 5, 378–400.Google ScholarCross Ref
    23. LEE, J., CHAI, J., REITSMA, P. S. A., HODGINS, J. K., AND POLLARD, N. S. 2002. Interactive control of avatars animated with human motion data. ACM Trans. on Graphics 21, 3, 491–500. Google ScholarDigital Library
    24. LEE, S., BADLER, J., AND BADLER, N. 2002. Eyes alive. ACM Trans. on Graphics 21, 3, 637–644. Google ScholarDigital Library
    25. LIU, Y., AND BADLER, N. I. 2003. Real-time reach planning for animated characters using hardware acceleration. In Proc. Computer Animation and Social Agents (CASA), 86–93. Google ScholarDigital Library
    26. MORASSO, P., AND TAGLIASCO, V., Eds. 1986. Human Movement Understanding: from computational geometry to artificial intelligence. North-Holland. Google ScholarDigital Library
    27. NAKAMURA, Y., AND HANAFUSA, H. 1986. Inverse Kinematics Solutions with Singularity Robustness for Robot Manipulator Control. J. Dynamic Sys., Meas., and Control 108, 163–171.Google Scholar
    28. PARK, W., CHAFFIN, D., AND MARTIN, B. 2002. Modifying motions for avoiding obstacles. SAE Transactions 110, 6, 2250–2256.Google Scholar
    29. PETTRE, J., LAUMOND, J.-P., AND SIMEON, T. 2003. A 2-stages locomotion planner for digital actors. In ACM SIGGRAPH Symp. on Computer Animation, 258–264. Google ScholarDigital Library
    30. ROSE, C. F., GUENTER, B., BODENHEIMER, B., AND COHEN, M. F. 1996. Efficient generation of motion transitions using spacetime constraints. In Proc. SIGGRAPH 96, 147–154. Google ScholarDigital Library
    31. ROSE, C., COHEN, M. F., AND BODENHEIMER, B. 1998. Verbs and adverbs: Multidimensional motion interpolation. IEEE Computer Graphics & Applications 18, 5, 32–40. Google ScholarDigital Library
    32. ROSE, C. F., SLOAN, P.-P. J., AND COHEN, M. F. 2001. Artist-directed inverse-kinematics using radial basis function interpolation. Computer Graphics Forum 20, 3, 239–250.Google ScholarCross Ref
    33. SHOEMAKE, K. 1985. Animating rotation with quaternion curves. In Proc. SIGGRAPH 85, 245–254. Google ScholarDigital Library
    34. SIMEON, T., CORTES, J., SAHBANI, A., AND LAUMOND, J. P. 2002. A manipulation planner for pick and place operations under continous grasps and placements. In Proc. Int’l Conf. on Robotics and Automation, 2022–2027.Google Scholar
    35. WILEY, D., AND HAHN, J. 1997. Interpolation synthesis of articulated figure motion. IEEE Computer Graphic and Applications 17, 6, 39–45. Google ScholarDigital Library
    36. YAMANE, K., AND NAKAMURA, Y. 2003. Natural Motion Animation through Constraining and Deconstraining at Will. IEEE Trans. on Visualization and Computer Graphics 9, 3, 352–360. Google ScholarDigital Library

ACM Digital Library Publication:

Overview Page: