“Motion graphs++: a compact generative model for semantic motion analysis and synthesis” by Min and Chai
Conference:
Type(s):
Title:
- Motion graphs++: a compact generative model for semantic motion analysis and synthesis
Session/Category Title: Full-Body Character Animation
Presenter(s)/Author(s):
Abstract:
This paper introduces a new generative statistical model that allows for human motion analysis and synthesis at both semantic and kinematic levels. Our key idea is to decouple complex variations of human movements into finite structural variations and continuous style variations and encode them with a concatenation of morphable functional models. This allows us to model not only a rich repertoire of behaviors but also an infinite number of style variations within the same action. Our models are appealing for motion analysis and synthesis because they are highly structured, contact aware, and semantic embedding. We have constructed a compact generative motion model from a huge and heterogeneous motion database (about two hours mocap data and more than 15 different actions). We have demonstrated the power and effectiveness of our models by exploring a wide variety of applications, ranging from automatic motion segmentation, recognition, and annotation, and online/offline motion synthesis at both kinematics and behavior levels to semantic motion editing. We show the superiority of our model by comparing it with alternative methods.
References:
1. Arikan, O., and Forsyth, D. A. 2002. Interactive motion generation from examples. In ACM Transactions on Graphics. 21(3):483–490.
2. Arikan, O., Forsyth, D. A., and O’Brien, J. F. 2003. Motion synthesis from annotations. In ACM Transactions on Graphics. 22(3):402–408.
3. Beaudoin, P., Coros, S., van de Panne, M., and Poulin, P. 2008. Motion-motif graphs. In Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA’08, 117–126.
4. Bishop, C. 1996. Neural Network for Pattern Recognition. Cambridge University Press.
5. Bowden, R. 2000. Learning statistical models of human motion. In IEEE Workshop on Human Modelling, Analysis and Synthesis, CVPR2000.
6. Brand, M., and Hertzmann, A. 2000. Style machines. In Proceedings of ACM SIGGRAPH 2000. 183–192.
7. Chai, J., and Hodgins, J. 2005. Performance animation from low-dimensional control signals. In ACM Transactions on Graphics. 24(3):686–696.
8. Chai, J., and Hodgins, J. 2007. Constraint-based motion optimization using a statistical dynamic model. In ACM Transactions on Graphics. 26(3):Article No. 8.
9. Gleicher, M., Shin, H. J., Kovar, L., and Jepsen, A. 2003. Snap-together motion: assembling run-time animations. In Proceedings of the 2003 symposium on Interactive 3D graphics, I3D’03, 181–188.
10. Grochow, K., Martin, S. L., Hertzmann, A., and Popović, Z. 2004. Style-based inverse kinematics. In ACM Transactions on Graphics. 23(3):522–531.
11. Heck, R., and Gleicher, M. 2007. Parametric motion graphs. In Proceedings of the 2007 symposium on Interactive 3D graphics and games. 129–136.
12. Hsu, E., Pulli, K., and Popović, J. 2005. Style translation for human motion. In ACM Transactions on Graphics. 24(3):1082–1089.
13. Ikemoto, L., Arikan, O., and Forsyth, D. 2009. Generalizing motion edits with gaussian processes. ACM Transactions on Graphics 28, 1, 1–12.
14. Kovar, L., and Gleicher, M. 2003. Flexible automatic motion blending with registration curves. In ACM SIGGRAPH/EUROGRAPH Symposium on Computer Animation. 214–224.
15. Kovar, L., and Gleicher, M. 2004. Automated extraction and parameterization of motions in large data sets. In ACM Transactions on Graphics. 23(3):559–568.
16. Kovar, L., Gleicher, M., and Pighin, F. 2002. Motion graphs. In ACM Transactions on Graphics. 21(3):473–482.
17. Lau, M., and Kuffner, J. J. 2005. Behavior planning for character animation. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, SCA’ 05, 271–280.
18. Lau, M., Bar-Joseph, Z., and Kuffner, J. 2009. Modeling spatial and temporal variation in motion data. In ACM Transactions on Graphics. 28(5): Article No. 171.
19. Lawrence, N. D., 2009. Gaussian process software. http://www.cs.manchester.ac.uk/neill/gp/.
20. Lee, J., Chai, J., Reitsma, P., Hodgins, J., and Pollard, N. 2002. Interactive control of avatars animated with human motion data. In ACM Transactions on Graphics. 21(3):491–500.
21. Lee, Y., Wampler, K., Bernstein, G., Popović, J., and Popović, Z. 2010. Motion fields for interactive character locomotion. ACM Transactions on Graphics 29, 138:1–138:8.
22. Li, Y., Wang, T., and Shum, H.-Y. 2002. Motion texture: A two-level statistical model for character synthesis. In ACM Transactions on Graphics. 21(3):465–472.
23. Lourakis, M. I. A., 2009. levmar: Levenberg-Marquardt nonlinear least squares algorithms in C/C++.
24. Min, J., Chen, Y.-L., and Chai, J. 2009. Interactive generation of human animation with deformable motion models. ACM Transactions on Graphics. 29(1): article No. 9.
25. Molina Tanco, L., and Hilton, A. 2000. Realistic synthesis of novel human movements from a database of motion capture examples. In Proceedings of the Workshop on Human Motion. 137–142.
26. Mukai, T., and Kuriyama, S. 2005. Geostatistical motion interpolation. In ACM Transactions on Graphics. 24(3):1062–1070.
27. Quinonero-Candela, J., and Rasmussen, C. E. 2005. A unifying view of sparse approximate gaussian process regression. Journal of Machine Learning Research. 6: 1935–1959.
28. Rasmussen, C. E., and Williams, C. K. I. 2006. Gaussian Processes for Machine Learning. The MIT Press.
29. Rose, C., Cohen, M. F., and Bodenheimer, B. 1998. Verbs and adverbs: Multidimensional motion interpolation. In IEEE Computer Graphics and Applications. 18(5):32–40.
30. Safonova, A., and Hodgins, J. K. 2007. Construction and optimal search of interpolated motion graphs. In ACM Transactions on Graphics. 26(3): Article No. 106.
31. Shin, H. J., and Oh, H. S. 2006. Fat graphs: constructing an interactive character with continuous controls. In Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation, SCA ’06, 291–298.
32. Shum, H. P. H., Komura, T., Shiraishi, M., and Yamazaki, S. 2008. Interaction patches for multi-character animation. ACM Transactions on Graphics. 27(5): Article No. 114.
33. Treuille, A., Lee, Y., and Popović, Z. 2007. Near-optimal character animation with continuous control. ACM Transaction on Graphics. 26(3): Article No. 7.
34. Wei, X., Min, J., and Chai, J. 2011. Physically valid statistical models for human motion generation. ACM Trans. Graph. 30, 19:1–19:10.
35. Ye, Y., and Liu, K. 2010. Synthesis of responsive motion using a dynamic model. Computer Graphics Forum (Proceedings of Eurographics). 29(2): 555–562.
