“A data-driven approach to quantifying natural human motion” by Ren, Efros, Patrick, Hodgins and Rehg

In this paper, we investigate whether it is possible to develop a measure that quantifies the naturalness of human motion (as defined by a large database). Such a measure might prove useful in verifying that a motion editing operation had not destroyed the naturalness of a motion capture clip or that a synthetic motion transition was within the space of those seen in natural human motion. We explore the performance of mixture of Gaussians (MoG), hidden Markov models (HMM), and switching linear dynamic systems (SLDS) on this problem. We use each of these statistical models alone and as part of an ensemble of smaller statistical models. We also implement a Naive Bayes (NB) model for a baseline comparison. We test these techniques on motion capture data held out from a database, keyframed motions, edited motions, motions with noise added, and synthetic motion transitions. We present the results as receiver operating characteristic (ROC) curves and compare the results to the judgments made by subjects in a user study.

1. Arikan, O., and Forsyth, D. A. 2002. Interactive motion generation from examples. ACM Transactions on Graphics 21(3), 483–490. Google ScholarDigital Library
2. Assa, J., Caspi, Y., and Cohen-Or, D. 2005. Action synopsis: Pose selection and illustration. ACM Transactions on Graphics 24(3). Google ScholarDigital Library
3. Brand, M., and Hertzmann, A. 2000. Style machines. In Proceedings of ACM SIGGRAPH 2000, 183–192. Google ScholarDigital Library
4. Cole, R. A., 1996. Survey of the state of the art in human language technology. http://cslu.cse.ogi.edu/HLTsurvey. Google ScholarDigital Library
5. Farid, H., and Lyu, S. 2003. Higher-order wavelet statistics and their application to digital forensics. In IEEE Workshop on Statistical Analysis in Computer Vision (in conjunction with CVPR 2003).Google Scholar
6. Gleicher, M. 2001. Comparing constraint-based motion editing methods. Graphical Models 63(2), 107–134. Google ScholarDigital Library
7. Hamid, R., Johnson, A., Batta, S., Bobick, A., Isbell, C., and Coleman, G. 2005. Detection and explanation of anomalous activities. In IEEE Conference on Computer Vision and Pattern Recognition. To appear. Google ScholarDigital Library
8. Hara, K., Omori, T., and Ueno, R. 2002. Detection of unusual human behavior in intelligent house. In Neural Networks for Signal Processing XII-Proceedings of the 2002 IEEE Signal Processing Society Workshop, 697–706.Google Scholar
9. Harrison, J., Rensink, R. A., and Van De Panne, M. 2004. Obscuring length changes during animated motion. ACM Transactions on Graphics 23(3), 569–573. Google ScholarDigital Library
10. Ikemoto, L., and Forsyth, D. A. 2004. Enriching a motion collection by transplanting limbs. In Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 99–108. Google ScholarDigital Library
11. Kovar, L., and Gleicher, M. 2004. Automated extraction and parameterization of motions in large data sets. ACM Transactions on Graphics 23(3), 559–568. Google ScholarDigital Library
12. Kovar, L., Gleicher, M., and Pighin, F. 2002. Motion graphs. ACM Transactions on Graphics 21(3), 473–482. Google ScholarDigital Library
13. Lee, J., Chai, J., Reitsma, P., Hodgins, J., and Pollard, N. 2002. Interactive control of avatars animated with human motion data. ACM Transactions on Graphics 21(3), 491–500. Google ScholarDigital Library
14. Lerner, U. 2002. Hybrid Bayesian Networks for Reasoning about Complex Systems. PhD thesis, Stanford University.Google Scholar
15. Li, Y., Wang, T., and Shum, H.-Y. 2002. Motion texture: a two-level statistical model for character motion synthesis. ACM Transactions on Graphics 21(3), 465–472. Google ScholarDigital Library
16. O’Sullivan, C., Dingliana, J., Giang, T., and Kaiser, M. K. 2003. Evaluating the visual fidelity of physically based animations. ACM Transactions on Graphics 22(3), 527–536. Google ScholarDigital Library
17. Pavlović, V., Rehg, J. M., and MacCormick, J. 2000. Learning switching linear models of human motion. In Proceedings of Advances in Neural Information Processing Systems (NIPS 2000), 981–987.Google Scholar
18. Perlin, K. 1995. Real time responsive animation with personality. IEEE Transactions on Visualization and Computer Graphics 1(1), 5–15. Google ScholarDigital Library
19. Pollick, F., Hale, J. G., and McAleer, P. 2003. Visual perception of humanoid movement. In Proceedings Third International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems 101, 107–114.Google Scholar
20. Rabiner, L. R., and Juang, B.-H. 1993. Fundamentals of Speech Recognition. Prentice Hall. Google ScholarDigital Library
21. Reitsma, P. S. A., and Pollard, N. S. 2003. Perceptual metrics for character animation: Sensitivity to errors in ballistic motion. ACM Transactions on Graphics 22(3), 537–542. Google ScholarDigital Library
22. Rose, C., Cohen, M. F., and Bodenheimer, B. 1998. Verbs and adverbs: Multidimensional motion interpolation. IEEE Computer Graphics and Applications 18(5), 32–40. Google ScholarDigital Library
23. Soatto, S., Doretto, G., and Wu, Y. 2001. Dynamic textures. In IEEE International Conference on Computer Vision, vol. 2, 439-446.Google Scholar
24. Sulejmanpasic, A., and Popovic, J. 2005. Adaptation of performed ballistic motion. ACM Transactions on Graphics 24(1), 165–179. Google ScholarDigital Library
25. Troje, N. K. 2002. Decomposing biological motion: A frame-work for analysis and synthesis of human gait patterns. Journal of Vision 2, 371–387.Google ScholarCross Ref
26. Van Trees, H. L. 1968. Detection, Estimation, and Modulation Theory, vol. 1. John Wiley. Google ScholarDigital Library
27. Vicon Motion Systems, 2005. http://www.vicon.com/.Google Scholar
28. Wang, J., and Bodenheimer, B. 2003. An evaluation of a cost metric for selecting transitions between motion segments. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 232–238. Google ScholarDigital Library
29. Wang, J., and Bodenheimer, B. 2004. Computing the duration of motion transitions: an empirical approach. In Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 335–344. Google ScholarDigital Library
30. Wiley, D. J., and Hahn, J. K. 1997. Interpolation synthesis of articulated figure motion. IEEE Computer Graphics and Applications 17(6), 39–45. Google ScholarDigital Library
31. Zhong, H., Shi, J., and Visontai, M. 2004. Detecting unusual activity in video. In IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 819–826. Google ScholarDigital Library