“Animating animal motion from still images”
Conference:
Type(s):
Title:
- Animating animal motion from still images
Session/Category Title: Fun with single images
Presenter(s)/Author(s):
Abstract:
Even though the temporal information is lost, a still picture of moving animals hints at their motion. In this paper, we infer motion cycle of animals from the “motion snapshots” (snapshots of different individuals) captured in a still picture. By finding the motion path in the graph connecting motion snapshots, we can infer the order of motion snapshots with respect to time, and hence the motion cycle. Both “half-cycle” and “full-cycle” motions can be inferred in a unified manner. Therefore, we can animate a still picture of a moving animal group by morphing among the ordered snapshots. By refining the pose, morphology, and appearance consistencies, smooth and realistic animal motion can be synthesized. Our results demonstrate the applicability of the proposed method to a wide range of species, including birds, fishes, mammals, and reptiles.
References:
1. Agarwal, A., and Triggs, B. 2005. Monocular human motion capture with a mixture of regressors. In Proc. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2005 – Workshops, 72. Google Scholar
2. Agarwal, A. 2006. Machine learning for image based motion capture. PhD Thesis, Institut National Polytechnique de Grenoble.Google Scholar
3. Barrett, W. A., and Cheney, A. S. 2002. Object-based image editing. In Proc. ACM SIGGRAPH 2002, 777–784. Google Scholar
4. Belongie, S., Malik, J., and Puzicha, J. 2002. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligience 24, 4, 509–522. Google ScholarDigital Library
5. Bookstein, F. L. 1989. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Transaction on Pattern Analysis and Machine Intelligience 11, 6, 567–585. Google ScholarDigital Library
6. Brostow, G. J., and Essa, I. 2001. Image-based motion blur for stop motion animation. In Proc. ACM SIGGRAPH 2001, 561–566. Google Scholar
7. Chetverikov, D., and Fazekas, S. 2006. On motion periodicity of dynamic textures. In British Machine Vision Conference (BMVC), vol. I, 167–175.Google Scholar
8. Chuang, Y.-Y., Goldman, D. B., Zheng, K. C., Curless, B., Salesin, D. H., and Szeliski, R. 2005. Animating pictures with stochastic motion textures. In Proc. ACM SIGGRAPH 2005, 853–860. Google Scholar
9. Criminisi, A., Reid, I. D., and Zisserman, A. 2000. Single view metrology. International Journal of Computer Vision 40, 2, 123–148. Google ScholarDigital Library
10. Criminisi, A., Perez, P., and Toyama, K. 2003. Object removal by exemplar-based inpainting. In Proc. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2003, 721–728.Google Scholar
11. Horry, Y., Anjyo, K.-I., and Arai, K. 1997. Tour into the picture: using a spidery mesh interface to make animation from a single image. In Proc. ACM SIGGRAPH 1997, 225–232. Google Scholar
12. Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. In Proc. ACM SIGGRAPH 2005, 1134–1141. Google Scholar
13. Lin, Z., Wang, L., Wang, Y., Kang, S. B., and Fang, T. 2007. High resolution animated scenes from stills. IEEE Transactions on Visualization and Computer Graphics 13, 3, 562–568. Google ScholarDigital Library
14. Litwinowicz, P., and Williams, L. 1994. Animating images with drawings. In Proc. ACM SIGGRAPH 1994, 409–412. Google Scholar
15. Mori, G., Belongie, S., and Malik, J. 2005. Efficient shape matching using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 11, 1832–1837. Google ScholarDigital Library
16. Ngo, T., Cutrell, D., Dana, J., Donald, B., Loeb, L., and Zhu, S. 2000. Accessible animation and customizable graphics via simplicial configuration modeling. In Proc. ACM SIGGRAPH 2000, 403–410. Google Scholar
17. Oh, B. M., Chen, M., Dorsey, J., and Durand, F. 2001. Image-based modeling and photo editing. In Proc. ACM SIGGRAPH 2001, 433–442. Google Scholar
18. Pepper, J. W., Golden, B. L., and Wasil, E. A. 2002. Solving the traveling salesman problem with annealing-basedheuristics: a computational study. IEEE Transactions on Systems, Man and Cybernetics, Part A 32, 1, 72–77. Google ScholarDigital Library
19. Rother, C., Kolmogorov, V., and Blake, A. 2004. “grab-cut”: interactive foreground extraction using iterated graph cuts. ACM Transaction on Graphics 23, 3, 309–314. Google ScholarDigital Library
20. Schaefer, S., McPhail, T., and Warren, J. 2006. Image deformation using moving least squares. In Proc. ACM SIGGRAPH 2006, 533–540. Google Scholar
21. Schindler, G., Dellaert, F., and Kang, S. B. 2007. Inferring temporal order of images from 3D structure. In Proc. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2007.Google Scholar
22. Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In Proc. ACM SIGGRAPH 2000, 489–498. Google Scholar
23. Shinya, M., Aoki, M., Tsutsuguchi, K., and Kotani, N. 1999. Dynamic texture: physically based 2D animation. In Proc. ACM SIGGRAPH 1999, 239. Google Scholar
24. Sminchisescu, C. 2006. 3D human motion analysis in monocular video techniques and challenges. In Proc. the IEEE International Conference on Video and Signal Based Surveillance, 76. Google ScholarDigital Library
25. Soatto, S., Doretto, G., and Wu, Y. N. 2001. Dynamic textures. In International Conference on Computer Vision, 439–446.Google Scholar
26. Wang, Y., and Zhu, S.-C. 2003. Modeling textured motion: Particle, wave and sketch. In Proc. the 9th IEEE International Conference on Computer Vision(ICCV) 2003, 213–220. Google ScholarDigital Library
