“Computational Foresight: Realtime Forecast of Human Body Motion”
Conference:
Experience Type(s):
Title:
- Computational Foresight: Realtime Forecast of Human Body Motion
Organizer(s)/Presenter(s):
Description:
In this paper, we propose a machine learning-based system named “Comuputational Foresight” that can forecast body motion 0.5 seconds before. The system detects 25 human body joints by Kinect V2. We created 6-layered neural network system for machine-learning. We achieved real-time motion forecast system. This can be used to estimate human gesture inputs in advance, instruct sports actions properly, and prevent elderly from falling to the ground, and so on.
References:
[1]
Mohammad Bataineh, Timothy Marler, Karim Abdel-Malek, and Jasbir Arora. 2016. Neural network for dynamic human motion prediction. Expert Systems with Applications 48 (2016), 26–34.
[2]
Chen Chen, Kui Liu, and Nasser Kehtarnavaz. 2016. Real-time human action recognition based on depth motion maps. Journal of real-time image processing 12, 1 (2016), 155–163.
[3]
Catalin Ionescu, Dragos Papava, Vlad Olaru, and Cristian Sminchisescu. 2014. Human3.6m: Large scale datasets and predictive methods for 3d human sensing in natural environments. IEEE transactions on pattern analysis and machine intelligence 36, 7 (2014), 1325–1339.
[4]
Ashesh Jain, Amir R Zamir, Silvio Savarese, and Ashutosh Saxena. 2016. Structural-RNN: Deep learning on spatio-temporal graphs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5308–5317.
[5]
Julieta Martinez, Michael J Black, and Javier Romero. 2017. On human motion prediction using recurrent neural networks. arXiv preprint arXiv:1705.02445 (2017).
[6]
Seong-Bin Park, Sa-Yup Kim, Joon-Ho Hyeong, and Kyung-Ryul Chung. 2014. A study on the development of image analysis instrument and estimation of mass, volume and center of gravity using CT image in Korean. Journal of Mechanical Science and Technology 28, 3 (2014), 971.
[7]
Jack M Wang, David J Fleet, and Aaron Hertzmann. 2008. Gaussian process dynamical models for human motion. IEEE transactions on pattern analysis and machine intelligence 30, 2 (2008), 283–298.
