“Enhanced Shadow Play with Neural Networks”
Conference:
Experience Type(s):
Title:
- Enhanced Shadow Play with Neural Networks
Organizer(s)/Presenter(s):
Description:
We present a shadow play system that displays in real-time the extrapolated motion sequences of the still shadow images casted by players. The crux of our system is a sequential version of the recently developed generative adversarial neural networks with a stack of LSTMs as the sequence controller. We train the model with preprocessed image sequences of diverse shadow fgures’ motions, and use it in our enhanced shadow play system to automatically animate the shadows as if they were alive.
References:
[1]
Martin Arjovsky, Soumith Chintala, and Léon Bottou. 2017. Wasserstein gan. arXiv preprint arXiv:1701.07875 (2017).
[2]
David Berthelot, Tom Schumm, and Luke Metz. 2017. Began: Boundary equilibrium generative adversarial networks. arXiv preprint arXiv:1703.10717 (2017).
[3]
Timothy F. Cootes, Gareth J. Edwards, and Christopher J. Taylor. 2001. Active appearance models. IEEE Transactions on pattern analysis and machine intelligence 23, 6 (2001), 681–685.
[4]
Gwenn Englebienne, Timothy F Cootes, and Magnus Rattray. 2007. A probabilistic model for generating realistic lip movements from speech. In NIPS, Vol. 8. 401–408.
[5]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in neural information processing systems. 2672–2680.
[6]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.
[7]
Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013).
[8]
Alec Radford, Luke Metz, and Soumith Chintala. 2015. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015).
[9]
Carl Vondrick, Hamed Pirsiavash, and Antonio Torralba. 2016. Generating videos with scene dynamics. In Advances In Neural Information Processing Systems. 613–621.
[10]
Tianfan Xue, Jiajun Wu, Katherine Bouman, and Bill Freeman. 2016. Visual dynamics: Probabilistic future frame synthesis via cross convolutional networks. In Advances in Neural Information Processing Systems. 91–99.
