“KinÊtre: animating the world with the human body” by Chen, Izadi and Fitzgibbon

Imagine you are asked to produce a 3D animation of a demonic armchair terrorizing an innocent desk lamp. You may think about model rigging, skeleton deformation, and keyframing. Depending on your experience, you might imagine hours to days at the controls of Maya or Blender. But even if you have absolutely no computer graphics experience, it can be so much easier: grab a nearby chair and desk lamp, scan them using a consumer depth camera, and use the same camera to track your body, aligning your virtual limbs to the chair’s geometry. At one spoken command, your limbs are attached to the chair model, which follows your movements in an intuitive and natural manner. Kinêtre is such a system. Rather than targeting professional animators, it brings animation to a new audience of users with little or no CG experience. It allows realistic deformations of arbitrary static meshes, runs in real time on consumer hardware, and uses the human body for input in conjunction with simple voice commands. Kinêtre lets anyone create playful 3D animations.

1. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. 2011. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In UIST 2011.
2. Sumner, R. W., Schmid, J., and Pauly, M. 2007. Embedded deformation for shape manipulation. SIGGRAPH 2007.