An AI Spline Motion Model for Swapping Objects in Animation

Take a look at this fascinating motion transfer framework by Jian Zhao and Hui Zhang. The thin-plate spline motion model allows changing the person's face or even the whole body in animation. The method can also animate other objects, including pixel animations.

To generate realistic, high-quality images, the authors use multi-resolution occlusion masks and additional auxiliary loss functions.

The paper trains the model for 100 epochs for a fair comparison, and it looks really impressive. 

If you'd like to try it yourself, check out the paper here and get the code on GitHub. Also, don't forget to join our new Reddit page, our new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.