An AI Spline Motion Model for Swapping Objects in Animation

A new tool for creating deepfakes.

Take a look at this fascinating motion transfer framework by Jian Zhao and Hui Zhang. The thin-plate spline motion model allows changing the person's face or even the whole body in animation. The method can also animate other objects, including pixel animations.

To generate realistic, high-quality images, the authors use multi-resolution occlusion masks and additional auxiliary loss functions.

The paper trains the model for 100 epochs for a fair comparison, and it looks really impressive. 

If you'd like to try it yourself, check out the paper here and get the code on GitHub. Also, don't forget to join our new Reddit pageour new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.

Published 16 May 2022
Gloria Levine
Senior Editor