Stylized Face Animation Made With MetaHuman & Stable Diffusion

The AI-generated face was animated using Thin-Plate Spline Motion Model and GFPGAN.

Digital Artist known as CoffeeVectors has managed to create an impressive stylized face animation that combines a multitude of AIs with a more traditional character art approach. To create the project, the artist utilized a Daz 3D character model turned into UE5's MetaHuman with the Mesh to MetaHuman plug-in, gave the model stylized looks with the help of Stable Diffusion's image-to-image tool, used Thin-Plate Spline Motion Model to animate the stylized version with the driving video from Unreal Engine 5, and utilized Topaz's Video Enhance AI and GFPGAN for upscaling.

And here's an in-depth breakdown shared by the creator:

You can check out more of CoffeeVectors' projects here. Also, don't forget to join our Reddit page and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more. 

Published 14 September 2022
Theodore McKenzie
Head of Content