Stylized Face Animation Made With MetaHuman & Stable Diffusion

The AI-generated face was animated using Thin-Plate Spline Motion Model and GFPGAN.

Digital Artist known as CoffeeVectors has managed to create an impressive stylized face animation that combines a multitude of AIs with a more traditional character art approach. To create the project, the artist utilized a Daz 3D character model turned into UE5's MetaHuman with the Mesh to MetaHuman plug-in, gave the model stylized looks with the help of Stable Diffusion's image-to-image tool, used Thin-Plate Spline Motion Model to animate the stylized version with the driving video from Unreal Engine 5, and utilized Topaz's Video Enhance AI and GFPGAN for upscaling.

And here's an in-depth breakdown shared by the creator:

You can check out more of CoffeeVectors' projects here. Also, don't forget to join our Reddit page and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more. 

Join discussion

Comments 1

  • Anonymous user

    The end result still looks like Live2D somehow.

    0

    Anonymous user

    ·a year ago·

You might also like

We need your consent

We use cookies on this website to make your browsing experience better. By using the site you agree to our use of cookies.Learn more