Generating Animations From Audio With NVIDIA’s Deep Learning Tech

Check out a tool in beta called Omniverse Audio2Face that lets you quickly generate new animations.

In case you missed the news, NVIDIA has a tool in beta that lets you quickly and easily generate expressive facial animation from just an audio source using the team's deep learning-based technology. The Audio2Face tool allows users to simplify the animation of 3D characters for a game, film, real-time digital assistants, and other projects. The toolkit lets you run the results live or bake them out.

NVIDIA's latest tech comes with “Digital Mark” – a 3D character model that can be animated with your audio track. The process is straightforward: you just select your audio and upload it – the tool deals with the rest. A pre-trained Deep Neural Network drives the 3D vertices of your character mesh to create the facial animation in real-time. The toolkit also allows you to edit various post-processing parameters to edit the performance of your character.

Audio2Face is said to process any language easily and the team is continually updating it with more and more languages. The tool can also be used to animate stylized characters or humanoid aliens, for example.

Learn more and get started here. Also, don't forget to join our new Reddit page, our new Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.

You might also like

1
2
3
4
5

A Week After "Basically Announcing" Minecraft 2, Notch Basically Cancels It

Instead, he and his team will focus on the previously-announced retro-style roguelike.

+2

Rumor: Possible Release Date for Grand Theft Auto 6 Revealed

A video game store from Uruguay appears to have disclosed the launch date for the gaming industry's most anticipated title.

+2

Breaking: Unity Suddenly Lays Off Numerous Developers With a 5 AM Email

Apparently, the entire Unity Behavior team was cut, alongside many other employees.

+4

800+ Hard Surface Custom shapes (300+ Cheatbrushes)
by Mels Mneyan
Error
(2000-0001)
Hardsurface Height/Alpha Vol.2
by Jonas Ronnegard
The second volume of Hard surface alphas originally sold as a set of 350 alphas but currently includes 390 alphas + 6 trim brushes.
Error
(2000-0001)

Generating Animations From Audio With NVIDIA’s Deep Learning Tech

Join discussion

Comments 0

You might also like

A Week After "Basically Announcing" Minecraft 2, Notch Basically Cancels It

Rumor: Possible Release Date for Grand Theft Auto 6 Revealed

Breaking: Unity Suddenly Lays Off Numerous Developers With a 5 AM Email

We need your consent