LogInIt also updated Omniverse Kit, Audio2Face, Machinima, and DeepSearch.
NVIDIA launched multiple Omniverse tools and services to "close the gap between the physical and virtual worlds."
One of the most interesting of them is Avatar Cloud Engine (ACE), a suite of cloud-native AI models and services that make it easier to build and customize lifelike virtual assistants and digital humans. ACE's assistants and avatars understand multiple languages, respond to speech prompts, interact with the environment, and make intelligent recommendations.
“Our industry has been on a decades-long journey teaching computers to communicate and carry out complex tasks with ease that humans take for granted,” said Rev Lebaredian, vice president of Omniverse and simulation technology at NVIDIA. “NVIDIA ACE brings this within reach. ACE combines many sophisticated AI technologies, allowing developers to create digital assistants that are on a path to pass the Turing test.”
ACE is built on top of NVIDIA’s Unified Compute Framework, which provides access to the software tools and APIs needed to make realistic, fully interactive avatars. These include NVIDIA Riva for developing speech AI applications, NVIDIA Metropolis for computer vision and intelligent video analytics, NVIDIA Merlin for high-performing recommender systems, NVIDIA NeMo Megatron for large language models with natural language understanding, and NVIDIA Omniverse for AI-enabled animation.
Two applications built on ACE include NVIDIA’s Project Maxine and Project Tokkio.
In addition to ACE, NVIDIA unveiled several Omniverse updates:
- Omniverse Kit – the toolkit for building native Omniverse extensions and applications got updates to PhysX, including real-time, multi-GPU, scalable soft body and particle cloth simulation. The update also brings new OmniLive workflows, bringing increased speed and performance to multiple app 3D workflows and enabling non-destructive USD workflows to make collaboration between artists and developers easier.
- Omniverse Audio2Face – the AI tool that can create facial animations from an audio file has a new ability to infer and generate realistic emotions and animates all facial features.
- Omniverse Machinima – the app for building 3D cinematics and animated films launches a lot of new, free 3D assets from Post Scriptum, Beyond the Wire, and Shadow Warrior 3 games, as well as a suite of new AI animation tools like Audio2Gesture, an AI that generates realistic arm and body motion from an audio file.
- Omniverse DeepSearch – the tool helps teams use AI to search through 3D asset databases of visuals using natural language and is now available for Omniverse Enterprise customers.
- NVIDIA Modulus – the physics machine-learning framework is available as an Omniverse Extension.
NVIDIA also unveiled 11 new Omniverse Connectors, USD-based plugins opening more Omniverse workflows. These bring the total number of Connectors to 112. Connectors for PTC Creo, Visual Components, and SideFX Houdini are available in beta. NVIDIA is working on Connectors for Blender, Autodesk Alias and Autodesk Civil 3D, Siemens JT, SimScale, Open Geospatial Consortium, and Unity.
NVIDIA also open sourced NVIDIA MDL, which provides a physically accurate representation of 3D materials, and revealed NeuralVDB, coming soon to beta, as "the next evolution of OpenVDB" that brings AI and GPU optimization to sparse volume datasets and reduces their memory footprint.
You can learn more about ACE and other Omniverse updates on NVIDIA's website. Also, don't forget to join our Reddit page and our Telegram channel, follow us on Instagram and Twitter, where we are sharing breakdowns, the latest news, awesome artworks, and more.
Keep reading
You may find these articles interesting