Unity Goes All-In on Generative AI, Introducing a Bunch of AI Features in 6.2 Update

Keeping their earlier promise to add more AI-powered features to the engine, Unity Technologies has officially released Unity 6.2, the latest version of their flagship game creation software, filled to the brim with features powered by the generative artificial intelligence technology.

Extensive and lengthy at first glance, the list of genAI tools in Unity 6.2, named Unity AI by the developer, can be boiled down to three main items, the first of which is Assistant. Powered by LLMs, Assistant replaces Unity Muse and essentially acts as a built-in ChatGPT that can answer questions, generate code, batch rename assets, or place objects in a scene. The ChatGPT comparison isn't just for flair though, as according to Unity, Assistant runs on GPT models via Azure OpenAI Services alongside Meta's Llama models.

The second item on the menu is Generators, a set of AI tools for generating assets, images, textures, animations, and sound. Unlike Assistant, these rely on both third-party models – such as those from Scenario, Inc. and Layer AI, which are trained on Stable Diffusion, FLUX, Bria, and GPT-Image foundation models – and Unity's own first-party AIs.

When it comes to those third-party models, Unity notes that while "Partner Model providers" do not train their models with your developer data, Unity does send them your anonymized data, including prompts, reference assets, and more, "for the sole purpose of running the services." It's also worth pointing out that some models block prompts with a likelihood of generating IP/copyright-infringing content, producing either a null response, a blank image, or a message requiring you to modify your prompt.

Lastly, there's a new Inference Engine, which replaces Sentis and lets you run AI models locally in the Unity Editor or on end-user devices during Unity runtime. According to the devs, Inference Engine doesn't come with built-in models but allows you to import your own pre-trained models or ones obtained from model repositories like Hugging Face.

Naturally, the Unity AI toolset comes with its own set of settings, the most important being the ON/OFF toggle for Unity AI itself, which lets you disable Assistant and Generators and is ON by default, and "Improve Unity AI", which allows Unity to use your developer data – including prompts, responses, interactions, code, and other content – to improve Unity AI models for all developers, toggled OFF by default.

As expected, when it comes to generative AI, questions of copyright infringement and data theft arise immediately, but it seems Unity has accounted for this by shifting the responsibility to the user:

"Unity users are ultimately responsible for ensuring that their use of Unity AI complies with our acceptable use principles," state the Unity AI Guiding Principles. "Importantly, you are responsible for ensuring your use of Unity AI and any generated assets do not infringe on third-party rights and are appropriate for your use. As with any asset used in a Unity project, it remains your responsibility to ensure you have the rights to use content in your final build."

You can find the full list of Unity 6.2's changes by clicking this link. Don't forget to join our 80 Level Talent platform and our Discord server. Follow us on Instagram, Twitter, LinkedIn, Telegram, TikTok, and Threads for breakdowns, the latest news, awesome artworks, and more.