A conversational assistant, easier avatar creation, and voice chat moderation.
Image credit: Roblox Corporation
Roblox is known for developing various solutions that could go much further than one game. This time, the company has shared some updates on the generative AI tools it has been working on.
Firstly, there is Roblox Assistant, which will help players create by taking simple, mundane tasks away from them, leaving players more time for "high-value activities, like narrative, game-play, and experience design."
The conversational AI was trained on a large set of public 3D models, so creators will be able to use natural language text prompts to make scenes, edit 3D models, and apply interactive behaviors to objects.
Roblox Assistant will help answer questions, improve code or explain its sections, and help debug and suggest fixes for code. It can also generate whole scenes based on text prompts.
In addition, the developers tried to make avatar creation easier, introducing a tool that can generate an avatar from an image or several images. Players with access to Roblox Studio will be able to upload a picture, have a skin made, and then modify it.
"To make this possible, we are training AI models on Roblox’s avatar schema and a set of Roblox-owned 3D avatar models. One approach leverages research for generating 3D stylized avatars from 2D images. We are also looking at using pre-trained text-to-image diffusion models to augment limited 3D training data with 2D generative techniques, and using a generative adversarial network (GAN)-based 3D generation network for training. Finally, we are working on using ControlNet to layer in predefined poses to guide the resulting multi-view images of the avatars. "
The tool is going to be out next year.
Finally, Roblox will see an AI moderator in the voice chat. The company has built its own voice-detection system that uses the standard voice-to-text Automatic Speech Recognition (ASR) and its data to train.
The AI can understand context along with Roblox-specific slang, abbreviations, and lingo and should work faster than pure ASR. Roblox is also experimenting with real-time user feedback through notifications to make sure appropriate consequences follow any violations. Overall, it sounds like an advanced system that analyzes not only what you say but also how you behave.
You may find these articles interesting