Immersion at its fullest.
After all these years, Skyrim keeps getting better with its faithful players' help. Creator Art from the Machine has integrated ChatGPT into Skyrim VR to make it possible to have natural conversations with NPCs.
With the latest update, the modder introduced lip-syncing and characters' awareness of in-game events using xVASynth (text-to-speech) and Whisper (speech-to-text) to help OpenAI's chatbot.
NPCs are now aware of their current location and time of day as well as the items picked up by the player during the conversation. In the video above, you can see what the shopkeeper thinks about the sword the player has taken.
"When everything is in place, it is an incredibly surreal experience to be able to sit down and talk to these characters in VR," said Art from the Machine. "Nothing takes me out of the experience more than hearing the same repeated voice lines, and with this no two responses are ever the same. There is still a lot of work to go, but even in its current state I couldn't go back to playing without this."
The creator shared that the idea was inspired by Lee Vermeulen's video on scripting AI tests in Modbox using GPT-3 and Replica:
Overall, the mod looks (and sounds) delightful although there are still things to improve. If you'd like to follow Art from the Machine's efforts, check out their Reddit page.
Also, don't forget to join our 80 Level Talent platform and our Telegram channel, follow us on Instagram and Twitter, where we share breakdowns, the latest news, awesome artworks, and more.
Keep reading
You may find these articles interesting