This Minecraft Player Built Functional ChatGPT-Style AI Model Inside The Game

Minecraft enthusiast Sammyuri, known for previously creating a playable, though simplified version of Minecraft within the game itself, has now pushed redstone engineering even further. Sammyuri returned with CraftGPT, a small language model built inside Minecraft, sparking huge excitement among players.

According to its creator, the model has 5,087,280 parameters, trained in Python on the TinyChat dataset of basic English conversations. It has an embedding dimension of 240, a vocabulary of 1920 tokens, and consists of 6 layers. The context window size is 64 tokens, which is enough for (very) short conversations.

CraftGPT is clearly not a competitor to chatbot platforms, but it stands out as an impressive achievement. The build occupies a volume of 1020x260x1656 blocks. Due to its immense size, the Distant Horizons mod was used to capture footage of the whole build, however, this results in distant redstone components looking strange as they are being rendered at a lower level of detail. CraftGPT can generate a response in approximately 2 hours when the tick rate is boosted to about 40,000 times normal speed using MCHPRS (Minecraft High Performance Redstone Server).

Before running CraftGPT, Sammyuri advises keeping expectations low. The model is very prone to going off topic, generating grammatically incorrect replies, or sometimes producing nonsensical output. You can get CraftGPT on GitHub.

Join our 80 Level Talent platform and our new Discord server, follow us on Instagram, Twitter, LinkedIn, Telegram, TikTok, and Threads, where we share breakdowns, the latest news, awesome artworks, and more.