Google Teaches AI to Play Quake III Arena
Events
Subscribe:  iCal  |  Google Calendar
7, Mar — 1, Jun
Los Angeles US   23, Apr — 25, Apr
Breda NL   24, Apr — 25, Apr
Copenhagen DK   25, Apr — 8, May
Gyeonggi-do KR   25, Apr — 28, Apr
Latest comments

Hurry up and get it on the store - I need it for a project ;-)

by Krzysztof Czerwinski
16 hours ago

All characters look so artificial...all movements of characters are unnatural :( CG industry has traveled by so many years of 3D development in all possible ways and all characters in animations looks still like puppets:(

by James Brown
22 hours ago

Thank you for your post, I look for such article along time, today I find it finally. this post gives me lots of advise it is very useful for me. https://tanktroubleonline.com/

Google Teaches AI to Play Quake III Arena
5 July, 2018
News

Quake III Arena is 20 years old now, and developers are still trying to figure out how to teach AI to play the multiplayer first-person shooter the way a human can. A new post over on Google’s DeepMind blog discusses a way their team of researchers has been trying to teach AI agents to “act independently, yet learn to interact and cooperate with other agents” by making them play Quake III Arena.

The researchers are using redesigned Capture the Flag mode with the map layout changing from match to match. This way, AI agents master general strategies of play rather than use map-specific tricks.

ABSTRACT

Recent progress in artificial intelligence through reinforcement learning (RL) has shown great success on increasingly complex single-agent environments and two-player turn-based games. However, the real-world contains multiple agents, each learning and acting independently to cooperate and compete with other agents, and environments reflecting this degree of complexity remain an open challenge. In this work, we demonstrate for the first time that an agent can achieve human-level in a popular 3D multiplayer first-person video game, Quake III Arena Capture the Flag, using only pixels and game points as input. These results were achieved by a novel two-tier optimization process in which a population of independent RL agents is trained concurrently from thousands of parallel matches with agents playing in teams together and against each other on randomly generated environments. Each agent in the population learns its own internal reward signal to complement the sparse delayed reward from winning and selects actions using a novel temporally hierarchical representation that enables the agent to reason at multiple timescales. During game-play, these agents display human-like behaviors such as navigating, following, and defending based on a rich learned representation that is shown to encode high-level game knowledge. In an extensive tournament-style evaluation, the trained agents exceeded the win-rate of strong human players both as teammates and opponents and proved far stronger than existing state-of-the-art agents. These results demonstrate a significant jump in the capabilities of artificial agents, bringing us closer to the goal of human-level intelligence.

These Arena-trained AI are said to “see” only what a player would see (the raw pixels being displayed on the screen instead of a direct feed of game data).

Google states that the resulting “FTW” (“for the win”) AI agent can compete in multiplayer CTF matches at a very high level against other bots and human opponents. The report points out that after a 40-player tournament with both human and AI players, the humans rated the AI players as “more collaborative” than their human teammates.упуп

You can find more details in the full DeepMind blog post.

Source: deepmind.com

Leave a Reply

avatar