OpenAI is revealing more information about its bot system after its win streak in the game Dota 2 last Friday, and it’s another step forward in the world of artificial intelligence.
The graph below was released this morning by OpenAI, which depicts the rate at which the bot improved in playing Dota 2.
(Source: OpenAI)
“Our Dota 2 result shows that self-play can catapult the performance of machine learning systems from far below human level to superhuman, given sufficient compute,” OpenAI wrote in a post. “In the span of a month, our system went from barely matching a high-ranked player to beating the top pros and has continued to improve since then. Supervised deep learning systems can only be as good as their training datasets, but in self-play systems, the available data improves automatically as the agent gets better.”
OpenAI’s Dota 2 project started in March of this year, starting the bot off with simple tasks.
For background, Dota 2 is a free multiplayer battlefield game on Steam, a gaming streaming site. The game prides itself on not imposing limits on its players.
The bot went on an impressive winning streak starting on August 7, beating a notable Dota 2 player named Blitz. That same day, the bot beat two more high-ranking players. The following day, the bot beat Arteezy, another respected player in the game. All four of the players the bot defeated said that fellow player SumaiL could defeat the bot.
SumaiL did not fare as well as his comrades thought he would.
Finally, the bot took on Dota 2’s former world champion, Dendi. The bot beat Dendi 2-0.
As for how the bot learned to play the came, OpenAI had the following explanation, “The bot learned the game from scratch by self-play, and does not use imitation learning or tree search. This is a step towards building AI systems which accomplish well-defined goals in messy, complicated situations involving real humans.”
Some of the skills that the bot picked up were the ability to predict where players will move, to improvise in response to new situations, and how to influence the other players.
In between battles, OpenAI workers combined some “coaching” with self-play, which helped the bot continuously improve.
OpenAI is a non-profit AI research company, founded by Tesla CEO Elon Musk, that researches safe artificial intelligence.
The Musk company has previously trained bots to successfully compete a task after watching it on virtual reality just once, and developed bots that created their own language.
Musk’s involvement in AI should come as no surprise as he has reiterated time and time again how important, and potentially dangerous, AI can be.
“I have exposure to the most cutting edge AI and I think people should be really concerned about it,” Musk has previously said. “I keep sounding the alarm bell, but until people see robots going down the street killing people, they don’t know how to react because it seems so theorial.”
Aside from OpenAI, Musk is also the CEO of Neuralink, a brain-computer interface company.
The developments of the bot in these varied complex scenarios is a fairly large step forward in discovering the power of artificial intelligence. With limited input form the OpenAI engineers, the bot went from a decent player to being essentially unstoppable. This holds a promising future for further AI developments, if they can be contained.
