Why did AI researchers turn to StarCraft and Dota 2 after conquering chess and Go?

Chess is hard. But real-time strategy games with fog of war and thousands of possible actions per second? That's a whole different beast.

The answer

After mastering perfect-information board games, AI researchers tackled real-time strategy games that feature imperfect information, long-term planning, real-time decision-making, and enormous action spaces. In August 2017, OpenAI's bot defeated top professional Dota 2 players in 1v1 matches, and by April 2019, OpenAI Five beat the reigning Dota 2 world champions OG in a full 5v5 game after training for the equivalent of 45,000 years of gameplay. Meanwhile, DeepMind's AlphaStar reached Grandmaster level in StarCraft II in October 2019, placing in the top 0.2% of all human players on the European ladder. These achievements required breakthroughs in multi-agent coordination, long-horizon planning, and operating under uncertainty - skills far more relevant to real-world AI challenges.

Source: Nature (Vinyals et al., 2019)

More from AI & Machine Learning

All AI & Machine Learning →