AI Has Finally Learned To Play Stratego (arstechnica.com) 40
Researchers from Carnegie Mellon, MIT, NYU, and Stanford have built an AI called Ataraxos that finally cracked Stratego, beating four-time world champion Pim Niemeijer 15 games to one with four draws. Its key advantage was a second neural network that estimates the identities of hidden enemy pieces, letting the system search plausible game states rather than brute-force a massive hidden-information space. Ars Technica reports: Just like [DeepMind's DeepNash, introduced in 2022], Ataraxos learned by playing against itself -- 163 million games in total. In these self-play sessions, moves that led to wins were reinforced and played more often in future matches, while moves that led to losses were played less, which was the same simple training idea. The difference was in how much Ataraxos adjusted after each game, because hidden information tends to send self-play learning algorithms around in circles. The team addressed this by making big, bold changes in strategy early in training and small, careful ones later.
The even bigger innovation was something DeepNash never had: thinking ahead before each move. AIs like AlphaGo refine their general strategy with a search just before acting. DeepMind couldn't make that work in Stratego because the search space was too large, leaving it an open question whether it was worth trying. "This is one of the things that we did figure out how to do," Farina said. The solution was a second neural network, a belief model, trained to guess the opponent's hidden pieces based on how they had been moving. This way, instead of iterating through every possible arrangement, Ataraxos samples plausible ones, plays out candidate moves in each, and picks based on how they turned out. And it shows in its playstyle.
[...] DeepNash was trained for two to three months on 1,024 of Google's specialized chips, a run the Ataraxos team estimates would cost $3 million to $4.5 million at 2025 prices. Ataraxos, in contrast, needed 16 GPUs for a week, plus an additional four GPUs for four days to train the belief model. Farina and lead author Samuel Sokota achieved this efficiency by writing a simulator that runs millions of moves per second on graphics cards. "At the scale that we are in academia, we don't really have access to an entire field of GPUs," Farina said. The algorithm also learned far faster -- it played about 34 times fewer games than DeepNash, and still ended up much stronger. The findings have been published in the journal Nature.
The even bigger innovation was something DeepNash never had: thinking ahead before each move. AIs like AlphaGo refine their general strategy with a search just before acting. DeepMind couldn't make that work in Stratego because the search space was too large, leaving it an open question whether it was worth trying. "This is one of the things that we did figure out how to do," Farina said. The solution was a second neural network, a belief model, trained to guess the opponent's hidden pieces based on how they had been moving. This way, instead of iterating through every possible arrangement, Ataraxos samples plausible ones, plays out candidate moves in each, and picks based on how they turned out. And it shows in its playstyle.
[...] DeepNash was trained for two to three months on 1,024 of Google's specialized chips, a run the Ataraxos team estimates would cost $3 million to $4.5 million at 2025 prices. Ataraxos, in contrast, needed 16 GPUs for a week, plus an additional four GPUs for four days to train the belief model. Farina and lead author Samuel Sokota achieved this efficiency by writing a simulator that runs millions of moves per second on graphics cards. "At the scale that we are in academia, we don't really have access to an entire field of GPUs," Farina said. The algorithm also learned far faster -- it played about 34 times fewer games than DeepNash, and still ended up much stronger. The findings have been published in the journal Nature.
Fascinating... (Score:3)
Re: (Score:3)
Same here. And I probably expended a lot less energy learning how to play it than AI did. But I was certainly not world champion level. I might be able to beat my cousin once in a while...
Re: (Score:3)
I own a Stratego board and play it regularly with my son. We also play it with close family from time to time. It's one of my favorite games. It allows for the right balance of strategy, skill, and adaptation, with just the right amount of luck mixed in. Additionally, even as one may be on the verge of losing, there still exist opportunities to win the game. And because arrangement of pieces can be different every game, and because your pieces are largely unknown to the other player until an attack is
Re: (Score:2)
Re: (Score:2)
Back in my day, it was popular with boys about 9 and up. But it was a bit of a niche game - it had its die-hard fans, and a whole lot of people who never played it.
Re: (Score:2)
Re: (Score:2)
Germany comes to mind.
But probably not on a much higher level than Go.
I did play Stratego since ages.
Re: (Score:1)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Agreed. An AI developed specifically to play a particular obscure game (even if a very complicated one) seems both highly limited and dubiously useful.
There are many esoteric "games" that are highly useful for specific arenas. Stratego itself may not be that practical, but the ability to train an AI to master an arbitrary game is extremely useful.
Re: (Score:2)
Just to make sure, the AC is joking on that all of those are famous French games that might be obscure elsewhere. "Coup fourré" is one of the moves in Mille Bornes.
Re: (Score:2)
It seems like the approach they used in training this AI could be ported to other games, possibly even to real-world problems. This I believe is one of the situations where AI technology could actually be useful, a specialised domain with a limited number of parameters. Not an AI trained to put words together with zero understanding of what any of them mean.
"Diplomacy"? (Score:2)
For the ones that don't know it - it's a bit like "Risk", but there is no luck anywhere involved. Between each turn, all the players engage in e.g. 15 minutes of "Diplomacy" and literally anything is allowed (except moving the pieces). You can negotiate alliances, bribe and blackmail people, whatever. Many friendships have been lost to this game, because sooner or later you will have to backstab allies and betray friends.
It's g
Re: (Score:2)
Headline and article disagree (Score:2)
Re: (Score:2)
the unauthorized version of Pluto was additionally modified to use a maphack...During some games, Pluto reached several thousand actions per minute... the bot used its micro to surround and neutralize Mutalisks... the bot simultaneously fought in multiple areas of the map, precisely micro-managed its units
So yeah, that kind of clicking (and maybe perfect information, or maybe not) gives the computer a massive advantage, it doesn't even need a neural network to win.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Most players use the keyboard. And perfect click is far less relevant than perfect strategy.
Re: (Score:2)
Re: (Score:2)
To click where the troops should go, for everything else you use the keyboard.
Re: (Score:2)
So did Joshua/WOPR and that was over 40 years ago. Stephen Falken was a fucking visionary and a genius!
They tried teaching it Risk (Score:3)
ukraine weak is really tripping it up (Score:2)
ukraine weak is really tripping it up
WOPR: Shall we play a game? (Score:2)
Nope!
+++ATH0
I don't get the hype (Score:2)
does anyone not think computers will always beat humans at any game so long as that game is a matter of computation - as long as you can write a good program for the computer. Generative ai is just that last bit.
What people seem to have forgotten is that few games were made to be simply a contest of who can compute best, mostly they're about spending time with friends and making memories. Did the people who played stratego with the AI have as much fun as they did when they were 9 years old on a snow day lay
Re: I don't get the hype (Score:2)
As a child I wrote a BASIC program that can always tie at tic-tac-toe. Not every situation is winnable.
Playing vs. Reading..? (Score:2)
Perhaps after 165 million games played there is little substitute for the real thing. But given how AI (and humans) often learn a game to the level of building strategy, is there a reason these AIs weren’t merely trained by first reading every Stratego strategy book?
I’ve not heard of a single Grandmaster that has ever reached that level by simply playing the game of chess. They read about it. A lot.
Finally! (Score:2)
So now it can learn to kill us all more 'strategically'. :-)
Learns? (Score:2)
The solution was a second neural network, a belief model, trained to guess the opponent's hidden pieces based on how they had been moving.
Half learning, half having the logic augmented. That's a remodel.
I wonder how many Slashdot accounts AI has (Score:2)