Claude, Microsoft Copilot Fail Again to Predict the Winners of the Kentucky Derby (yahoo.com) 17
In 2016 an online "swarm intelligence" platform generated a correct prediction for the Kentucky Derby — naming all four top finishers in order. (But its 2017 predictions weren't even close.) Slashdot checked in again on how modern AI systems performed in 2023, 2024, and 2025 — but their predictions were still pretty bad. Would AI-generated Derby predictions be any better in 2026?
This year's winner was 24-to-1 longshot "Golden Tempo" — though a lot of oddsmakers had favored a horse named Further Ado (which ultimately only finished 11th). So when USA Today prompted Microsoft Copilot for its own picks for the Kentucky Derby, Copilot also went with Further Ado. (Even worse, it predicted Golden Tempo would come in... 13th.)
Here's how Copilot's picks actually performed...
This year's winner was 24-to-1 longshot "Golden Tempo" — though a lot of oddsmakers had favored a horse named Further Ado (which ultimately only finished 11th). So when USA Today prompted Microsoft Copilot for its own picks for the Kentucky Derby, Copilot also went with Further Ado. (Even worse, it predicted Golden Tempo would come in... 13th.)
Here's how Copilot's picks actually performed...
- Further Ado (finished 11th)
- Chief Wallabee (finished 4th)
- The Puma (SCRATCHED)
- Renegade (finished 2nd)
- Commandment (finished 7th)
- So Happy (finished 9th)
- Emerging Market (finished 10th)
- Danon Bourbon (finished 5th)
- Potente (finished 12th)
- Incredibolt (finished 6th)
- Robusta (finished 14th)
- Ocelli (finished 3rd)
- Golden Tempo (finished 1st)
- Pavlovian (finished 18th)
- Great White (SCRATCHED)
- Wonder Dean (finished 8th)
- Litmus Test (finished 17th)
- Albus (finished 15th)
- Six Speed (finished 13th)
- Intrepido (finished 16th)
Copilot was told to use the latest odds, conditions, and analysis of favorites, best bets, expert picks, previous results and race history with the post positions, according to USA Today.
And meanwhile, Yahoo Sports asked Claude "to simulate the race using the opening odds, draw and potential track conditions. We also asked it to factor in some human predictions."
Like Microsoft Copilot, Claude also picked Further Ado to finish first (though it came in 11th) — and predicted that Golden Tempo (the eventual first-place finisher) would finish 12th.
- Further Ado (finished 11th)
- The Puma (SCRATCHED)
- Commandment (finished 7th)
- Chief Wallabee (finished 4th)
- Renegade (finished 2nd)
- Emerging Market (finished 10th)
- So Happy (finished 9th)
- Incredibolt (finished 6th)
- Danon Bourbon (finished 5th)
- Potente (finished 12th)
- Pavlovian (finished 18th)
- Golden Tempo (finished 1st)
- Litmus Test (finished 17th)
- Albus (finished 15th)
- Wonder Dean (finished 8th)
- Six Speed (finished 13th)
- Intrepido (finished 16th)
Just lucky? (Score:2)
I'm curious how the 2016 platform managed to get it so right but everything since then has failed. Would be amusing if models are actually getting worse as they are hyped more in business.
Re: (Score:3)
Re: (Score:2)
You're looking at this the wrong way, the 2017 - and subsequent - platform(s) got it right, but the Las Vegas bookmakers either bribed the predicted top 4 jockeys to slow up a bit or they manipulated the top 4 predictions in the first place. Let's hear it for conspiracy theories!
Oh really?! (Score:2)
It's almost as if you cannot predict the future with absolute certainty and sometimes you cannot predict it at all with any certainty.
Win rate and probability is something well researched and all the bookies already know you can use tea leaves, astrology, advanced statistical models, AI, ninjitsu the house always wins in the long run.
At best the AI models can come up with the same probability distribution as the bookies. Perhaps the
Re: (Score:2)
24-1 Longshot wins? (Score:2)
If the AI got it right, I would say the fix is in.
How does AI do predicting lottery numbers? (Score:3)
Re: (Score:2)
People who bet on sports, roulette, whatever, for purposes other than pure entertainment have to believe that predicting the outcome is a matter of skill. If it is a matter of skill then a really good model should at least have the potential to do it well.
Re: (Score:2)
Re: (Score:2)
People building systems that at least can predict a bit feed them with a lot more specific data than general purpose AIs have. Claude is as good as average joe in making a guess and may be lucky or not.
Re: (Score:2)
Yes we do. Where we equals investors who spent billions on dubious AI companies who deliberately mislead said investors about the true capabilities to get their money.
Yes we do. Where yes implies there is an economic crash coming and we implies that it will affect you too, even if you didn't technically believe it.
There is a reason liars should ordinarily be punished. When they are not, bad things happen.
This kind of story is just a symptom about the sheer magnitude of the lies.
Asking the House. (Score:2)
Asking AI about the outcome is like asking The House for advice.
(The House) ”The hell do you think my job is? I’m not here to advise a winner. I’m here to addict a loser. I already know who’s ultimately going to win. By design.”