AI models agreed with each other more than with reality
A new test from Science Prediction Universe found that pooling AI rankings improved average results, but shared scientific errors survived the crowd.
Advertising disclosure: we may earn a commission when you join an operator via links on this page, at no cost to you. This never dictates our ratings. How we make money
Key takeaways
- Science Prediction Universe tested AI models on scientific prediction.
- Pooling the models' rankings improved average results.
- Errors the models shared didn't go away when their answers were combined.
- Agreement between models isn't proof that an answer is correct.
Stacking AI models helps. Only so far. A new test from Science Prediction Universe found that pooling the models' rankings improved average results, but the scientific errors they shared made it through untouched.
What the test found
Start with the good news. Group the rankings together and the average gets better. That's the standard crowd effect, and it showed up here right on cue.
Now the catch. When several models made the same mistake, pooling didn't scrub it out. The models agreed with each other more than they agreed with reality. Awkward.
The source material is thin. It doesn't say which models were tested, how many, or how big the gains were. Treat the details as unconfirmed until the full study lands.
Why it matters
Crypto leans harder on AI every month: research summaries, trading signals, autonomous agents that act on their own conclusions. The popular fix for flaky output is to ask several models and take the consensus. This test says that fix has a ceiling.
If models learn from similar data, they can be wrong in the same direction. Consensus then looks like confirmation when it's really correlated error. If you hold, trade or build on AI-generated analysis, that's your risk. Agreement feels like safety. It may not be.
So check AI claims against real data, not just against another AI. And ask yourself how much independence you're really getting when most of these models learned from the same internet.
Source: CryptoSlate
Top Crypto Casinos Right Now
🇨🇦 Showing sites that accept players from Canada Change country
Advertising disclosure: we may earn a commission when you join an operator via links on this page, at no cost to you. This never dictates our ratings. How we make money
More info Less info
Why we chose it: A US-facing book that pays a premium for crypto deposits: 125% against 100% for cash, with fee-free deposits across five coins.
- Payout time
- Within 24 hours (crypto)
- KYC
- Required
Restricted countries: Australia, Afghanistan, Bulgaria, Central African Republic, Congo - Brazzaville, Eritrea, France, Guinea-Bissau and 16 more.
More info Less info
Why we chose it: Phemex is a derivatives-first venue for Europe, Asia and Latin America. Good engine, mid-size liquidity, and a blocklist that grew in 2025.
- Online since
- 2019
- Licence
- Seychelles
- KYC
- Required
Restricted countries: United Arab Emirates, Afghanistan, Australia, Belgium, Bermuda, Belarus, Ontario (Canada), China and 18 more.
More info Less info
Why we chose it: BetNow's casino floor with the biggest match bonus we list. The 200% headline deserves a careful read of the code terms behind it.
- Payout time
- Within 24 hours (crypto)
- KYC
- Required
Restricted countries: Australia, Afghanistan, Bulgaria, Central African Republic, Congo - Brazzaville, Eritrea, France, Guinea-Bissau and 16 more.
Alex Rivera
Alex covers crypto markets and trading, testing every platform hands-on before writing about it.
Related News
Maternal AI chatbot 'Rosie' fails to beat a kids' book program
Nonprofits sue OpenAI, Anthropic, Google to freeze AI development
ACE Music v1 Tops AI Music Rankings, Edging Out Suno in Decrypt Test