Frontier AI models fall for fake data in supervision tests
Controlled tests on Claude Code and Codex reportedly found failures when weaker models read the evidence on behalf of stronger supervisors.
Advertising disclosure: we may earn a commission when you join an operator via links on this page, at no cost to you. This never dictates our ratings. How we make money
Key takeaways
- Tests on Claude Code and Codex exposed a flaw in AI oversight setups.
- The failures showed up when weaker models read evidence for stronger supervisors.
- The reported result: fake data got through and was adopted.
- Only a short summary of the findings was available, so details like scale and error rates are unknown.
Frontier AI coding models can be fed bad data, and they'll run with it. That's the takeaway from controlled tests on Claude Code and Codex, reported by CryptoSlate on Nov. 18.
What the tests found
The failures showed up in one specific setup. A weaker model reads the evidence, then hands it up to a stronger model acting as supervisor. In the tests, that arrangement broke down. The fake data got adopted. Just like that.
That's all we've got. The source material is a short summary, so there are no error rates, no details on how the tests were designed, and nothing on how each tool performed. I'm not going to guess, and you shouldn't trust anyone who does.
Why it matters
Crypto is leaning hard on AI agents: trading bots, research tools, code assistants that write and audit smart contracts. Plenty of these pipelines use a cheap model to gather and summarize, then a stronger one to make the call. Fool the cheap layer and the smart layer inherits the mistake, then delivers it with total confidence.
If you're letting an agent anywhere near funds or contract review, the lesson is blunt. Don't assume the strong supervisor catches bad inputs. Check the source data yourself. So how many automated crypto workflows actually do that today?
Source: CryptoSlate
Top Crypto Casinos Right Now
🇦🇺 Showing sites that accept players from Australia Change country
Advertising disclosure: we may earn a commission when you join an operator via links on this page, at no cost to you. This never dictates our ratings. How we make money
More info Less info
Why we chose it: A US-oriented casino that turns away only New Jersey. The cashier takes crypto, but the site publishes fewer specifics than any operator we list.
- KYC
- Required
Restricted countries: New Jersey (US).
More info Less info
Why we chose it: One of the widest crypto line-ups of any book we list - seven coins with fast payouts - aimed squarely at Asia and Latin America rather than the US or Western Europe.
- Licence
- Curacao
Restricted countries: Austria, Belgium, Bulgaria, Cyprus, Czechia, Germany, Denmark, Estonia and 21 more.
More info Less info
Why we chose it: Built for American bettors, priced accordingly. Biggest welcome bonus of the five, attached to the heaviest rollover of the five.
- Online since
- 1994
- Licence
- Curaçao
- Payout time
- 24–48 hours (crypto)
- Wagering
- 18x sportsbook / 30x casino
- KYC
- Required
Restricted countries: Belgium, Costa Rica, Croatia, Curaçao, Aruba, Sint Maarten, Caribbean Netherlands, France and 11 more.
Sofia Marek
Sofia reviews exchanges and crypto casinos, focused on fees, safety and what actually reaches the player.