CryptoCMD CryptoCMD
AI Agents

Frontier AI models fall for fake data in supervision tests

Controlled tests on Claude Code and Codex reportedly found failures when weaker models read the evidence on behalf of stronger supervisors.

Sofia Marek

· 2 min read

Advertising disclosure: we may earn a commission when you join an operator via links on this page, at no cost to you. This never dictates our ratings. How we make money

Frontier AI models fall for fake data in supervision tests
Image via CryptoSlate

Key takeaways

  • Tests on Claude Code and Codex exposed a flaw in AI oversight setups.
  • The failures showed up when weaker models read evidence for stronger supervisors.
  • The reported result: fake data got through and was adopted.
  • Only a short summary of the findings was available, so details like scale and error rates are unknown.

Frontier AI coding models can be fed bad data, and they'll run with it. That's the takeaway from controlled tests on Claude Code and Codex, reported by CryptoSlate on Nov. 18.

What the tests found

The failures showed up in one specific setup. A weaker model reads the evidence, then hands it up to a stronger model acting as supervisor. In the tests, that arrangement broke down. The fake data got adopted. Just like that.

That's all we've got. The source material is a short summary, so there are no error rates, no details on how the tests were designed, and nothing on how each tool performed. I'm not going to guess, and you shouldn't trust anyone who does.

Why it matters

Crypto is leaning hard on AI agents: trading bots, research tools, code assistants that write and audit smart contracts. Plenty of these pipelines use a cheap model to gather and summarize, then a stronger one to make the call. Fool the cheap layer and the smart layer inherits the mistake, then delivers it with total confidence.

If you're letting an agent anywhere near funds or contract review, the lesson is blunt. Don't assume the strong supervisor catches bad inputs. Check the source data yourself. So how many automated crypto workflows actually do that today?

Source: CryptoSlate

Top Crypto Casinos Right Now

🇦🇺 Showing sites that accept players from Australia Change country

Advertising disclosure: we may earn a commission when you join an operator via links on this page, at no cost to you. This never dictates our ratings. How we make money

The Online Casino
7.8/10

400% crypto welcome bonus up to $1,000 (code MAXOUT)

More info

Why we chose it: A US-oriented casino that turns away only New Jersey. The cashier takes crypto, but the site publishes fewer specifics than any operator we list.

24/7 live chat
KYC
Required

Restricted countries: New Jersey (US).

Mostbet
8.0/10

125% welcome bonus on first deposit

More info

Why we chose it: One of the widest crypto line-ups of any book we list - seven coins with fast payouts - aimed squarely at Asia and Latin America rather than the US or Western Europe.

Sports betting 24/7 live chat
Accepts BTC ETH USDT LTC DOGE BNB XRP
Licence
Curacao

Restricted countries: Austria, Belgium, Bulgaria, Cyprus, Czechia, Germany, Denmark, Estonia and 21 more.

BetUS
7.6/10

100% Welcome Bonus up to 5BTC

More info

Why we chose it: Built for American bettors, priced accordingly. Biggest welcome bonus of the five, attached to the heaviest rollover of the five.

Sports betting Live casino Rakeback / cashback VIP program Mobile app 24/7 live chat
Accepts BTC BCH ETH LTC
Online since
1994
Licence
Curaçao
Payout time
24–48 hours (crypto)
Wagering
18x sportsbook / 30x casino
KYC
Required

Restricted countries: Belgium, Costa Rica, Croatia, Curaçao, Aruba, Sint Maarten, Caribbean Netherlands, France and 11 more.

#Ai #Security #Ai Agents #Claude Code #Codex

Sofia Marek

Sofia reviews exchanges and crypto casinos, focused on fees, safety and what actually reaches the player.

Related News