CryptoCMD CryptoCMD
AI Agents

Frontier AI models fall for fake data in supervision tests

Controlled tests on Claude Code and Codex reportedly found failures when weaker models read the evidence on behalf of stronger supervisors.

Sofia Marek

· 2 min read

Advertising disclosure: we may earn a commission when you join an operator via links on this page, at no cost to you. This never dictates our ratings. How we make money

Frontier AI models fall for fake data in supervision tests
Image via CryptoSlate

Key takeaways

  • Tests on Claude Code and Codex exposed a flaw in AI oversight setups.
  • The failures showed up when weaker models read evidence for stronger supervisors.
  • The reported result: fake data got through and was adopted.
  • Only a short summary of the findings was available, so details like scale and error rates are unknown.

Frontier AI coding models can be fed bad data, and they'll run with it. That's the takeaway from controlled tests on Claude Code and Codex, reported by CryptoSlate on Nov. 18.

What the tests found

The failures showed up in one specific setup. A weaker model reads the evidence, then hands it up to a stronger model acting as supervisor. In the tests, that arrangement broke down. The fake data got adopted. Just like that.

That's all we've got. The source material is a short summary, so there are no error rates, no details on how the tests were designed, and nothing on how each tool performed. I'm not going to guess, and you shouldn't trust anyone who does.

Why it matters

Crypto is leaning hard on AI agents: trading bots, research tools, code assistants that write and audit smart contracts. Plenty of these pipelines use a cheap model to gather and summarize, then a stronger one to make the call. Fool the cheap layer and the smart layer inherits the mistake, then delivers it with total confidence.

If you're letting an agent anywhere near funds or contract review, the lesson is blunt. Don't assume the strong supervisor catches bad inputs. Check the source data yourself. So how many automated crypto workflows actually do that today?

Source: CryptoSlate

Top Crypto Casinos Right Now

🇩🇪 Showing sites that accept players from Germany Change country

Advertising disclosure: we may earn a commission when you join an operator via links on this page, at no cost to you. This never dictates our ratings. How we make money

BetNow
8.0/10

125% crypto bonus (code PROMOBUCK2)

More info

Why we chose it: A US-facing book that pays a premium for crypto deposits: 125% against 100% for cash, with fee-free deposits across five coins.

Sports betting 24/7 live chat
Accepts BTC ETH BCH LTC USDT
Payout time
Within 24 hours (crypto)
KYC
Required

Restricted countries: Australia, Afghanistan, Bulgaria, Central African Republic, Congo - Brazzaville, Eritrea, France, Guinea-Bissau and 16 more.

Phemex
8.0/10

Up to 8,800 USDT welcome bonus

More info

Why we chose it: Phemex is a derivatives-first venue for Europe, Asia and Latin America. Good engine, mid-size liquidity, and a blocklist that grew in 2025.

Mobile app 24/7 live chat VIP program
Accepts BTC ETH USDT USDC SOL XRP DOGE TON ADA LTC
Online since
2019
Licence
Seychelles
KYC
Required

Restricted countries: United Arab Emirates, Afghanistan, Australia, Belgium, Bermuda, Belarus, Ontario (Canada), China and 18 more.

BetNow Casino
7.9/10

200% casino bonus (code CASINO200)

More info

Why we chose it: BetNow's casino floor with the biggest match bonus we list. The 200% headline deserves a careful read of the code terms behind it.

24/7 live chat VIP program
Accepts BTC ETH BCH LTC USDT
Payout time
Within 24 hours (crypto)
KYC
Required

Restricted countries: Australia, Afghanistan, Bulgaria, Central African Republic, Congo - Brazzaville, Eritrea, France, Guinea-Bissau and 16 more.

#Ai #Security #Ai Agents #Claude Code #Codex

Sofia Marek

Sofia reviews exchanges and crypto casinos, focused on fees, safety and what actually reaches the player.

Related News