CryptoCMD CryptoCMD
AI Agents

Anthropic's Fable 5.2 tops freelance AI benchmark, still fails 58%

Fable 5.2 leads Scale's Remote Labor Index, yet more than half of its deliverables don't measure up to professional work.

Mia Chen

· 2 min read

Advertising disclosure: we may earn a commission when you join an operator via links on this page, at no cost to you. This never dictates our ratings. How we make money

Anthropic's Fable 5.2 tops freelance AI benchmark, still fails 58%
Image via CryptoSlate

Key takeaways

  • Fable 5.2 ranks first on Scale's Remote Labor Index.
  • The index grades complete deliverables against professional reference work.
  • The headline figure: the model fails 58% of the tasks.
  • Even the top model still falls short of human freelancers on most jobs.

Anthropic's Fable 5.2 now holds the top spot on Scale's Remote Labor Index, a benchmark for AI on freelance-style work. It still fails 58% of the tasks, per CryptoSlate's report.

What the index measures

This isn't a trivia quiz or a puzzle set. The Remote Labor Index takes a model's complete deliverable and compares it with reference work produced by professionals. That's a harder test, and a cleaner one. A finished product either holds up or it doesn't.

Leading isn't passing

Fable 5.2 ranks first. Yet a 58% failure rate means that on most tasks, its output wasn't good enough to sit beside the professional version. Best of a weak field? Not the same as ready to replace a freelancer.

The source material I have is thin, so I can't tell you how the other models scored or which task types tripped Fable up.

Why it matters

Crypto is crowded with projects pitching AI agents that supposedly do real work for you, and plenty of tokens ride on that story. This benchmark is a handy reality check. If the leading model misses on more than half of complete jobs, agents built on weaker models will likely do worse. So be sceptical of bold claims about autonomous AI labor, especially when a token's attached. Ask for results on full deliverables, not demos.

The better question is how fast that 58% shrinks.

Source: CryptoSlate

Top Crypto Casinos Right Now

🇺🇸 Showing sites that accept players from United States Change country

Advertising disclosure: we may earn a commission when you join an operator via links on this page, at no cost to you. This never dictates our ratings. How we make money

BetNow
8.0/10

125% crypto bonus (code PROMOBUCK2)

More info

Why we chose it: A US-facing book that pays a premium for crypto deposits: 125% against 100% for cash, with fee-free deposits across five coins.

Sports betting 24/7 live chat
Accepts BTC ETH BCH LTC USDT
Payout time
Within 24 hours (crypto)
KYC
Required

Restricted countries: Australia, Afghanistan, Bulgaria, Central African Republic, Congo - Brazzaville, Eritrea, France, Guinea-Bissau and 16 more.

BetNow Casino
7.9/10

200% casino bonus (code CASINO200)

More info

Why we chose it: BetNow's casino floor with the biggest match bonus we list. The 200% headline deserves a careful read of the code terms behind it.

24/7 live chat VIP program
Accepts BTC ETH BCH LTC USDT
Payout time
Within 24 hours (crypto)
KYC
Required

Restricted countries: Australia, Afghanistan, Bulgaria, Central African Republic, Congo - Brazzaville, Eritrea, France, Guinea-Bissau and 16 more.

The Online Casino
7.8/10

400% crypto welcome bonus up to $1,000 (code MAXOUT)

More info

Why we chose it: A US-oriented casino that turns away only New Jersey. The cashier takes crypto, but the site publishes fewer specifics than any operator we list.

24/7 live chat
KYC
Required

Restricted countries: New Jersey (US).

#Ai #Ai Agents #Anthropic #Benchmarks

Mia Chen

Mia digs into DeFi and on-chain data, translating protocol mechanics into plain English for everyday readers.

Related News