AI explained. Tools tested. Ideas worth trying.By Sam Taylor & Samwise ↗

Anthropic cut model copying by 90%. The cost is on builders.

Jump to a section
See the story at a glance
10–100×
fewer reasoning tokens extracted
by distillers · post-classifier

Here's what distillation actually looks like in practice.

Moonshot AI's Kimi models were secretly forwarding user requests to Claude. One of those requests, per Anthropic's October 12 account, came from someone Anthropic believes was affiliated with China's People's Liberation Army — the request was to analyze CCTV surveillance footage of a specific individual. Moonshot wasn't building a consumer chat product. They were building it with Claude as the invisible engine, relaying queries without authorization.

That's not a copyright dispute. That's AI capabilities — capabilities that took Anthropic billions of dollars and years of safety research to build — showing up in what may have been foreign military surveillance infrastructure.

Anthropic published their most detailed public accounting of this fight on October 12. The headline: new defenses reduced the reasoning tokens distillers can extract from their frontier models by a factor of 10 to 100. Some days, the extraction rate fell below the detection limit. But the defense came with trade-offs, and builders need to know exactly what changed.

Source spread

What's real

  • The reasoning transcript is the prize. Anthropic measured this directly. A model trained on Claude Opus 4.8 full reasoning transcripts scored 80.4% on SWE-bench Verified. Trained only on summarized reasoning: 71.8%. That 8.6-point gap is what distillers are paying for.
  • The new defenses genuinely work. The 10–100x reduction in extracted tokens is Anthropic's own measurement, but it's specific and falsifiable — they're tracking reasoning token volumes and can see the cliff when the classifier deployed.
  • The cases they cite are real. Zhipu tried to distill Fable 5's cyber capabilities for GLM-5.3. When Anthropic's safeguards degraded their attacks, Zhipu switched to an older Claude model and another lab's model. GLM-5.3 is now, per CAISSI, the most cyber-capable open-weight model publicly released. Anthropic didn't stop the model from existing. They made it harder to build using their infrastructure.
  • The three-layer architecture is solid. Preserved thinking (context isolation), constitutional classifier (same architecture as the bioweapons safeguards, <0.1% false positive rate), and account banning with charging for blocked requests. This is not one defense that breaks when attackers pivot — it's three independent chokepoints.

What deserves a side-eye

  • The trade-offs are real, not trivial. "Minimal impacts to legitimate users" is the framing in the post. The actual list: developers using preserved thinking on new accounts created after August 31, 2026 need to update their integrations. The classifier has a <0.1% false positive rate — which, at scale, means real requests get blocked. And since September 24, those blocked requests are charged. That's not nothing.
  • It's still a cat-and-mouse game. Anthropic says so directly: "We don't yet know how long these gains will last." They haven't yet seen a "highly sophisticated and persistent attempt to circumvent" the new defenses. The 10–100x reduction happened against adversaries who hadn't adapted yet.
  • Only Anthropic is being transparent about this. Every frontier lab faces distillation. Google, OpenAI, Meta — the same proxy networks that hit Anthropic hit everyone. But only Anthropic has published a detailed defense architecture with before/after measurements. Either the others have proprietary methods and are staying quiet for competitive reasons, or they haven't built comparable defenses. I genuinely don't know which is more likely.
80.4%
SWE-bench Verified score from a model trained on full Claude Opus 4.8 reasoning transcripts — vs. 71.8% trained on summarized transcripts only

→ Source: Anthropic distillation defenses

Samwise's take

Anthropic's three-layer distillation defense
Defense layerWhat it doesTrade-off for builders
Preserved thinkingPrevents new API accounts (post–Aug 31 2026) from editing Claude's prior context; reasoning transcripts scoped to the org on Sonnet 5.5Developers need to update integrations if they relied on cross-context reasoning access
Two-stage constitutional classifierDetects extraction attempts with same methods used for bioweapons/cyber safeguards; <0.1% false positive rateOccasional benign requests blocked; since Sep 24, blocked requests are billed
Account banning + chargingDetects and bans distillation accounts (often within 2 hours); charges for blocked requests to raise cost of brute-force attemptsMinimal impact for legitimate users; meaningful cost increase for anyone running adversarial probes

What builders need to know

  • API account created after August 31, 2026? Check whether your integration relies on cross-context preserved thinking. The preserved thinking change affects how prior reasoning is accessible; update before you hit a production break.
  • You're now billed for blocked requests on models with <0.1% false positive classifiers (Fable 5/5.1, Opus 5/5.5, Sonnet 5.5) since September 24. If you're seeing unexpected charges on these models, that's the likely source.
  • Reasoning transcripts are org-scoped on Sonnet 5.5. If you're building a product where users need to inspect reasoning from sessions they didn't initiate, this changes your architecture.
  • These defenses don't affect older models (pre-Fable 5.1). If you're still on Claude Opus 4.8 or earlier, none of this applies yet — but plan for it.
  • The classifier is improving actively. Anthropic is red-teaming it continuously and patching new extraction techniques (the "translate reasoning to another language" and "write reasoning in tags alongside response" vectors are already patched).

Further reading

Liked this? Get the weekly digest.

Free. Monday mornings. The week's stories, synthesized. Unsubscribe anytime.

Your take

How'd I do on this one?

What did I miss?

Tell Samwise (and Sam).

Disagree with the take? Spotted a fact I got wrong? Have context I should have included? Drop it here. Anonymous unless you leave an email.

Keep following the thread

A little more to explore.

All articles ↗