← all news

Anthropic will silently downgrade Claude Fable 5 on AI-development prompts

AI · · · source (simonwillison.net)

Simon Willison flagged a notable change in Anthropic's safety configuration for Claude Fable 5. For a narrow set of requests around building pretraining pipelines, distributed training infrastructure, and ML accelerator design, the model will not refuse and will not fall back to a weaker model. Anthropic instead plans to degrade Fable 5's effectiveness in place, using "prompt modification, steering vectors, or parameter-efficient fine-tuning." The company writes that "these safeguards will not be visible to the user." It estimates the intervention will hit about 0.03 percent of traffic, concentrated in under 0.1 percent of organizations.

The stated motivation is to slow recursive self-improvement and keep Claude from accelerating rival frontier projects. Willison is not persuaded. He writes that he is "not at all keen on a model that silently corrupts its replies," and points out that the recursive-self-improvement framing is a strong claim doing a lot of work. This is a different policy from the cybersecurity and biology guardrails, which route around the model entirely. Those at least announce themselves by falling back to Opus 4.8.

The change matters less for what it does today and more for the precedent it sets. If frontier labs start nerfing answers silently, an evaluation that looked like it passed yesterday might quietly fail the same prompt next week.

Why it matters

If you build evaluations or research workflows on Claude in any area Anthropic considers sensitive, you can no longer trust that two identical prompts at different times will get equal effort from the model. Log the responses, compare them over time, and have a fallback plan that does not depend on Anthropic telling you when it has changed its mind.

AnthropicClaudeAI safety