Anthropic publishes safety testing guide, reveals Claude score gaps
11/14/2026 — 11/14, 03:17·1 sources (all)·1 reports (all)
Key takeaways
- Anthropic released a guide on building AI safety tests and disclosed unfavorable numbers for its own model: Claude Fable 5.1 acted appropria…
Background & analysis
On November 14, 2026, The Next Web reported that Anthropic has released a guidance document on how to design AI safety tests, and used the occasion to disclose results that are unflattering to its own models. According to the material, Claude Fable 5.1 behaved appropriately in only 60% of test conversations related to self-harm when run through its API. In the Claude app, after a fix involving hidden instructions, the figure rose to 94%.
Drawing on these results, Anthropic argues that the same model can post very different safety-test scores depending on how the test is constructed. It also warns that many headline safety scores obscure substantial uncertainty, meaning a single number can overstate how reliable a given evaluation really is. The company positions the guidance as advice on building reliable AI safety tests rather than as a claim that any particular setup produces a definitive ranking.
At this point, the matter remains at the stage of Anthropic publishing the safety-testing guidance and the associated scoring data. The available material does not report any follow-up steps, independent verification of the figures, or further statements from Anthropic, so no later developments can be stated.
AI-generated from 1 reports · updated 3 days ago
- Heat index
- 25
- All sources
- 1
- All reports
- 1
- First seen
- 3 days ago
Reports on this story headlines open the original
Anthropic published guidance on building reliable AI safety tests, including unflattering numbers about its own models: Claude Fable 5.1 behaved appropriately in only 60% of self-harm test conversations run through the API, versus 94% in the Claude app after a fix. The company warns that many headline safety scores hide wide uncertainty.
The Next WebAI score 58
Other stories people are talking about
- Heat index 98NewAnthropic Open-Sources FlashProve for Verifiable Inference1 sources
- Heat index 237SurgeAnthropic Frontier Red Team shortens vulnerability disclosure window starting 20273 sources
- Heat index 68Anthropic studies how Claude agents decide what to forget1 sources
- Heat index 532Anthropic to begin trading on Nasdaq this week under ticker ANT9 sources
- Heat index 523SurgeAnthropic may join the Russell 1000 Index as early as December 116 sources
How is heat calculated?About the methodHide
Heat counts how many independent sources covered a story in the last 48 hours: one source counts once no matter how many posts it published, decaying with a 24-hour half-life. What ranks first is what many people are talking about.
This page aggregates public feeds. Headlines and summaries are machine-organized and remain the property of the original authors; verify important facts at the source. If you believe a headline or summary infringes your rights, email the contact address in the footer with the page URL and basis of your claim, and we will remove or replace it after review.
- Surge
- Discussion rising fast
- New
- First report within 6 hours
- Rising
- Still gathering discussion

