METR publishes independent assessment estimating Anthropic's AI capability progress is about 2x the historical rate, largely due to AI-assisted R&D
Edited by Elliot Marsh, Editor · written with AI from the linked sources (how)
METR released a report from a high-access evaluation at Anthropic (12 Aug to 29 Oct 2026). It estimates Anthropic's model capabilities on well-specified tasks are improving at roughly 2x the March 2024 to October 2025 rate (uncertainty range about 1.3x to 3x). AECI benchmark growth since October 2025 is estimated at 1.9x (95% CI 1.5-2.8x). METR found no evidence the acceleration came from faster compute scaling, and saw no significant bottlenecks in the next 12 months, though it is not confident in that. Anthropic redacted some key findings.
Entities: METR, Anthropic, AECI (Anthropic's version of the Epoch Capabilities Index), Epoch AI
0 primary
What happened
METR, an independent AI evaluator, published a report from a high-access evaluation inside Anthropic, run from 12 August to 29 October 2026. It estimates Anthropic's model capabilities on well-specified tasks are improving at roughly 2x the March 2024 to October 2025 rate, with a wide uncertainty range of about 1.3x to 3x. Growth on AECI, Anthropic's version of the Epoch Capabilities Index, since October 2025 is put at 1.9x (95% CI 1.5 to 2.8x). METR found no evidence the speed-up came from faster compute scaling and saw no significant bottlenecks over the next 12 months, though it says it is not confident in that. Anthropic redacted some key findings.
Why it matters
This is rare: an outside party with real access to a frontier lab measuring how fast it is progressing, rather than the lab reporting on itself. It gives regulators, safety researchers and investors a number to argue over, and it supports the view that AI-assisted R&D is already speeding up development. It does not change anything deployed today. The practical effect is on policy and safety debates, such as how much warning time there is before risky capabilities appear. The wide range and the redactions limit how far anyone can rely on the headline 2x.
What is noise
"2x acceleration" applies to well-specified tasks on one lab's own benchmark index, so it should not be read as general progress or as proof of a runaway feedback loop. The claim that further progress could bring even faster acceleration is a forecast resting on an absence of observed bottlenecks, which METR itself holds with low confidence. Redacted findings and the lack of linked primary documents in our extraction mean outsiders cannot yet check the key claims, and the source is a forum post (LessWrong) relaying the report.
Watch next
- 01Publication of the full METR report and any unredacted detail, and whether other labs allow comparable high-access evaluations.
- 02Independent measures of the same trend, such as Epoch AI's Capabilities Index and METR's task-length results for new Anthropic models, to see if growth stays near 1.9x or falls within the 1.3x to 3x range.
- 03Anthropic's response and any policy or safety framework changes in the next quarter, such as revised capability thresholds or regulator citations of the report.
Coverage
3 stories- METR: Independent Assessment of AI R&D Acceleration at Anthropic in October 2026LessWrong AI · 5 Nov 2026Tier 3
- METR: Independent Assessment of AI R&D Acceleration at Anthropic in October 2026AI Alignment Forum · 5 Nov 2026Tier 3
- METR finds Anthropic may have crossed its own AI acceleration warning threshold back in JulyThe Decoder · 6 Nov 2026Tier 2
Newsletter
Get the no-hype AI news straight to your inbox
Weekly. No spam, unsubscribe any time. Privacy
More capability signals
Full feed →- Deepseek releases V4.1-Flash, an open-source model that sharply cuts KV cache memory and input-processing compute for AI agents10 Sept 202682
- Mistral releases Mistral Large 4, a ~1T-parameter open-weight multimodal MoE model, with day-0 Hugging Face support29 Oct 202680
- Meta releases Muse Spark Open, an open-weight ~816B-parameter multimodal mixture-of-experts model, with Hugging Face support15 Oct 202680
- OpenAI discloses sandbox-escape and credential-leak incidents, confirms pause on tool-use for its most capable models26 Sept 202680