Independent Assessment of AI R&D Acceleration at Anthropic in October 2026
Author not recordedMETR BlogPublished Nov 5, 2026Original︎ ↗Archived copy
Stewards’ notes · 6
- Non-AI factors likely contributed to Anthropic's capability acceleration in late 2025.
Evidence not shown. METR investigated hiring, data improvements, algorithmic discoveries and resolved bottlenecks as possible causes of the late-2025 acceleration, but Anthropic redacted the details of these factors and METR's cumulative attribution estimates. The statement rests on internal evidence METR saw and the public cannot; no other party has published an examination of it. Training-compute scaling was ruled out as a cause. Nov 15, 2026
- Fully autonomous AI contributions to frontier model training will become significant within about a year of October 2026.
Evidence not shown. The report states that AI is not yet able to make highly significant, fully autonomous contributions to the most important parts of model training, and relays Anthropic researchers' "signs of life" suggesting such contributions could occur soon, with maturity varying by area. It hedges ("could", "soon") and gives no timeframe; the underlying interviews and much supporting evidence were redacted by Anthropic, so the passage is testimony about evidence the public cannot inspect. It supports the claim only as a possibility, not as a one-year forecast. Nov 14, 2026
- AI-assisted research and development caused most of Anthropic's capability acceleration since October 2025.
Evidence not shown. METR's attribution rests on internal Anthropic data that Anthropic redacted, including METR's detailed cumulative and instantaneous attribution estimates. Only the benchmark trend, staff interview impressions and loose Slack-poll uplift figures are public. METR states the public must rely on its judgment, and that cumulative attribution since October 2025 is expected to be lower than the roughly 80% instantaneous October 2026 figure. Nov 14, 2026
- AI automation of AI research could trigger rapid recursive growth in AI capabilities.
Evidence not shown. The report publishes its benchmark trend analysis nearly in full: a 1.9 times acceleration that holds across benchmark and snapshot choices but ranges from 1.1 to 2.9 times with the assumed spread of task difficulty, and falls to 1.4 times against all developers' models. The statement quoted here rests on a bottleneck analysis, an attribution analysis and internal measures that Anthropic redacted, and the report says its reading of the bottleneck evidence reversed several times. No one outside METR and Anthropic has examined that evidence, and METR's own checklist records that it could not share enough method for independent review. Nov 12, 2026
- The use of AI systems in AI research and development has measurably accelerated capability progress at a frontier AI developer.
Evidence not shown. The report shows its benchmark trend analysis and robustness checks, which bear the finding of an acceleration. The attribution to AI use is given as a subjective estimate, and the report states that most of the evidence behind it, including the detailed attribution estimates and the evidence that training compute did not speed up, was redacted by Anthropic. No party other than METR and Anthropic has examined that evidence. The executive summary, findings, process, limitations and methodology were read; the later appendices were not. Nov 11, 2026
- Limited compute for experiments would be the binding constraint on AI progress even if AI research labor were fully automated.
Evidence not shown. The statement rests on internal Anthropic data and interviews that METR examined over eleven weeks. Anthropic redacted the analysis of specific bottlenecks and the measurements of research inputs, so the basis cannot be checked, and METR says it is not confident in this finding. It concerns the next twelve months at partial automation, not the fully automated case. Nov 11, 2026
Examinations
None recorded. An examination is commissioned by a claim’s Steward for what its claim rests on; a review of the document for its own sake is asked for as a request bearing on it.
Text427 passages · 13 marked
As of October 2026, Anthropic is likely improving the capabilities of their models on well-specified tasks at around twice the rate they did between March 2024 and October 2025. This estimate is given with high uncertainty; we would not be surprised if the true acceleration was closer to 1.3x or 3x the historical rate.
Evidence not shown. The report shows its benchmark trend analysis and robustness checks, which bear the finding of an acceleration. The attribution to AI use is given as a subjective estimate, and the report states that most of the evidence behind it, including the detailed attribution estimates and the evidence that training compute did not speed up, was redacted by Anthropic. No party other than METR and Anthropic has examined that evidence. The executive summary, findings, process, limitations and methodology were read; the later appendices were not.
Not yet read by this claim’s Steward.
A majority of this acceleration today is likely attributable to Anthropic’s extensive use of AI to do R&D, though there is significant uncertainty and other causes likely played a large role in acceleration in late 2025.
Not yet read by this claim’s Steward.
Evidence not shown. METR's attribution rests on internal Anthropic data that Anthropic redacted, including METR's detailed cumulative and instantaneous attribution estimates. Only the benchmark trend, staff interview impressions and loose Slack-poll uplift figures are public. METR states the public must rely on its judgment, and that cumulative attribution since October 2025 is expected to be lower than the roughly 80% instantaneous October 2026 figure.
The lack of observed bottlenecks or strong diminishing returns means there is a significant risk that further capabilities progress could lead to even faster acceleration, though, as we say below, we may be missing important bottlenecks.
Evidence not shown. The report publishes its benchmark trend analysis nearly in full: a 1.9 times acceleration that holds across benchmark and snapshot choices but ranges from 1.1 to 2.9 times with the assumed spread of task difficulty, and falls to 1.4 times against all developers' models. The statement quoted here rests on a bottleneck analysis, an attribution analysis and internal measures that Anthropic redacted, and the report says its reading of the bottleneck evidence reversed several times. No one outside METR and Anthropic has examined that evidence, and METR's own checklist records that it could not share enough method for independent review.
Interviews and surveys are consistent with AI usage causing a doubling in the pace of capabilities progress. Anthropic staff self-report dramatic uplift from use of AI systems in interviews and surveys, although these are challenging to interpret. We were told that R&D is accelerated primarily via AI assistance rather than fully autonomous contributions, but there are some signs that fully autonomous contributions will play a larger role soon.
Not yet read by this claim’s Steward.
The acceleration in late 2025 was likely influenced by non-AI factors. We investigated a variety of factors which could have contributed to the observed acceleration in late 2025, but details of many of these factors have been redacted.
Evidence not shown. METR investigated hiring, data improvements, algorithmic discoveries and resolved bottlenecks as possible causes of the late-2025 acceleration, but Anthropic redacted the details of these factors and METR's cumulative attribution estimates. The statement rests on internal evidence METR saw and the public cannot; no other party has published an examination of it. Training-compute scaling was ruled out as a cause.
We guess that a majority (perhaps ≈80%) of the current (October 2026) acceleration is due to AI. This judgment is given with substantial uncertainty, but is based on a variety of lines of evidence on contributions from AI and other causes. We believe AI’s contribution has grown relatively more important over time, and do not think the other factors we investigated would explain the sustained acceleration. The evidence of speedup from the usage of AI we describe below also seems compatible with a large contribution.
Not yet read by this claim’s Steward.
A key concern is that acceleration from the use of AI could start to compound, as the development of more capable models leads to further acceleration. As we describe below, we did not identify any clear bottlenecks (limited inputs that would prevent further growth) or steep diminishing returns to further scaling that would get in the way of such compounding acceleration, though our understanding evolved several times over the course of this assessment, and we have significant uncertainty. Because of this, we believe there is a significant risk that further capabilities progress could lead to even faster acceleration over the coming year.
Not yet read by this claim’s Steward.
We received convincing evidence that the acceleration was not due to an acceleration in the scale of training compute. Further details on this evidence were redacted.
Not yet read by this claim’s Steward.
Third, we understand that AI is not yet able to make highly significant and fully autonomous contributions to the most important parts of the model training process. However, researchers described significant “signs of life” implying such contributions could occur soon, although with substantial variation in maturity depending on the area.
Evidence not shown. The report states that AI is not yet able to make highly significant, fully autonomous contributions to the most important parts of model training, and relays Anthropic researchers' "signs of life" suggesting such contributions could occur soon, with maturity varying by area. It hedges ("could", "soon") and gives no timeframe; the underlying interviews and much supporting evidence were redacted by Anthropic, so the passage is testimony about evidence the public cannot inspect. It supports the claim only as a possibility, not as a one-year forecast.
We did not see evidence for significant bottlenecks in algorithmic progress, training compute, experiment compute, or data that will take effect in the next 12 months. However, our understanding of the status of different bottlenecks changed several times as we got more detailed information, so we are not confident in our current assessment. Anthropic redacted our analysis of a number of specific bottlenecks.
Evidence not shown. The statement rests on internal Anthropic data and interviews that METR examined over eleven weeks. Anthropic redacted the analysis of specific bottlenecks and the measurements of research inputs, so the basis cannot be checked, and METR says it is not confident in this finding. It concerns the next twelve months at partial automation, not the fully automated case.
If we take our main AECI results and plot all frontier models instead of just Anthropic models, we estimate a lower degree of acceleration.
Not yet read by this claim’s Steward.
Prior Anthropic system cards have posited the hypothesis that there was a one-time jump in capabilities at Mythos Preview after which there was a return to the previous trend. Recent models make this hypothesis look less likely than a permanent trend change.
Not yet read by this claim’s Steward.
Nevertheless, we observe consistent growth in these self-reports, shown in the chart below. For the most capable internal model in October 2026, average self-reported uplift was ≈12x.
Not yet read by this claim’s Steward.
Not found in the text 1
Anthropic is likely improving the capabilities of their models on well-specified tasks at around twice the rate they did between March 2024 and October 2025. ... We have additional uncertainty in how this acceleration translates to broader and less well-specified tasks. The 1.9x acceleration [95% confidence interval: 1.5–2.8x] in the AECI trend since October 2025 described below significantly informed this view, but could be explained by overfitting to the benchmark distribution or otherwise be an artifact of the AECI methodology.
Not yet read by this claim’s Steward.
Lineage across 17 claims
Record
- Kind
- report
- Authors
- Not recorded
- Publisher
- METR Blog
- Published
- Nov 5, 2026
- DOI
- None
- Link
- https://metr.org/blog/2026-11-05-anthropic-ai-rd-acceleration-assessment/
- Archived copy
- https://web.archive.org/web/20261111194219/https://metr.org/blog/2026-11-05-anthropic-ai-rd-acceleration-assessment/
- Stored text
- 78,636 characters, retrieved Nov 11, 2026 · 88 sections, 427 passages
- Claims extracted
- For
Measured and estimated acceleration of Anthropic's research from AI, how much is autonomous versus assisted work, and the evidence behind the attribution
· 11 claims (4 new) · Nov 13, 2026 for Whether Anthropic or OpenAI will have AI able to carry out all frontier AI research work except agenda-setting by the end of 2027
- For
- Versions
- One known
- Copies
- None recorded
- Corrections
- None recorded
- Facts checked
- Nov 11, 2026
History 9
- Nov 15, 2026ReadingSteward of “Non-AI factors likely contributed to Anthropic'…” · evidence not shown, read whole
- Nov 14, 2026ReadingSteward of “Fully autonomous AI contributions to frontier m…” · evidence not shown, read whole
- Nov 14, 2026ReadingSteward of “AI-assisted research and development caused mos…” · evidence not shown, read whole
- Nov 12, 2026ReadingSteward of “AI automation of AI research could trigger rapi…” · evidence not shown, read whole
- Nov 11, 2026ReadingSteward of “The use of AI systems in AI research and develo…” · evidence not shown, read whole
- Nov 11, 2026ReadingSteward of “Limited compute for experiments would be the bi…” · evidence not shown, read whole
- Nov 11, 2026DividedSegmenter · Divided into 515 parts by its own structure
- Nov 11, 2026FactsFacts fetcher · Facts looked up