Claude outperforms skilled human researchers at optimizing steps within clearly defined machine-learning experiments.
Assessment
The evidence favors the claim, but the examination is incomplete or the evidence is indirect.
The claim rests mainly on Anthropic's own capability evaluations, run at each model release. On a fixed-goal task, making the code that trains a small language model run as fast as possible while still passing correctness checks, Anthropic reports that a skilled human reaches about a 4x speedup in four to eight hours. Claude Opus 4 averaged about 3x in May 2025. Claude Opus 4.6 averaged about 34x, Claude Mythos Preview about 52x, and Claude Opus 4.7 about 41x. On a kernel optimization task, Opus 4.6 reached 427x against a reference of 300x set at roughly 40 human-expert hours. A more open-ended example points the same way: Claude agents recovered 97% of the performance gap on a weak-to-strong supervision problem, against 23% for two researchers working for about a week. That example used far more cumulative agent hours and compute.
Read as a statement about current frontier Claude models on well-specified, metric-driven optimization work, the claim is supported. The margins are large: an order of magnitude over the human reference on the training-speedup task. The evidence has real limits, though. The human figures are time-capped reference points, not what a skilled researcher would reach with comparable effort, wall-clock time and compute. Only a handful of in-house tasks are covered. Anthropic has not fully published the baselines or run details. The source also has a commercial interest in the result. Earlier independent work, METR's 2024 RE-Bench, found that agents led human experts at short time budgets while humans improved faster over longer ones. So "outperforms" is well established against time-bounded expert baselines on these tasks, and less firmly established as a general statement about skilled researchers working on any clearly defined ML experiment. Independent head-to-head comparisons with matched resources, on current models, would settle it.
Full reasoning: the evidence and decisions behind this verdict
Evidence read: Anthropic Institute essay "When AI builds itself" (read in full, including footnote 7, which warns that the absolute speedup depends on the headroom in the starting code and says the like-for-like comparison is what to weigh). Corroborated by search results giving the system card tables: Opus 4.7 system card (LLM training: Opus 4.6 34x, Mythos Preview 61.79x best or ~52x average, Opus 4.7 40.81x, threshold >4x = 4–8h equivalent); Mythos Preview system card summaries (LLM training 51.91x average); coverage of the Opus 4.6 system card (kernel optimization 427x against a 300x threshold described as 40 human-expert hours). Counter-consideration: METR RE-Bench (arXiv 2411.15114, 2024) found that agents beat humans at 2 hours, while humans improved faster with time and led at 8 hours or more. Those were older models, but it shows that time-capped baselines can flatter agents. Weighing: the margin (~13x the human reference on the training task, and beyond the 40-hour reference on kernels) is large enough that a modest correction for time caps probably does not reverse it on these tasks. The remaining doubt is about generality across "clearly defined ML experiments" and the lack of independent replication with matched resources. All load-bearing figures come from Anthropic, an interested party, and its baseline methodology is not public. Credence 0.72.
Decomposition
This claim is atomic: it bottoms out in a bedrock fact, an open empirical question, or a value premise, and does not decompose further.
Provenance
Where this claim has been said, linked to its canonical form.
Neither source has been traced to an origin, or to one another.
LLM training 34× 61.79× 40.81× >4× = 4–8h eq.
Automated R&D evaluation table: Opus 4.6, Mythos Preview and Opus 4.7 scores on the LLM-training speedup task against a threshold equal to a 4x speedup, the level a human expert reaches in 4 to 8 hours. Evidence for the claim rather than a verbal assertion of it.
In this part of the research workflow—optimizing steps within a clearly defined experiment—Claude has gone from super helpful to superhuman in under a year.
Based on Anthropic's small-model training-code speedup test run at every model release.
The assertion outruns the source's own evidence. The essay rests the word "superhuman" on a single in-house task, a small-model training speedup test, comparing Claude's ~52x average with a skilled human's ~4x after four to eight hours. Its own footnote warns that the absolute multiple depends on the starting code. The human figure is a time-capped reference, not what a researcher reaches with comparable effort, and the baseline details are not published here. The data are Anthropic's own, about its own models.
Cite this claim: a formal citation with its evidence attached
Embed this claim: show it on another site with its current assessment
An embed reports the graph's judgment as it stands when the page is viewed: the status with its confidence, how disputed the claim is, and the date. It links back here.
<blockquote class="minerval-claim" data-claim-id="f5262f38-3029-47e3-9e55-e7f796eae1e4"><a href="https://minerval.ai/claims/f5262f38-3029-47e3-9e55-e7f796eae1e4">Claude outperforms skilled human researchers at optimizing steps within clearly defined machine-learning experiments.</a></blockquote> <script async src="https://minerval.ai/embed.js"></script>
<iframe src="https://minerval.ai/embed/claims/f5262f38-3029-47e3-9e55-e7f796eae1e4" title="Minerval: Claude outperforms skilled human researchers at optimizing steps within clearly defined m…" width="480" height="225" style="border:0;max-width:100%" loading="lazy"></iframe>
[](https://minerval.ai/claims/f5262f38-3029-47e3-9e55-e7f796eae1e4)
The badge now: 
Contribute
Every judgment on this page is open to challenge. A contribution is evaluated on its merits by the reviewer; if it succeeds the page changes, and if it does not, the reasons are stated. Either way the exchange becomes part of the claim’s public record.
Stated views None yet. A view stated to the graph is shown on this page in its speaker’s words, as a source like any other, and carries no weight in the assessment.
The attention this claim received was paid for by a funded mandate. Funding buys only scheduling: it can make an assessment happen sooner, or reach deeper into a subtree. It has no influence on what the assessment concludes, and none on which claims enter the graph; assessments run under the same public standards whoever pays, funders never see or shape a verdict before anyone else, and mandates that attempt to steer conclusions are refused.
The model that assessed this claim, Claude Opus 5.5, was built by Anthropic, which the claim names. A model may be biased about its own developer.
Created by extractor · Nov 13, 2026. Every judgment on this page is accompanied by a reasoning trace.