Minerval
Sourcereporttext stored

When AI builds itself

Author not recordedDate not recordedOriginal︎ ↗Archived copy

Interest recordedAnthropic · Anthropic develops and sells the Claude models the report describes, and the report is published by its own institute. It gains commercially and reputationally from its models being seen as highly capable, and its account of their limits shapes how regulators and the public judge the pace of AI development. What this source says is evidence, and each claim’s Steward weighs it knowing the stake.
Claims23
ExaminationsNone
Text32 sections
VersionsOne known
CopiesNone recorded
CorrectionsNone recorded
Facts checked Nov 13, 2026
ReachNo copies recorded
StructureIn 23 claims' maps0 sources downstream across 23 claims
Evidence6 readings · 6 read wholeEvidence not shown 4 · Overstates 2No claim cites an examination's findings
ReviewsNot reviewed
Stewards’ notes · 6
  • The use of AI systems in AI research and development has measurably accelerated capability progress at a frontier AI developer.

    Overstates. The essay's internal evidence measures research and engineering productivity: the Claude-authored share of merged code, lines merged per engineer (which the essay itself says overstate productivity), a self-reported staff poll that it expects overstates uplift, and Claude-judged task success rates. Much of it is internal data not published in full. None of it measures a change in the rate at which Anthropic's models improve, and the public benchmark trends it cites are industry-wide and not attributed to AI use. The essay therefore supports faster research work at Anthropic more than it supports a measured acceleration of capability progress. It is in some tension with Anthropic's August 2026 risk report, which attributed the acceleration up to mid-July to factors other than AI. Nov 14, 2026

  • Claude outperforms skilled human researchers at optimizing steps within clearly defined machine-learning experiments.

    Overstates. The essay rests the word "superhuman" on a single in-house task, a small-model training speedup test, comparing Claude's ~52x average with a skilled human's ~4x after four to eight hours. Its own footnote warns that the absolute multiple depends on the starting code. The human figure is a time-capped reference, not what a researcher reaches with comparable effort, and the baseline details are not published here. The data are Anthropic's own, about its own models. Nov 14, 2026

  • AI systems are improving at choosing next steps in AI research.

    Evidence not shown. The report describes an internal test on 129 detours from researchers' Claude Code sessions, January to March 2026, scored by a separate Claude that could see how each session ended. The win rate against the researcher's choice rose from 51% to 64% between two models. The sessions, the judging prompts and per-case results are not published, and no outside party is reported to have examined them. The moments were selected because the human choice was poor, so the figures compare models with each other, not with human judgment in general; the report says so itself. Nov 14, 2026

  • Share of Anthropic internal Claude Code sessions on the most open-ended tasks judged successful in May 2026 (%)

    Evidence not shown. The figure comes from Anthropic's internal Claude Code session logs, graded by a Claude-based judge that counts a session as successful when the agent clearly succeeded without requiring corrections. Neither the session data, the rule assigning sessions to the most open-ended tier, nor any validation of the judge against human grading is published, and no outside party is reported to have examined them. The report itself warns that shifting workloads cause short-term fluctuations in the rate. A later update to the page (September 2026) extended the chart beyond May. Nov 14, 2026

  • AI development is moving toward substantial automation while humans continue setting research directions and judging results.

    Evidence not shown. The report combines public benchmark trends with internal Anthropic data, including the share of merged code that Claude wrote, lines of code per engineer, and an employee survey. It also concedes that Claude remains weak at choosing goals. The internal data have not been published or examined independently. Nov 14, 2026

  • As of 2026, frontier AI agents can perform research engineering but struggle with critical stages of the AI research lifecycle.

    Evidence not shown. The account rests on internal usage data, staff polls and session outcomes scored by the developer's own model, none of it published in a form others can check. The strong engineering figures serve the developer's interest. The statement that large gaps persist in judgment about which goals to pursue runs against the impression the rest of the report gives, and deserves weight for that reason. The first 14,000 characters of the report were read. Nov 13, 2026

Examinations

None recorded. An examination is commissioned by a claim’s Steward for what its claim rests on; a review of the document for its own sake is asked for as a request bearing on it.

Text80 passages · 18 marked

No examination yetMarked passage
When AI builds itself

Taken far enough, and given enough compute, that trend points to an AI system capable of fully autonomously designing and developing its own successor. This is called recursive self-improvement . We are not there yet, and recursive self-improvement is not inevitable. But it could come sooner than most institutions are prepared for.

When AI builds itself

Using public benchmarks and previously unreported data from within Anthropic, The Anthropic Institute is showing that AI is already accelerating the development of AI systems. To take just one example: today, Anthropic engineers on average ship 8x as much code per quarter as they did from 2021-2025.

The use of AI systems in AI research and development has measurably accelerated capability progress at a frontier AI developer.SupportedReading · this claim’s Steward

Overstates. The essay's internal evidence measures research and engineering productivity: the Claude-authored share of merged code, lines merged per engineer (which the essay itself says overstate productivity), a self-reported staff poll that it expects overstates uplift, and Claude-judged task success rates. Much of it is internal data not published in full. None of it measures a change in the rate at which Anthropic's models improve, and the public benchmark trends it cites are industry-wide and not attributed to AI use. The essay therefore supports faster research work at Anthropic more than it supports a measured acceleration of capability progress. It is in some tension with Anthropic's August 2026 risk report, which attributed the acceleration up to mid-July to factors other than AI.

Evidence from the outside world

The rate at which AI models improve is accelerating. The length of tasks that they can reliably complete on their own has been doubling roughly every four months, up from an earlier trend of doubling every seven months. In March 2024, Claude Opus 3 could complete software tasks that take humans about four minutes to complete. A year later, Claude Sonnet 3.7 managed tasks that took about an hour and a half. A year after that, Claude Opus 4.6 managed 12-hour tasks. 1 If this trend holds, tasks that take a skilled person days could come into range this year. In 2027, AI systems could be capable of tasks that take a person weeks.

Evidence from the outside world

CORE-Bench tests whether a model can reproduce existing research, a prerequisite for them to conduct original research. It gives an AI model the code and data behind a published paper, and asks it to rerun everything and confirm it can replicate the paper’s results. AI systems went from succeeding at reproducing the results roughly 20% of the time in 2024 to saturating the benchmark fifteen months later. METR, which runs the benchmark measuring how well models can complete long-duration tasks, found that Claude Mythos Preview could work for “at least” 16 hours and was “at the upper end of what [METR] can measure without new tasks.”

Evidence from within Anthropic

Across both engineering and research, the picture is consistent. In engineering, Claude can be handed an underspecified problem and figure out how to solve it; humans supply the goal, but they no longer need to supply the method. In research, Claude can already match or outperform skilled humans at executing a well-specified experiment. However, large performance gaps persist when it comes to Claude exercising judgement in choosing goals in both engineering and research. That’s the gap between AI today and a future system that could autonomously design its own successor.

As of 2026, frontier AI agents can perform research engineering but struggle with critical stages of the AI research lifecycle.SupportedReading · this claim’s Steward

Evidence not shown. The account rests on internal usage data, staff polls and session outcomes scored by the developer's own model, none of it published in a form others can check. The strong engineering figures serve the developer's interest. The statement that large gaps persist in judgment about which goals to pursue runs against the impression the rest of the report gives, and deserves weight for that reason. The first 14,000 characters of the report were read.

Current AI systems have research taste comparable to top human AI researchers.Doubtfuldenies

Not yet read by this claim’s Steward.

Evidence from within Anthropic

Claude writes a significant proportion of Anthropic’s code. As of May 2026, more than 80% of the code we merge into Anthropic’s codebase was authored by Claude. 3 Before Claude Code launched in research preview in February 2025, this number was in the low single digits. That shift also shows up in the amount of output per engineer. Lines of code merged per engineer per day stayed constant through Anthropic’s first four years (2021-2024), then began to climb upward in 2025 when Claude began to run code rather than just suggesting it for an engineer to copy and paste. The slope steepened again in 2026 when models began to work autonomously over longer time horizons. These two inflection points are shown in the chart below. In the second quarter of 2026, the typical engineer was merging 8× as much code per day as they were in 2024. 4 This is because much of the code is written by Claude, with the engineer directing and reviewing, rather than typing it themselves.

Evidence from within Anthropic

The increase in lines of code written lines up with subjective impressions of large productivity increases. In a March 2026 poll of 130 employees from across Anthropic research teams, the median respondent estimated that they produced around 4x as much output with Mythos Preview as they would have without access to any AI models, on the kinds of projects they would have been working on regardless. 5 We expect that the true degree of uplift in March was somewhat lower. 6 Nevertheless, we find the overall claim plausible, and in line with our other observations: a significant fraction of Anthropic technical staff is accomplishing their core work multiple times faster than they could without AI assistance.

Anthropic employee*

On the most open-ended tasks, Claude’s success rate reached 76% in May 2026, up 50 percentage points in six months. To give an example of tasks in this difficulty tier, a routine upgrade began crashing tens of thousands of training jobs. An engineer pointed Claude at the live incident with little more than some text content and cluster access. Working through the running jobs and testing one environment setting at a time, Claude isolated the single obscure debugging flag that was triggering the crash, reproduced it reliably, and confirmed a fix. In about two hours, Claude delivered what would normally be two to three days of work.

Share of Anthropic internal Claude Code sessions on the most open-ended tasks judged successful in May 2026 (%)UnassessedReading · this claim’s Steward

Evidence not shown. The figure comes from Anthropic's internal Claude Code session logs, graded by a Claude-based judge that counts a session as successful when the agent clearly succeeded without requiring corrections. Neither the session data, the rule assigning sessions to the most open-ended tier, nor any validation of the judge against human grading is published, and no outside party is reported to have examined them. The report itself warns that shifting workloads cause short-term fluctuations in the rate. A later update to the page (September 2026) extended the chart beyond May.

Anthropic employee*

The second criterion is writing code that another engineer can understand and build on. Here the gap between humans and AI persists, but is closing fast. There isn’t full consensus among staff at Anthropic, but many believe that the Claude-written code was still worse in quality than human-written code at Anthropic in late 2025, and is roughly at parity today. We expect it to be better within the year.

Anthropic employee*

Claude is good at running experiments to hit a goal that someone else has set. Every time Anthropic releases a model, we run the same test: we give Claude some code that trains a small AI model, and ask it to make that code run as fast as possible while still passing the same correctness checks. The goal and the success metrics are fixed in advance, so Claude’s job is to find speedups by rewriting the code, running it, timing it, and repeating. It’s a miniature version of an experimental research loop. In May 2025, Claude Opus 4 averaged a ~3x speedup over the starting code. By April 2026, Claude Mythos Preview was achieving ~52x. For calibration, a skilled human researcher would need four to eight hours to reach 4x. 7 In this part of the research workflow—optimizing steps within a clearly defined experiment—Claude has gone from super helpful to superhuman in under a year.

Claude outperforms skilled human researchers at optimizing steps within clearly defined machine-learning experiments.SupportedReading · this claim’s Steward

Overstates. The essay rests the word "superhuman" on a single in-house task, a small-model training speedup test, comparing Claude's ~52x average with a skilled human's ~4x after four to eight hours. Its own footnote warns that the absolute multiple depends on the starting code. The human figure is a time-capped reference, not what a researcher reaches with comparable effort, and the baseline details are not published here. The data are Anthropic's own, about its own models.

Anthropic employee*

Claude is getting better at proposing its own experiments. In April 2026, Anthropic published the first demonstration of Claude running an open-ended research project end to end. Claude-powered agents were given an open problem in AI safety—roughly, can a weaker model reliably supervise a stronger one? —and were left to solve it. This involved proposing hypotheses, testing them, sharing findings with parallel agents, and iterating. The task has a clear performance “floor” and “ceiling”: the floor is how well the weak supervisor would do on its own; the ceiling is how the strong model does when trained on correct answers. Two human researchers, over about a week, recovered roughly 23% of that gap; the agents recovered 97% over 800 cumulative hours and used roughly $18,000 in compute. There are some caveats to this work; the result didn’t transfer cleanly to production-scale models, and humans still chose the problem and created the scoring rubric. But within those bounds, the agents designed every experiment themselves. Direction-setting was the only meaningful role a human played.

Anthropic employee*

Because we deliberately picked moments (n=129) where we know the human’s choice had room for improvement, this isn’t a like-for-like comparison between model and human judgement. What these moments give us is a set of realistic, challenging situations where the right next step is not obvious, and where the human’s choice serves as a useful yardstick to compare model performance over time. On this measure, our best model in November 2025 (Opus 4.5) beat the human choice 51% of the time; in April 2026 (Mythos Preview), this grew to 64%. The day-to-day work of research is largely a chain of these next-step decisions, making this a relevant measure of the model’s ability to eventually run an investigation of its own. We view this result as an early signal that AI systems are getting better at making the kinds of judgement calls that AI research depends on.

AI systems are improving at choosing next steps in AI research.SupportedReading · this claim’s Steward

Evidence not shown. The report describes an internal test on 129 detours from researchers' Claude Code sessions, January to March 2026, scored by a separate Claude that could see how each session ended. The win rate against the researcher's choice rose from 51% to 64% between two models. The sessions, the judging prompts and per-case results are not published, and no outside party is reported to have examined them. The moments were selected because the human choice was poor, so the figures compare models with each other, not with human judgment in general; the report says so itself.

Anthropic employee*

It is genuinely unclear whether today’s training methods and architectures could unlock that capacity. But AI is rarely advanced by “eureka!” moments. There have been a few of these in AI’s recent history, like the Transformer architecture , or mixture-of-experts models, but paradigm-shifting ideas arrive years apart. In between, most progress is incremental: we scale something up, see what breaks, fix it, and try again. That is exactly the kind of workflow Claude now excels at. Edison said that genius is 1% inspiration and 99% perspiration. But we see perspiration becoming increasingly automated. It’s becoming clear that much of what advances the frontier is automatable; large-scale research progress is mostly a function of tools and resources, which dictate how fast you can run experiments, how many you can run at once, and how quickly you can get results.

Anthropic employee*

Even if we suppose that Claude never achieves good research taste, a conservative reading of our evidence still implies compounding acceleration. If humans spend most of their time on the single-digit fraction of work that is direction-setting, while Claude handles the rest, that means each engineer or researcher is steering far more work than before. The evidence we see suggests that people at Anthropic are both moving faster and covering a broader surface. In practice, this means that AI already makes Anthropic move much faster than it did before the advent of effective AI tools.

Anthropic employee*

The less conservative reading is that the early evidence on Claude’s improving research judgment—narrow as it is today—is an indicator that this capability is improving as well. “Research taste” might be just another AI capability that AI systems fail at for a time, then get good at. We’ve seen a similar pattern with other qualitative skills, like AI systems being able to explain why a joke is funny, demonstrate theory of mind, and solve linguistic riddles.

Possible futures

We include this scenario for completeness, but we don’t believe it’s likely. Every capability we can measure, including those that feel “squishier,” like quality of code and success on open-ended tasks, has so far followed the same curve. We have not yet seen that curve bend. Of the three futures we consider, this one would give governments and societies the most time to adapt. We are more worried about the next two, which would move faster and leave far less room for preparation.

Possible futures

The evidence we’ve laid out here suggests that we’re likely heading into this scenario. But speeding up one part of a process often just shifts the bottleneck elsewhere: overall pace is capped by the parts that haven’t sped up. In computing, this is known as Amdahl’s law , and the same logic can apply to organizations. Anthropic has already encountered one signature of Amdahl’s law: as we’ve begun to push more code around the organization, human code review has become a new bottleneck.

AI development is moving toward substantial automation while humans continue setting research directions and judging results.SupportedReading · this claim’s Steward

Evidence not shown. The report combines public benchmark trends with internal Anthropic data, including the share of merged code that Claude wrote, lines of code per engineer, and an employee survey. It also concedes that Claude remains weak at choosing goals. The internal data have not been published or examined independently.

Possible futures

In this world, the pace of progress in AI development becomes determined entirely by the availability of compute (or the speed of discovering various efficiencies in algorithmic training or inference) for AI systems. Humans play a substantially diminished role in their development, likely moving most of our effort towards oversight, validation, and verification of an expanding “virtual lab” run by AI systems. We expect that systems capable of automated AI research and development would have skills that would transfer to the rest of science, allowing them to begin to revolutionize other fields.

Lineage across 23 claims

Draws on · none recorded
This source
When AI builds itself
in 23 claims' maps
Drawn on by · none recorded

Record

Kind
report
Authors
Not recorded
Publisher
Not recorded
Published
Not recorded
DOI
None
Link
https://www.anthropic.com/institute/recursive-self-improvement
Archived copy
https://web.archive.org/web/20261111053955/https://www.anthropic.com/institute/recursive-self-improvement
Stored text
34,128 characters, retrieved Nov 13, 2026 · 32 sections, 80 passages
Claims extracted
Versions
One known
Copies
None recorded
Corrections
None recorded
Facts checked
Nov 13, 2026

History 9

  1. Nov 14, 2026ReadingSteward of “The use of AI systems in AI research and develo…” · overstates, read whole
  2. Nov 14, 2026ReadingSteward of “Claude outperforms skilled human researchers at…” · overstates, read whole
  3. Nov 14, 2026ReadingSteward of “AI systems are improving at choosing next steps…” · evidence not shown, read whole
  4. Nov 14, 2026ReadingSteward of “Share of Anthropic internal Claude Code session…” · evidence not shown, read whole
  5. Nov 14, 2026ReadingSteward of “AI development is moving toward substantial aut…” · evidence not shown, read whole
  6. Nov 13, 2026ReadingSteward of “As of 2026, frontier AI agents can perform rese…” · evidence not shown, read whole
  7. Nov 13, 2026DividedSegmenter · Divided into 112 parts by its own structure
  8. Nov 13, 2026FactsFacts fetcher · Facts looked up