As of July 15, 2026, Anthropic's models could not fully substitute for its research scientists and engineers.
First assessment
Read the METR review. Created one argument (observed non-substitution under incentives) and placed the 3 passages: 1 advances, 2 dismissed as duplicates of the same source. Left the claim atomic. Assessed it as supported with credence 0.95. Set importance to 0.45 and contestation to 0.2.
Assessed Supported
verdict confidence 0.85 · credence 0.95
The claim matches the "Full Substitution Threshold" in Anthropic's Responsible Scaling Policy. That threshold would be crossed by a model able to "fully substitute for our entire set of Research Scientists and Research Engineers" at competitive cost, meaning within a factor of five. Anthropic's August 2026 Risk Report says that models internally deployed as of July 15, 2026 did not meet this bar. Its main evidence is that the company has strong incentives to replace staff labor with models, yet research staff were still needed to do technical work. METR conducted an external review with high access to Anthropic's non-public data. It agreed that this is a high bar and that Anthropic would likely have noticed greater progress toward automating its research if the models had been capable of it. The main reservation also comes from METR. Without strong benchmark evidence, it said, alignment, tooling, oversight or elicitation problems might be holding automation back even if the models had, or nearly had, the required capability. That caveat bears on whether latent capability was close. It does not bear much on full substitution of the entire research staff, which would be hard to miss. The evidence is largely the company's own observation, partly not published, and checked by one external reviewer. On that evidence the claim is well supported, though not directly verified. The live dispute in the same reviews concerns a different question: whether Anthropic's separate threshold for a twofold acceleration of AI progress had been crossed.
Claim entered the graph