argumentA line of reasoning from premises to a conclusion. Like a claim, it belongs to no one who makes it.constitution →

The judgment-bottleneck argument

forThis argument, if it holds, bears in favour of the claim.constitution →Weak research judgment in AI systems will slow automation of the remaining AI R&D tasks below current-trend extrapolations.

The argument

Trend extrapolations of AI R&D automation are driven mostly by engineering tasks that agents now do well. The tasks that remain unautomated mostly require research judgment, humans still supply most of that judgment, and agents attempting open-ended research show recurring judgment failures. If judgment improves no faster than the engineering trend, the residual share is automated more slowly than extrapolation implies.

Does it work?

Does it follow?: likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
Do the premises hold?: 3 supported

Granting its premises, including the stated one that judgment improves no faster than the engineering trend, slower automation of the residual work follows with high probability, since the slowest remaining component tends to set the pace. The premises on current failures (linked claim) and on humans supplying most judgment (linked claim) are supported. The composition premise (linked claim) is supported only weakly: much long-horizon engineering also remains, and that share moves at the trend rate, which limits how much of the residual the bottleneck governs. The argument lives or dies on the relative-rate premise, which is unmeasured for open-ended judgment.

Premises

SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →Most AI R&D tasks that remain unautomated require research judgment rather than engineering execution.
SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →AI agents attempting open-ended research exhibit recurring failures in research judgment, redesign, backtracking, resource awareness, and instruction following.
SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →As of late 2026, humans supply most research judgment in frontier AI R&D.

Where it is made

Passages where sources make, criticize or mention this argument. They record where it appears, not how strong it is, and none has precedence over another.

No source is recorded as making it.

Earlier ratings

Nov 14, 2026likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
Granting its premises, including the stated one that judgment improves no faster than the engineering trend, slower automation of the residual work follows with high probability, since the slowest remaining component tends to set the pace. Its premises on current failures (linked claim) and on humans supplying judgment (linked claim) are supported, and the composition of residual tasks (linked claim) is unjudged. The argument lives or dies on the relative-rate premise, which is unmeasured for open-ended judgment.