The argument from the research-judgment gap
shows Full automation, which requires research judgment, is likely later than extrapolations from well-specified tasks suggest, probably after 2028.
The argument
Full automation requires AI to supply research judgment, which humans still provide: no measured part of Anthropic's R&D was fully autonomous in late 2026, agents recovered little of unseen innovations on InnovationEval, and all four AI-written papers in the CRUX 2 evaluation were rejected by the original authors. The tasks left unautomated are those hardest to measure and train, so progress on them may lag the trend on well-specified tasks. If the measured acceleration does not generalize to open-ended AI research, the final step to full automation takes years longer than extrapolations imply.
Does it work?
- Does it follow?
- likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
- Do the premises hold?
- 1 inconclusive
Granting that research judgment remains the unautomated remainder and that acceleration on well-specified tasks fails to generalize, a later date follows fairly directly. The argument lives on that generalization premise, which the evidence currently leaves unsettled.
Premises
- InconclusiveThe evidence and argument have been examined and do not come down on either side.constitution →Recent acceleration measured on well-specified AI benchmarks will not generalize to AI research and development.
Where it is made
Passages where sources make, criticize or mention this argument. They record where it appears, not how strong it is, and none has precedence over another.
No source is recorded as making it.
Earlier ratings
- Nov 14, 2026likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
Granting that research judgment remains the unautomated remainder and that acceleration on well-specified tasks fails to generalize, a later date follows fairly directly. The argument lives on that generalization premise, which the evidence currently leaves unsettled.