The argument from the present gap in open-ended research
The argument
In late 2026, frontier agents do research engineering but struggle at critical stages of research: expert authors rejected every AI-written paper in the one direct open-ended test, both labs say people still judge which ideas and results to pursue, and at OpenAI over half of successful four-to-eight-hour tasks needed human intervention. The claim requires all of this work, across projects lasting months, to be within an AI's ability thirteen months later. The evidence of acceleration is measured on well-specified, checkable tasks, and may not generalise to research work; the remaining tasks are the judgment-dependent ones, where lack of research judgment may slow automation. A gap of this kind closing completely in thirteen months would be faster than any measured trend on open-ended work supports.
Does it work?
- Does it follow?
- likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
- Do the premises hold?
- 2 inconclusive1 supported
Granting its premises, the forecast would probably fail: if the measured acceleration does not reach research work and judgment holds back the remaining tasks, thirteen months is too short. The premise about the present is the firmest: the gap at critical stages of research is well supported through mid-2026 and confirmed by both labs' own accounts, though less certain for the newest models, one of which now exceeds recruited experts at designing and interpreting experiments on fixed problems. The two forward-looking premises carry the weight and are open: whether benchmark acceleration generalises to research is unsettled, and whether research judgment will slow the remaining automation has not been assessed. The argument is the main reason the forecast is judged more likely false than true, but it is not decisive, because a present gap says little about a rate that may itself be accelerating.
Premises
- SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →As of 2026, frontier AI agents can perform research engineering but struggle with critical stages of the AI research lifecycle.
- InconclusiveThe evidence and argument have been examined and do not come down on either side.constitution →Weak research judgment in AI systems will slow automation of the remaining AI R&D tasks below current-trend extrapolations.
- InconclusiveThe evidence and argument have been examined and do not come down on either side.constitution →Recent acceleration measured on well-specified AI benchmarks will not generalize to AI research and development.
Where it is made
Passages where sources make, criticize or mention this argument. They record where it appears, not how strong it is, and none has precedence over another.
No source is recorded as making it.