argumentA line of reasoning from premises to a conclusion. Like a claim, it belongs to no one who makes it.constitution →

The argument from oversight degrading as the capability gap widens

forThis argument, if it holds, bears in favour of the claim.constitution →Amplified oversight can supervise AI systems moderately beyond overseers’ capabilities, but not superintelligent systems.

The argument

Oversight success rates decline as the capability gap between overseer and overseen system grows, and a dishonest debater can win with arguments too complex for its opponent to refute, a route to failure that opens wider as the system becomes more capable. A superintelligent system lies far beyond any human overseer. Protocols that give adequate oversight at a moderate gap therefore fail at that one.

Does it work?

Does it follow?: likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
Do the premises hold?: 2 supported

Granting its premises, failure at a superintelligent gap becomes much more probable, though not certain: the measured decline covers narrow capability ranges in small games, debate was a partial exception, chained figures are extrapolations, and a protocol could flatten the curve. The argument bears only on the claim's second half. It turns on whether the decline in oversight success with the capability gap, supported as a default tendency for unaided oversight, extends far beyond the gaps measured, and whether arguments too complex to refute, supported for standard debate, can be designed away.

Premises

SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →AI oversight success rates decline as the capability gap between overseer and overseen system grows.
SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →In AI debates, dishonest debaters can win by making arguments too complex for opponents to refute.

Where it is made

Passages where sources make, criticize or mention this argument. They record where it appears, not how strong it is, and none has precedence over another.

No source is recorded as making it.

Earlier ratings

Nov 11, 2026likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
Granting its premises, failure at a superintelligent gap becomes much more probable, though not certain: the measured decline covers narrow capability ranges in small games, debate was a partial exception to it, and a protocol could flatten the curve. The argument bears only on the claim's second half and gives the first half no support. It turns on whether the decline in oversight success with the capability gap, which is supported as a default tendency, extends far beyond the gaps measured, and on whether arguments too complex to refute, supported for standard debate protocols, can be designed away.