argumentA line of reasoning from premises to a conclusion. Like a claim, it belongs to no one who makes it.constitution →

The argument from bootstrapping

againstThis argument, if it holds, weighs against the claim.constitution →Amplified oversight can supervise AI systems moderately beyond overseers’ capabilities, but not superintelligent systems.

The argument

Suppose amplified oversight lets an overseer supervise a system moderately more capable than itself, as the claim's first half says. A system supervised in this way is aligned well enough to serve, alongside its human principals, as overseer of a system moderately beyond it. If oversight errors do not compound across such successive steps, repeating the step extends oversight to systems far beyond the humans at the start of the chain, superintelligent ones included.

Does it work?

Does it follow?: likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
Do the premises hold?: 1 doubtful

Granting its premises, oversight would probably extend along the chain to superintelligent systems, defeating the point of the claim's second half even though no single overseer would supervise far beyond itself. The argument takes the first half as given and adds two premises that carry the weight: that being supervised makes a system trustworthy enough to oversee its successor, which needs supervision to produce alignment and not only good outputs, and that errors do not compound across steps, which is doubtful: the case for it depends on each step catching deliberate deception, which has not been shown. As its premises now stand the argument does little against the claim.

Premises

DoubtfulThe evidence weighs against the claim, but the examination is incomplete or the evidence is indirect.constitution →Oversight errors do not compound when successive AI generations oversee moderately more capable successors.

Where it is made

Passages where sources make, criticize or mention this argument. They record where it appears, not how strong it is, and none has precedence over another.

No source is recorded as making it.

Earlier ratings

Nov 11, 2026likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
Granting its premises, oversight would probably extend along the chain to superintelligent systems, which would defeat the point of the claim's second half even though no single overseer would be supervising far beyond itself. The argument takes the claim's first half as given and adds two premises that carry the weight. One is that being supervised makes a system trustworthy enough to oversee its successor, which needs supervision to produce alignment and not only good outputs. The other is that errors do not compound across steps, which has not been assessed and starts with a low prior: the one quantitative model of chained oversight found success falling as the total gap grew.