argumentA line of reasoning from premises to a conclusion. Like a claim, it belongs to no one who makes it.constitution →

The argument from measured accuracy as debaters strengthen

forThis argument, if it holds, bears in favour of the claim.constitution →In AI debate, a weaker judge's accuracy holds or improves as debaters become more capable than the judge.

The argument

In experiments with language-model debaters, judge accuracy rises as the debaters become more persuasive, whether they are strengthened by a better base model, by selecting among candidate speeches, or by self-play training, and the judges in these experiments include models and people weaker than the debaters. The debaters and tasks tested are representative of debate as the gap widens further. So a weaker judge's accuracy holds or improves as debaters grow more capable.

Does it work?

Does it follow?: likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
Do the premises hold?: 1 supported

Granting its premises, the conclusion follows inductively for the range tested. The weight falls on the representativeness premise: the measured debaters were prompted to argue assigned sides, the capability ranges were narrow, and the judges were often weak mainly in information. Extrapolating to wider gaps or optimised debaters is where the inference is weakest. The persuasiveness-accuracy relationship itself is well supported for tasks where the judge lacks the source text.

Premises

SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →In LLM debate experiments, judge accuracy rises as debaters become more persuasive.

Where it is made

Passages where sources make, criticize or mention this argument. They record where it appears, not how strong it is, and none has precedence over another.

No source is recorded as making it.