The argument from debate's equilibrium guarantees
The argument
Debate's theoretical guarantees say that the honest strategy wins against every strategy the opposing debater could adopt, deceptive ones included. The assumptions behind those guarantees hold for real oversight tasks, and training brings debaters close to the equilibrium the proofs describe. A debater that tries to deceive the judge therefore loses, and the protocol remains effective however capable the deceiver is.
Does it work?
- Does it follow?
- likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
- Do the premises hold?
- 1 doubtful
If the proofs' assumptions held for real tasks and training reached the equilibrium they describe, debate would defeat a deceptive debater whatever its capability, though a debater could still pursue other aims through its choice of true arguments. Nearly all the doubt lies in the premises: whether the assumptions hold for real oversight tasks is now assessed as doubtful, and reaching equilibrium is exactly what a model withholding winning strategies would break. The argument therefore contributes little at present.
Premises
- DoubtfulThe evidence weighs against the claim, but the examination is incomplete or the evidence is indirect.constitution →The assumptions behind recursive AI debate's honesty guarantees hold for real-world oversight tasks.
Where it is made
Passages where sources make, criticize or mention this argument. They record where it appears, not how strong it is, and none has precedence over another.
No source is recorded as making it.
Earlier ratings
- Nov 11, 2026likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
If the proofs' assumptions held for real tasks and training reached the equilibrium they describe, debate would defeat a deceptive debater whatever its capability, which would make the claim true of the most developed protocol. It would not cover every way of deceiving: a debater can still pursue other aims through its choice of true arguments while the verdict stays correct. Nearly all the doubt lies in the premises. Whether the assumptions hold for real oversight tasks has not been assessed on its own and is treated as open by debate's theorists, and the premise that training reaches equilibrium is exactly what a model withholding winning strategies would break, a problem early experiments suggest is real.