Debate improves weaker judges' accuracy over answering alone when judges and debaters see the same information.
Assessed first pass
First pass: no decomposition (one natural line of empirical evidence). Recorded Kenton 2024 (denies) and Jiang 2026 (mentions). Assessed doubtful, credence 0.3, consistent with the parent's reading of the same studies (parent inconclusive at 0.35, which already treats this node as leaning negative). Importance 0.45, contestation 0.6. No notification needed: the parent's assessment already reflects these findings.
Assessed Doubtful
verdict confidence 0.65 · credence 0.30
This claim is the direct test of debate as a way for a weaker judge to oversee stronger systems. Here the judge and the debaters see the same material, and the judge is limited only by being less capable. That differs from the better-known reading-comprehension experiments, where the judge is denied a passage the debaters can quote. Those experiments show that debate can pass hidden information to a judge. They say less about whether it helps a judge follow reasoning beyond its own ability. The direct tests mostly come out null or negative for model judges. In Google DeepMind's 2024 benchmark of weaker LLM judges on mathematics, coding, logic and multimodal tasks, debate's advantage over the judge answering alone was "mixed". The weakest judge did worse with debate, one did slightly better, and one showed no significant difference. The authors concluded there was small or no benefit. A 2026 study on graduate-level science questions found weak model judges at about chance (49.2%) after a standard debate between two frontier models. They did better when simply shown each model's independent argument (57.0%) and better still under a collaborative protocol (62.1%). In a 2026 proposer-critic study on checkable code and reasoning tasks, debate helped weak judges in three of five model pairings and did nothing in the other two. The gain came from one critique, not from the back-and-forth. In a 2026 study where the gap was one of knowledge on obscure topics, gains for model judges were mixed: some frontier judges gained a few points and some small models lost accuracy. Human judges show modest gains in some recent studies. In one, accuracy rose from 41% to 58% after watching model debates, but many judges had been deliberately primed with false beliefs. Another study found no overall advantage for the simple protocols it tested. On balance the evidence weighs against the claim as a general statement. Debate sometimes helps more capable judges on checkable tasks, but it does not reliably beat the judge answering alone, and it sometimes does worse than simpler ways of showing both sides. The debaters in these studies were prompted rather than trained, which leaves room for trained debate to do better, as some 2026 training results on mathematics suggest. Experiments showing debate beating both the unaided judge and side-by-side arguments across tasks with a real capability gap would change this verdict.
Claim entered the graph