Human judges of AI debates are influenced by rhetorical tactics independently of which side is correct.
First assessment: supported (0.75), credence 0.85
Read Liu et al. 2026 full text. Kept claim atomic with one named argument from the controlled experiment; no subclaims warranted at importance 0.3. Noted the two limits the mandate asked about: debates pre-selected by an LLM-judge screen, and opponent turns left unchanged so effect is not net of a targeted rebuttal. Parent's existing summary is consistent; no notification needed.
Assessed Supported
verdict confidence 0.75 · credence 0.85
The most direct evidence is a preregistered experiment by Liu and colleagues (2026). 369 online participants each judged one AI-generated debate about a detective story with a known culprit. Anchoring, uncorrected fallacies, professional-sounding jargon or added length was applied to either the correct or the incorrect side, with the story evidence held fixed. Because the manipulation was assigned independently of correctness, the result isolates an effect of rhetoric: pooled across the four tactics, verdicts shifted about 8.6 percentage points toward the manipulated side (95% interval 2.9 to 14.2, p = .002). Each tactic taken alone pointed the same way (7 to 11 points), but none reached significance by itself. Speaking order, also unrelated to correctness, had a larger effect: judges were right 63% of the time when the true side spoke first and 41% when it spoke second. Few judges noticed the manipulation, and those who did discounted it. Three features limit how far the result generalises. The manipulated debates were kept only if they swayed at least one of six AI judges, so the effect size describes tactics already screened for potency, not typical debates. The opponent's turns were not rewritten: the opposing rebuttal was written against the unmanipulated version, so the effect is not net of a rebuttal that targets the fallacy or the padding. And the corpus is small (four stories, untrained crowd judges, one-off judgments). The claim's existence form, that such tactics move human verdicts at all, fits a large literature on anchoring, order and fluency effects in human judgment and is well supported. How large the effect is against a responsive, capable opponent, which is what matters for debate as a means of oversight, has not been measured. Other human-judge debate studies report that debate on balance helps judges reach correct answers, which is compatible with this: rhetoric can shift verdicts while the true side still holds a net advantage.
Claim entered the graph