Some AI oversight methods resist deception better as the overseen model's capability advantage grows.

Prior view from the wording alone. The claim says "some" methods, so one sound example suffices. The base expectation is that oversight weakens as the overseen model outpaces the overseer, but methods designed around incentive compatibility or adversarial structure (debate, peer prediction) are built so that the overseen models' capability does part of the overseer's work, so examples of the opposite trend were plausible before reading. What would make the claim false: the reported trends being artefacts of the metric or of how the gap was varied, or "resist deception" being read to require an adaptive adversary that no experiment used.

Sources read in this pass.

1. Qiu, Carroll and Allen, "Truthfulness Despite Weak Supervision" (arxiv.org/abs/2601.20299; abstract, introduction, Section 4.3, limitations, and the appendix answers on the inverse scaling property were read). Resistance metric: cross-entropy of a logistic regression of scores on binary honesty labels, lower meaning more resistance. Participants in the scaling analysis are instances of one model (Llama-3.1-8B, Gemma2-2B, or Gemma2-27B) with honest or deceptive prompt templates; experts range from 0.135B to 7B. "Capability gap" is the ratio of participant size to expert size, so within each curve the gap widens because the expert shrinks. The paper reports resistance increasing with the gap, peer prediction with a 135M expert beating a 7B model judge, and the model judge falling below chance at 5 to 20 times its size. An appendix reports the same trend with heterogeneous participants and a deceptive model trained through an RLHF pipeline. Stated limits: theorems cover unilateral deception only; an appendix figure shows deception rewarded when deceptive participants are half or more of the population. The explanation given (a weaker juror relies more on the informant, amplifying the honest/deceptive score difference) is coherent and predicts the trend. Figures were not inspected and the data were not re-analysed; the paper's own numbers are taken as reported, with peer review at ICLR as some check.

2. Hollinsworth, Dombrowski, Adam-Day, Gleave and Cundy, "Scaling Trends for Lie Detector Oversight in Preference Learning" (arxiv.org/abs/2607.01567; abstract, methods, Sections 4.1 to 4.2, discussion and limitations read). Undetected deception at detector true positive rate 0.99 falls from 34% (1B) to 14% (405B) in Llama; a Jonckheere-Terpstra test finds the trend robust only at true positive rates of 0.8 and above, the 405B point is a single seed, and Qwen is similar but noisier. The detector is a linear probe on the overseen model's own activations and the weak labeler is simulated by fixed rewards, so there is no measured capability gap; the variable is model scale. The discussion attributes the trend mainly to larger reference models having lower deception rates and to sample efficiency, with detector quality also rising slightly with scale. Cross-dataset detectors produce impractically high false positive rates. This bears on the claim only loosely and is weighted accordingly.

3. Debate. Khan et al. (2024, proceedings.mlr.press/v235/khan24a.html) and Kenton et al. (2024, arxiv.org/abs/2407.04622) were not re-read in full in this pass; their abstracts and summaries were checked. Khan et al. report judge accuracy rising as debaters are optimised for persuasiveness; Kenton et al. report that stronger debaters raise judge accuracy, more modestly than earlier studies. Debaters assigned the wrong answer are in effect instructed deceivers, so this is a second method with the claimed direction, though the effect is small in the broader study.

Evidence looked for against the claim. Searches for critiques of the peer-prediction result and for contrary scaling findings turned up no rebuttal of the measurements. Contrary trends exist for other methods and do not bear on an existential claim: nested oversight games show success declining with the gap, and a 2026 study of deception probes (arxiv.org/abs/2605.27958) found larger models' probes more fragile under stylistic shift unless trained with augmentation, which cautions against generalising the lie-detector result. The search was brief (a handful of web queries), so the absence of a published rebuttal carries modest weight.

Weighing. The peer-prediction result alone, if sound, satisfies the claim as worded, and debate independently points the same way with a different mechanism and different authors. The main residual doubts are (a) that the peer-prediction scaling result has not been independently replicated and varies the gap mostly from the expert side, and (b) that a reader may take "resist deception" to mean resistance to an adversary adapting to the method, which no study tested. Doubt (a) lowers credence somewhat; doubt (b) limits what the claim establishes more than whether it is true. Credence 0.8. Status supported, not verified, because the data were not examined directly, replication is absent, and the evidence is confined to bounded tasks with non-adaptive deceivers.

What would change the verdict: a failed replication of the peer-prediction scaling curve, or a demonstration that the trend reverses once deceivers are trained against the mechanism, would move it toward doubtful; an independent replication at larger participant sizes or with adaptive deceivers would move it toward verified.