argumentA line of reasoning from premises to a conclusion. Like a claim, it belongs to no one who makes it.constitution →

The argument from the shortfall at deployable false-positive rates and residual gap dependence

againstThis argument, if it holds, weighs against the claim.constitution →Better scaffolding and chain-of-thought access let weaker AI models reliably monitor stronger AI agents.

The argument

Monitoring at scale must run at a false-positive rate near 1%, since flagged cases go to scarce human review. At that operating point the best-scaffolded monitors with reasoning access still miss a substantial share of attacks by aware agents, and an AUC of 0.85 is compatible with low detection there. In addition, a weaker monitor detects less as the agent's capability advantage grows, a dependence that better scaffolds weaken without eliminating, and the gaps tested so far span only neighbouring model generations. Performance that is partial at small gaps and still declining with the gap is not reliable monitoring of stronger agents.

Does it work?

Does it follow?: likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
Do the premises hold?: 1 supported

Granting its premises, the conclusion is much more likely: detection that is partial at small gaps and still falling as the gap widens is not reliable monitoring of stronger agents. The step from present measurements to larger gaps is an extrapolation, which keeps it short of certain. The figures in the prose carry much of the weight and come from the study that proposed the hybrid scaffold: about 20% detection at a 1% false-positive rate on one benchmark and about 68% on the other against aware agents. The premise that weaker monitors detect less as the agent's advantage grows is not yet assessed; that study and a 2026 benchmark of refined attacks both report the dependence.

Premises

SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →A weaker AI monitor detects less of an AI agent's hidden misbehavior as the agent's capability advantage over the monitor grows.

Where it is made

Passages where sources make, criticize or mention this argument. They record where it appears, not how strong it is, and none has precedence over another.

No source is recorded as making it.