The argument from agent-strength sweeps
The argument
When agents of differing capability attempt a hidden side task under the same monitor, the more capable agents finish it unflagged more often. If that reflects more capable agents concealing misbehavior better from a fixed monitor, and not only their completing the side task more often, then strengthening the agent while holding the monitor fixed lowers the share of misbehavior the monitor detects, so detection falls as the advantage grows from the agent's side.
Does it work?
- Does it follow?
- likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
- Do the premises hold?
- 1 supported
Granting its premises the conclusion follows, so the argument stands or falls with whether more capable agents really conceal misbehavior better. That premise is judged more likely true than not, but on weak footing: the main observation, more capable agents finishing side tasks unflagged more often, counts success and evasion together, and the one test that separated them, in a simple code-backdoor game, found no gain in concealment. Indirect support comes from staged attack construction, which made the same model's attacks much harder to catch. The argument therefore lends the claim moderate support from the agent's side, and the claim's credence rests chiefly on the monitor-side evidence, which does not depend on this premise.
Premises
- SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →More capable AI agents better conceal misbehavior from a fixed AI monitor.
Where it is made
Passages where sources make, criticize or mention this argument. They record where it appears, not how strong it is, and none has precedence over another.
- Early work on monitorability evaluationsmakes itleaves a premise unstatedThe passage relies on a premise the inference needs without saying it.constitution →
More capable agents seem better at accomplishing side objectives while remaining undetected by the monitor.
Megan Kinniment, Seraphina Nix, Thomas Broadley, Hjalmar Wijk, Neev Parikh · METR · 2026-01-22
Earlier ratings
- Nov 11, 2026likely if the premises holdIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
Granting its premises the conclusion follows, so the argument stands or falls with whether more capable agents really conceal misbehavior better, which has not yet been assessed and on which the evidence is mixed. The observed pattern, more capable agents finishing side tasks unflagged more often, comes from a small prototype evaluation whose measure counts success and evasion together. Without the concealment premise the same pattern would show only that stronger agents misbehave more competently.