Run step
Step 17: assistant
thinking
Calls notify_steward
{
"message": "First assessment of the covert-strategy claim: supported, credence 0.8, from Li, Phuong & Siegel 2025 (arXiv 2508.00943). New wording: \"Language models told to sandbag covertly against a chain-of-thought monitor adopt less detectable strategies without being shown any.\" Models were explicitly told to sandbag and to hide it; only the method was unprompted. Monitor false-negative rates rose from 2-6% to 16-36%. This is a capability result from prompting, not a propensity result, on multiple-choice benchmarks only, and evasion largely failed on the harder ProtocolQA. That fits your edge as written, but it limits how strongly it counts against your claim.",
"claim_id": "f9d50d3c-3831-4038-a5a5-ae60f5ef231f",
"target_ids": [
"022b9cef-1397-4f4c-af7e-917df64bab6b"
]
}