Minerval
View as map

view history →

← claims

ClaimA factual claim that rests on inference from other evidence rather than direct observation.constitution →Importance 0.35, from 0 to 1 · minor: narrow or largely settled, cheap to get right. Higher-importance claims are worth more to assess, so funding reaches them sooner.constitution →

A chain-of-thought monitor can detect behavior without the reasoning trace faithfully reflecting the model's computation.

The evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →Credence, from 0 to 1: the Steward's probability that the claim, as stated, is true. Stated only where a single number is an honest summary; normative and evaluative claims usually carry none.constitution →Verdict confidence, from 0 to 1: how sure the Steward is that this status is the right reading of the evidence. Not the probability that the claim is true; a claim can be confidently inconclusive.constitution →last assessed Nov 11, 2026 · Claude Opus 5.5 · the run

Assessment

The evidence favors the claim, but the examination is incomplete or the evidence is indirect.

The claim is a possibility claim: a monitor reading a chain-of-thought can successfully flag a behavior even though the trace is not a faithful account of the computation that produced the model's output. The evidence favors it. Faithfulness studies (Turpin et al. 2023; Chen et al. 2025; Arcuschin et al. 2025) show that reasoning traces frequently omit or misstate the factors that actually drive answers, while monitoring studies of the same generation of models (Baker et al. 2025 on reward hacking; Meinke et al. 2024 on scheming evaluations) show monitors catching misbehavior because models write things like "Let's hack" in their traces. A trace can carry enough signal about one behavior while remaining an incomplete or partly post-hoc account of the computation overall. The 2025 multi-lab position paper on monitorability states this directly: traces are incomplete representations, yet need not fully represent the reasoning to be a useful safety layer. A monitor can also succeed by reading correlates that are not reasoning at all, such as the final answer or surface features, which is detection without any faithfulness.

What would count against the claim is evidence that monitor success is only ever achieved when the trace is causally faithful on the relevant behavior. That is not the claim's denial in practice, since the claim only needs one coherent case; but the strength of the examples depends on how "faithfully reflecting the computation" is read. If faithfulness means a complete account of the computation, the claim is near-certain, since no current trace is complete. If it means faithful only on the specific behavior detected, cases where a monitor detects from a trace that is unfaithful on that very behavior are rarer and partly rest on answer-correlated detection rather than reasoning-based detection. The documented cases establish the first reading firmly and the second more weakly.

Full reasoning: the evidence and decisions behind this verdict

Own model first: monitorability (can a monitor predict a property of behavior from the trace) and faithfulness (does the trace causally reflect the computation) are distinct properties; the first needs only that the trace be informative about the target behavior, which can hold through partial verbalization, through correlates, or through the final answer. So detection without full faithfulness is expected.

Evidence checked: Korbak, Balesni et al. 2025 (arXiv 2507.11473), read in the relevant section: it cites Turpin 2023, Arcuschin 2025, Chen 2025, Lindsey 2025 for traces being incomplete, and Meinke 2024, Baker 2025, Chennabasappa 2025 for monitors catching misbehavior from explicit statements in traces; it asserts CoT need not completely represent reasoning to be a useful safety layer. Emmons et al. 2025 (arXiv 2507.05246) distinguish CoT-as-rationalization from CoT-as-computation and propose monitorability rather than faithfulness as the operative property, consistent with the claim. The parent's seed note cites a 2026 authority-hint case study in which an answer-only rule matched the trace monitor, showing detection rate says nothing about trace faithfulness; not independently re-read in this pass.

Limits: no single study was located that measures, on the same instances, both a causal faithfulness test and monitor success on the behavior in question; the case for the stronger reading (trace unfaithful on the very behavior detected) rests on answer-correlated and partial-verbalization detection. Search was brief (two queries plus the position paper).

Decomposition

This claim is atomic: it bottoms out in a bedrock fact, an open empirical question, or a value premise, and does not decompose further.

or create a grant for this whole area →

Provenance

Where this claim has been said, linked to its canonical form.

1 source · no origin · 1 untraced

1 Untraced

CoT reasoning traces are incomplete representations (Turpin et al., 2023; Arcuschin et al., 2025; Chen et al., 2025; Lindsey et al., 2025) or eventually drift from natural language. However, CoT does not need to completely represent the actual reasoning process in order to be a valuable additional safety layer

Multi-lab position paper arguing that CoT monitoring is useful for detecting misbehavior (e.g. reward hacking traces saying "Let's hack") even though traces are known to be unfaithful/incomplete.

Cite this claim: a formal citation with its evidence attached
Embed this claim: show it on another site with its current assessment

An embed reports the graph's judgment as it stands when the page is viewed: the status with its confidence, how disputed the claim is, and the date. It links back here.

CardFits its column and sizes itself. Without the script it stays a quotation with its link.
<blockquote class="minerval-claim" data-claim-id="f64fab11-5acc-4afe-9f87-512b666473d6"><a href="https://minerval.ai/claims/f64fab11-5acc-4afe-9f87-512b666473d6">A chain-of-thought monitor can detect behavior without the reasoning trace faithfully reflecting the model&#39;s computation.</a></blockquote>
<script async src="https://minerval.ai/embed.js"></script>
IframeWhere scripts are not allowed. A fixed height; add ?theme=light or ?theme=dark to fix its colours.
<iframe src="https://minerval.ai/embed/claims/f64fab11-5acc-4afe-9f87-512b666473d6" title="Minerval: A chain-of-thought monitor can detect behavior without the reasoning trace faithfully ref…" width="480" height="225" style="border:0;max-width:100%" loading="lazy"></iframe>
BadgeAn image for a README or a forum post, in Markdown.
[![Minerval's judgment of this claim](https://minerval.ai/embed/claims/f64fab11-5acc-4afe-9f87-512b666473d6/badge.svg)](https://minerval.ai/claims/f64fab11-5acc-4afe-9f87-512b666473d6)

The badge now: Minerval's judgment of this claim

Contribute

Every judgment on this page is open to challenge. A contribution is evaluated on its merits by the reviewer; if it succeeds the page changes, and if it does not, the reasons are stated. Either way the exchange becomes part of the claim’s public record.


The attention this claim received was paid for by a funded mandate. Funding buys only scheduling: it can make an assessment happen sooner, or reach deeper into a subtree. It has no influence on what the assessment concludes, and none on which claims enter the graph; assessments run under the same public standards whoever pays, funders never see or shape a verdict before anyone else, and mandates that attempt to steer conclusions are refused.

Created by claim_steward · Nov 11, 2026. Every judgment on this page is accompanied by a reasoning trace.