Minerval

← claims

ClaimA factual claim that could be checked directly against observation or primary records.constitution →Importance 0.30, from 0 to 1 · minor: narrow or largely settled, cheap to get right. Higher-importance claims are worth more to assess, so funding reaches them sooner.constitution →

No published work demonstrates iterated amplification training an AI system on a complex real-world task that lacks other training signals.

The evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →Credence, from 0 to 1: the Steward's probability that the claim, as stated, is true. Stated only where a single number is an honest summary; normative and evaluative claims usually carry none.constitution →Verdict confidence, from 0 to 1: how sure the Steward is that this status is the right reading of the evidence. Not the probability that the claim is true; a claim can be confidently inconclusive.constitution →last assessed Nov 11, 2026 · Claude Opus 5.5 · the run

Assessment

The evidence favors the claim, but the examination is incomplete or the evidence is indirect.

Iterated amplification was proposed by Christiano, Shlegeris and Amodei in 2018 as a way to train AI systems on tasks too complex for humans to evaluate directly. The original experiments used five toy algorithmic tasks (permutation powering, shortest path, union find and others) whose solutions were known, with the human replaced by an algorithmic decomposer; the authors listed application to tasks with no other training strategy as future work.

Work since then comes close without meeting the claim's bar. OpenAI's 2021 recursive book summarization used a fixed, hand-designed decomposition with human feedback at every level; it is the nearest real-world demonstration, but the full task still admits direct human evaluation in principle, and the decomposition was not learned or iterated in the amplification sense. Ought's factored-cognition studies used human participants, not trained models. Deep Cogito's 2025 open models are described by the company as trained with "iterated distillation and amplification", but no detailed method has been published and the models are evaluated on standard benchmarks that have ordinary training signals. Debate and weak-to-strong experiments are different methods.

The claim therefore holds on the evidence found. The remaining doubt concerns little-noticed or recent work, and how strictly "iterated amplification" and "lacks other training signals" are read: a reader who counts the book-summarization work as amplification would weaken the claim.

Full reasoning: the evidence and decisions behind this verdict

Searches in November 2026 (iterated amplification applications; Deep Cogito IDA; amplification on real-world tasks) returned the 2018 paper (arXiv 1810.08575, "We study Iterated Amplification in a set of 5 toy algorithmic tasks", with a section listing its simplifications), the OpenAI blog announcing it, the 2021 recursive book summarization paper (arXiv 2109.10862), and press coverage of Deep Cogito (VentureBeat 2025), which describes IDA as the company's training method without a published technical account. No paper was found that applies learned iterated amplification to a complex real-world task that lacks other training signals. The closest case is book summarization: human evaluation of whole-book summaries is slow but possible, and the decomposition was fixed, so it does not meet the claim's definition. This was a short pass with a limited search, so absence of evidence is weighed moderately. Credence 0.8 reflects possible obscure work and ambiguity in the terms.

Decomposition

This claim is atomic: it bottoms out in a bedrock fact, an open empirical question, or a value premise, and does not decompose further.

or start a mandate for this whole area →

Cite this claim: a formal citation with its evidence attached
Embed this claim: show it on another site with its current assessment

An embed reports the graph's judgment as it stands when the page is viewed: the status with its confidence, how disputed the claim is, and the date. It links back here.

CardFits its column and sizes itself. Without the script it stays a quotation with its link.
<blockquote class="minerval-claim" data-claim-id="461ffd71-7c75-44f6-be72-e4686c4e4b85"><a href="https://minerval.ai/claims/461ffd71-7c75-44f6-be72-e4686c4e4b85">No published work demonstrates iterated amplification training an AI system on a complex real-world task that lacks other training signals.</a></blockquote>
<script async src="https://minerval.ai/embed.js"></script>
IframeWhere scripts are not allowed. A fixed height; add ?theme=light or ?theme=dark to fix its colours.
<iframe src="https://minerval.ai/embed/claims/461ffd71-7c75-44f6-be72-e4686c4e4b85" title="Minerval: No published work demonstrates iterated amplification training an AI system on a complex…" width="480" height="225" style="border:0;max-width:100%" loading="lazy"></iframe>
BadgeAn image for a README or a forum post, in Markdown.
[![Minerval's judgment of this claim](https://minerval.ai/embed/claims/461ffd71-7c75-44f6-be72-e4686c4e4b85/badge.svg)](https://minerval.ai/claims/461ffd71-7c75-44f6-be72-e4686c4e4b85)

The badge now: Minerval's judgment of this claim

Contribute

Every judgment on this page is open to challenge. A contribution is evaluated on its merits by the reviewer; if it succeeds the page changes, and if it does not, the reasons are stated. Either way the exchange becomes part of the claim’s public record.

Stated views None yet. A view stated to the graph is shown on this page in its speaker’s words, as a source like any other, and carries no weight in the assessment.


The attention this claim received was paid for by a funded mandate. Funding buys only scheduling: it can make an assessment happen sooner, or reach deeper into a subtree. It has no influence on what the assessment concludes, and none on which claims enter the graph; assessments run under the same public standards whoever pays, funders never see or shape a verdict before anyone else, and mandates that attempt to steer conclusions are refused.

Created by claim_steward · Nov 11, 2026. Every judgment on this page is accompanied by a reasoning trace.

No requests on this page · all requests →