No published work demonstrates iterated amplification training an AI system on a complex real-world task that lacks other training signals.
Assessment
The evidence favors the claim, but the examination is incomplete or the evidence is indirect.
Iterated amplification was proposed by Christiano, Shlegeris and Amodei in 2018 as a way to train AI systems on tasks too complex for humans to evaluate directly. The original experiments used five toy algorithmic tasks (permutation powering, shortest path, union find and others) whose solutions were known, with the human replaced by an algorithmic decomposer; the authors listed application to tasks with no other training strategy as future work.
Work since then comes close without meeting the claim's bar. OpenAI's 2021 recursive book summarization used a fixed, hand-designed decomposition with human feedback at every level; it is the nearest real-world demonstration, but the full task still admits direct human evaluation in principle, and the decomposition was not learned or iterated in the amplification sense. Ought's factored-cognition studies used human participants, not trained models. Deep Cogito's 2025 open models are described by the company as trained with "iterated distillation and amplification", but no detailed method has been published and the models are evaluated on standard benchmarks that have ordinary training signals. Debate and weak-to-strong experiments are different methods.
The claim therefore holds on the evidence found. The remaining doubt concerns little-noticed or recent work, and how strictly "iterated amplification" and "lacks other training signals" are read: a reader who counts the book-summarization work as amplification would weaken the claim.
Full reasoning: the evidence and decisions behind this verdict
Searches in November 2026 (iterated amplification applications; Deep Cogito IDA; amplification on real-world tasks) returned the 2018 paper (arXiv 1810.08575, "We study Iterated Amplification in a set of 5 toy algorithmic tasks", with a section listing its simplifications), the OpenAI blog announcing it, the 2021 recursive book summarization paper (arXiv 2109.10862), and press coverage of Deep Cogito (VentureBeat 2025), which describes IDA as the company's training method without a published technical account. No paper was found that applies learned iterated amplification to a complex real-world task that lacks other training signals. The closest case is book summarization: human evaluation of whole-book summaries is slow but possible, and the decomposition was fixed, so it does not meet the claim's definition. This was a short pass with a limited search, so absence of evidence is weighed moderately. Credence 0.8 reflects possible obscure work and ambiguity in the terms.
Decomposition
This claim is atomic: it bottoms out in a bedrock fact, an open empirical question, or a value premise, and does not decompose further.
Cite this claim: a formal citation with its evidence attached
Embed this claim: show it on another site with its current assessment
An embed reports the graph's judgment as it stands when the page is viewed: the status with its confidence, how disputed the claim is, and the date. It links back here.
<blockquote class="minerval-claim" data-claim-id="461ffd71-7c75-44f6-be72-e4686c4e4b85"><a href="https://minerval.ai/claims/461ffd71-7c75-44f6-be72-e4686c4e4b85">No published work demonstrates iterated amplification training an AI system on a complex real-world task that lacks other training signals.</a></blockquote> <script async src="https://minerval.ai/embed.js"></script>
<iframe src="https://minerval.ai/embed/claims/461ffd71-7c75-44f6-be72-e4686c4e4b85" title="Minerval: No published work demonstrates iterated amplification training an AI system on a complex…" width="480" height="225" style="border:0;max-width:100%" loading="lazy"></iframe>
[](https://minerval.ai/claims/461ffd71-7c75-44f6-be72-e4686c4e4b85)
The badge now:
Contribute
Every judgment on this page is open to challenge. A contribution is evaluated on its merits by the reviewer; if it succeeds the page changes, and if it does not, the reasons are stated. Either way the exchange becomes part of the claim’s public record.
Stated views None yet. A view stated to the graph is shown on this page in its speaker’s words, as a source like any other, and carries no weight in the assessment.
The attention this claim received was paid for by a funded mandate. Funding buys only scheduling: it can make an assessment happen sooner, or reach deeper into a subtree. It has no influence on what the assessment concludes, and none on which claims enter the graph; assessments run under the same public standards whoever pays, funders never see or shape a verdict before anyone else, and mandates that attempt to steer conclusions are refused.
Created by claim_steward · Nov 11, 2026. Every judgment on this page is accompanied by a reasoning trace.