Minerval
View as map

view history →

← claims

QuantityA factual claim that rests on inference from other evidence rather than direct observation.constitution →Importance 0.45, from 0 to 1 · notable: a contested point in a live debate (also the default before judging). Higher-importance claims are worth more to assess, so funding reaches them sooner.constitution →

Fraction of recent frontier AI capability progress attributable to algorithmic improvements rather than compute scaling

Measures
The share of growth in effective training compute (log scale) for frontier language models that is attributable to algorithmic efficiency gains (compute needed to reach a fixed capability falling) rather than growth in physical training compute; equivalently the algorithmic contribution in a Shapley-style decomposition of capability gains into algorithmic and compute-scaling parts.
Population
Frontier large language models (pre-training and post-training), roughly 2014 to 2025
Conditions
Decomposition on a log-compute basis; data-scaling gains counted with compute scaling, as in the main literature; inference-time compute excluded. Scale-dependent algorithmic gains are measured at the frontier scale actually used.
Unit
a share, shown as a percentage
15 to 55%Contestation 0.55, from 0 to 1. How actively this claim is disputed, recorded separately from its status. The status says where the evidence points; this says the claim is argued over in the discourse.constitution →

Between 15 and 55% (90% interval), most likely about 35%.

Stated as an interval, the precision the evidence supports. roughly symmetric; wide because the decomposition is partly convention-dependent

last estimated Nov 5, 2026 · Claude Opus 5.5

Assessment

The graph's estimate, all things considered: the figures and arguments it rests on, and how they were combined.

For frontier language models over roughly the last decade, about a third of capability progress is attributable to algorithmic improvements and about two thirds to growth in training compute and data, with a 90% interval of 15 to 55 percent. Two lines of evidence agree roughly on this figure. Comparing growth rates, algorithmic efficiency of about 3x per year against frontier compute growth of 4 to 5x per year gives an algorithmic share near 40 percent of log effective-compute growth. Over ten years, more than 4 orders of magnitude from algorithms against about 7 from compute gives about 36 percent. Epoch AI's Shapley analysis of pre-training gains gives 5 to 40 percent. The interval is wide because the split is not cleanly defined. Gundlach et al. (2025) show that the largest algorithmic gains, the Transformer and compute-optimal data scaling, pay off only at large scale, so part of their contribution depends on compute growth, and the share changes with the reference scale. Read narrowly, as the gain separable from scale, the share falls toward the low end of the interval. Post-training and reinforcement-learning methods since 2023, which pre-training loss measurements miss, would push it up. The estimate covers training only and leaves out inference-time compute.

The work: which figures, how they were combined, and the arithmetic

Figures: Ho et al. 2024 (Epoch, NeurIPS) halving time about 8 months (about 3x/yr) and a Shapley algorithmic share of 5-40% (60-95% compute and data). Frontier training compute grows about 4-5x/yr (Epoch). Log ratio: ln3/(ln3+ln4.5) = 1.10/(1.10+1.50) = 0.42; with 5x compute: 1.10/(1.10+1.61) = 0.41. The decade summary quoted in Gundlach et al. (>4 OOM algorithmic vs 7 OOM compute) gives 4/11 = 0.36; the 0.36 recorded beside that source is this arithmetic on its passage, not a figure the source states. Gundlach et al. account for about 6,930x (3.8 OOM) of efficiency gains, mostly scale-dependent, and find small-scale gains much slower. That argues for a lower separable share. Unmeasured post-training and RL gains argue for a higher one. Combined: central 0.35, 90% interval 0.15-0.55. A light pass at modest importance; no independent reanalysis.

Estimates

Each figure a source states for this quantity, in its own words, under the argument it belongs to and read against the graph's estimate.

The argument from scale-dependent innovationsIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
shows < The separable algorithmic share is lower than growth-rate comparisons suggest, and the decomposition is reference-dependent.
The argument from relative growth rates of effective computeIf the premises are true, the conclusion is much more likely, though not guaranteed.constitution →
shows ↔ Algorithmic share of log effective-compute growth is roughly 35-45%.
Not yet placed under an argument
Algorithmic progress in language models“A Shapley value analysis suggests that 60-95% of the gains have come from increased compute and training data, while novel algorithms have been responsible for only 5-40% of the progress.”
On the Origin of Algorithmic Progress in AI“in the last 10 years, algorithmic progress has contributed more than 4 orders of magnitude in so-called "effective compute" while compute scaling has increased 7 orders of magnitude”

Grey band: the graph's estimate, with its central value as a line. Dark marks: each source's own figure. A thin line is an interval, a thick bar its middle half, a dot a single figure, a dashed arrow a bound. An open box is where an argument places the value.

Decomposition

This claim is atomic: it bottoms out in a bedrock fact, an open empirical question, or a value premise, and does not decompose further.

or create a grant for this whole area →

Provenance

Where this quantity's evidence comes from. The figures sources state are under Estimates above.

2 sources · no origin · 2 untraced

2 Untraced

Algorithmic progress in language modelsMar 9, 2024 · states Untraced · nothing upstream recorded
On the Origin of Algorithmic Progress in AINov 26, 2025 · states Untraced · nothing upstream recorded
originuntraced
A Shapley value analysis suggests that 60-95% of the gains have come from increased compute and training data, while novel algorithms have been responsible for only 5-40% of the progress.
in the last 10 years, algorithmic progress has contributed more than 4 orders of magnitude in so-called "effective compute" while compute scaling has increased 7 orders of magnitude
Cite this claim: a formal citation with its evidence attached
Embed this claim: show it on another site with its current assessment

An embed reports the graph's judgment as it stands when the page is viewed: the status with its confidence, how disputed the claim is, and the date. It links back here.

CardFits its column and sizes itself. Without the script it stays a quotation with its link.
<blockquote class="minerval-claim" data-claim-id="0af6c0ca-e612-42fd-a8f8-5a519cf15c98"><a href="https://minerval.ai/claims/0af6c0ca-e612-42fd-a8f8-5a519cf15c98">Fraction of recent frontier AI capability progress attributable to algorithmic improvements rather than compute scaling</a></blockquote>
<script async src="https://minerval.ai/embed.js"></script>
IframeWhere scripts are not allowed. A fixed height; add ?theme=light or ?theme=dark to fix its colours.
<iframe src="https://minerval.ai/embed/claims/0af6c0ca-e612-42fd-a8f8-5a519cf15c98" title="Minerval: Fraction of recent frontier AI capability progress attributable to algorithmic improvemen…" width="480" height="275" style="border:0;max-width:100%" loading="lazy"></iframe>
BadgeAn image for a README or a forum post, in Markdown.
[![Minerval's judgment of this claim](https://minerval.ai/embed/claims/0af6c0ca-e612-42fd-a8f8-5a519cf15c98/badge.svg)](https://minerval.ai/claims/0af6c0ca-e612-42fd-a8f8-5a519cf15c98)

The badge now: Minerval's judgment of this claim

Contribution record · 1 exchange

Challenges and proposals from contributors, with the review each received. Substantive exchanges stay on the claim's public record.

jacksonqueenkingpropose claimNov 5, 2026
Review · accepted · Nov 5, 2026 · contribution reviewer

The proposal is a noun phrase that asks for a value (a fraction), so it reads as a quantity, not a proposition. The Matcher settles the kind, and the proposal should not be rejected for arriving as the wrong kind. It is about the world and not about a private person. It is a live, much-discussed topic in AI progress research, where people attribute progress to algorithmic gains versus compute scaling. The wording is workable as a starting point. The Steward will need to complete the definition, since "recent", "frontier", "capability progress", and the attribution method (for example, effective-compute decomposition versus counterfactual ablation) are left open. Those choices are the Steward's work after admission. The contributor did not give sources or reasons, and a proposal does not require them. Admitted on form, good faith, and the claim bar.

cites §2 · §3 · §17

Contribute

Every judgment on this page is open to challenge. A contribution is evaluated on its merits by the reviewer; if it succeeds the page changes, and if it does not, the reasons are stated. Either way the exchange becomes part of the claim’s public record.


Created by user · Nov 5, 2026. Every judgment on this page is accompanied by a reasoning trace.