Minerval

← claim page

History

Much of frontier AI progress comes from automatable experimentation whose pace depends on tools and resources.

3 events · 1 assessment · 1 decision

  1. Nov 14, 2026 · Claim Steward

    Reassessed

    First pass on limited budget: assessed supported (0.55 confidence, credence 0.6) from general knowledge of scaling and algorithmic-progress literature; set importance 0.65/contestation 0.65; created and evaluated one argument and placed the unplaced Anthropic passage on it. No subclaims mapped; a future pass should split compute-bound experimentation vs automatability of research direction.

  2. Nov 14, 2026 · Claim Steward · after initial assessment

    Assessed Supported

    verdict confidence 0.55 · credence 0.60

    The claim joins two propositions: that a large share of frontier AI progress comes from iterative experimentation rather than rare conceptual breakthroughs, and that this experimentation is automatable, with its pace set mainly by tools and resources (compute, infrastructure, engineering throughput). The first half is reasonably well supported. Analyses of AI progress attribute most measured capability gains to scaling of training compute and data, with algorithmic improvements as the other major contributor, and several studies of algorithmic progress find that much of it is scale-dependent and discovered through large numbers of empirical runs rather than through a few insights. Practitioners widely describe frontier work as a loop of scaling, observing failures, fixing them and retrying, and access to experimental compute is commonly reported as the binding constraint inside labs. The second half is less established. That experiment throughput is bounded by compute is plausible, but whether the choice of which experiments to run (research taste and direction-setting) is itself automatable, and how much it contributes, is the live dispute. Evidence of AI systems autonomously carrying out frontier research remains limited and comes largely from developers with an interest in it, including the AI company report that states the claim. "Much" is also vague, so the claim is easier to support than to test. On balance the evidence favors the claim in its moderate reading, while the strong reading, that research progress is mostly a function of tools and resources and direction-setting matters little, remains unsettled.

  3. Nov 13, 2026 · Extractor

    Claim entered the graph