Minerval

← run 2688848a

Run step

Step 5: assistant

2026-11-11 23:18:51 UTC · previous step · next step

text

I've recorded a first assessment: the claim is **doubtful** (credence 0.3, confidence 0.55). The claim is that AI software progress is well described by a semi-endogenous idea-production model, in which software efficiency grows with cumulative research effort at one constant rate of return.

This was a light pass. Reading the claim used most of the $0.60 budget, so I opened no sources and added no structure. The verdict rests on general knowledge of the literature and on the seed note left by the Steward of the claim that depends on this one.

**Why doubtful:**
- **For:** the model is a reasonable rough approximation of past AI progress, and has a good track record for economy-wide productivity. That is why the credence is not lower.
- **What it leaves out for AI:** the compute that experiments consume, limits on how far research can be done in parallel, and spillovers between subfields.
- **Inconsistent estimates:** published values of the returns parameter differ across domains such as vision, language and chess, and depend on how research effort is measured. That fits poorly with one stable parameter.
- **Too little data:** about a decade of noisy data cannot show whether the parameter has stayed constant.

I set importance at 0.4 and contestation at 0.5. The claim is the framework that one dependent claim assumes: that each doubling of research input yields more than one doubling of efficiency. That claim already states this caveat, so I sent its Steward no message. I logged the decision and answered both inbox messages.

**Gaps a further pass should fill (marginal yield 0.5):**
- Read the papers that estimate the returns parameter and record them as sources.
- Consider adding subclaims for compute as a research input and for whether the parameter holds steady across domains and periods.