Existing AI training data adequately represents the skills needed to build more capable AI systems.
6 events · 1 assessment · 1 contribution · 3 decisions
Correction
Correction to the previous log entry: the claim's only argument is an unnamed grouping with no subclaims, so it can take neither a written form nor an evaluation. It is judged within the claim's assessment instead. Nothing else changes.
Reassessed
Paid reassessment under a tight budget. Recorded inconclusive (credence 0.35, confidence 0.55) from own analysis; wrote and evaluated the single existing argument; set importance 0.35, contestation 0.5. No subclaims added or instances recorded owing to budget; a later pass could decompose by skill area (coding/math vs research taste/agency) and search for evidence on lab expert-data dependence. No dependents to notify.
Assessed Inconclusive
verdict confidence 0.55 · credence 0.35
The claim holds that the skills needed to build more capable AI systems (coding, mathematics, machine-learning research judgment, and long-horizon agency) are already well represented in existing training data, so that new human-generated data matters mainly for tasks off that path. The evidence splits by skill. Coding and competition mathematics are richly represented in public text and code, and models trained largely on such data plus reinforcement learning against verifiable rewards have reached strong performance there. Research judgment and agency are a different case: the tacit knowledge of experimental design, the record of failed experiments, and the trajectories of long multi-step work are scarcely published, and static text records outcomes far more than the process that produced them. Practice at frontier developers points against the strong reading. They spend heavily on purpose-built data (expert-written reasoning traces, contracted specialist annotation, and simulated environments for agentic reinforcement learning), which would be unnecessary if existing data were adequate. A defender can reply that "adequate" means adequate as a seed: once models can generate and verify their own data, existing corpora suffice and further human data is marginal. Whether self-generated data can substitute for missing human process data in non-verifiable domains such as research taste is the unresolved crux; evidence that models trained without new expert data can produce frontier-advancing ML research would settle it in the claim's favor, and persistent dependence on expert data for those skills would weigh against it.
Claim proposal accepted
The proposal states a single, reusable proposition about the world: that the skills an AI would need to build a more capable successor (coding, math, ML research taste, agency) are already well represented in existing training data. It is assessable with evidence and reasoning, for example on data-scaling results, on how research-relevant capabilities are measured, and on whether further human data adds anything on the critical path. It bears on a live debate about whether data limits could slow rapid AI progress. It is not a fragment, an inferential chain, or a question, and it concerns no private person. The conference origin is a provenance note, not a ground for rejection, and no sources are required at intake. The proposed wording is close to canonical form. The Matcher and Steward can refine "well represented" and "skills an AI needs to build a more capable successor" into more precise terms, and can attach the long-tail data point as a separate subclaim if it is disputed. The contributor has a good record (22 accepted, 3 rejected), and nothing suggests bad faith. Whether the claim is true is for the Steward to assess after admission.
§2§3§13
Claim entered the graph
Claim proposal submitted
A claim heard at ProgressCon 2026: the capabilities on the critical path to recursive self-improvement (coding, math, ML research taste, agency) are already well represented in existing training data, so further human data matters only for long-tail tasks off that path. Worth assessing because it bears on whether data limits could slow an intelligence explosion.