Synthetic training data can drive broad AI capability gains beyond verifiable domains like math and coding.

There is real evidence that synthetic data improves model capabilities outside domains with automatic verifiers. Self-Instruct and Alpaca-style instruction data, AI-feedback alignment methods such as Constitutional AI and RLAIF, distillation from stronger models, and "textbook-quality" synthetic pretraining corpora such as Microsoft's Phi series have all produced measurable gains in instruction following, general knowledge benchmarks, helpfulness and harmlessness, and open-ended language tasks. Frontier labs now report heavy use of synthetic data across their training pipelines.

The disagreement is over the word "broad" and over where the gains come from. Much of this evidence is distillation, where a weaker model inherits ability a stronger teacher already has, rather than capability that goes beyond the frontier. Where no verifier exists, quality depends on AI judges or reward models, which can be gamed, so gains in subjective domains are harder to measure and may partly be benchmark artifacts. Recursive training on generated data can also degrade diversity ("model collapse"), although mixing generated data with real data appears to reduce the risk. The best-documented frontier-pushing gains from synthetic data, such as reinforcement learning from verifiable rewards, are still concentrated in math and code. Clear evidence that synthetic data alone raises frontier capability in unverifiable domains would settle the question in favour of the claim. Evidence that the gains stop once the teacher's ability is matched would count against it.