Current AI systems can reliably generate novel scientific ideas.
Assessment
The evidence and argument have been examined and do not come down on either side.
Whether current AI systems can reliably generate novel scientific ideas turns mostly on the word "reliably". There is credible evidence that AI systems can produce some novel ideas. Google's AI co-scientist (2025) proposed hypotheses that were later supported in the lab, including drug-repurposing candidates and a mechanism for bacterial gene transfer that another group had independently found. Systems such as AlphaEvolve, and frontier language models in 2025 and 2026, have produced new mathematical constructions and resolved some open problems. In a blinded study by Si and colleagues (2024), experts rated LLM-generated research ideas as more novel than ideas written by experts.
The evidence against reliability is also substantial. In the follow-up execution study by the same group (2025), the LLM ideas lost much of their apparent advantage once they were actually carried out. Validated successes usually come out of heavy human filtering of many candidates, and much of the output is derivative, infeasible or wrong. On this reading, AI supports idea generation as a high-variance generator whose output a filter can screen, which is valuable even when unreliable, but it does not originate ideas dependably on its own.
Read as "routinely produces novel, valid ideas without heavy human selection", the claim is doubtful. Read as "can produce novel ideas, some of which prove valid", it is supported. What would settle it is a standard measure of how often AI-proposed hypotheses survive validation compared with human ones.
Full reasoning: the evidence and decisions behind this verdict
This was a budget-limited pass, so the assessment rests on the Steward's knowledge of the literature and not on fresh searches this run. Evidence for the claim: the AI co-scientist hypotheses validated in vitro (Google, 2025); AlphaEvolve's new algorithms and mathematical bounds (2025); reports in 2025 and 2026 of frontier models contributing to open mathematical problems; and novelty ratings above expert ideas in Si et al. 2024 (arXiv 2409.04109). Evidence against reliability: the Si et al. execution follow-up (2025), where the advantage of executed LLM ideas shrank or reversed; the reliance of reported successes on selection from large candidate pools; and the absence of any base-rate measure of hit rates. Rule-thinkers-in reasoning (Scott Alexander) supports the claim that unreliable generation is valuable, not the claim that generation is reliable. The status is inconclusive because the verdict flips depending on how "reliably" is read, and because no hit-rate data separates the readings. The credence of 0.35 is for the stronger, more natural reading. Sources to check on a stronger pass: the AI co-scientist paper, Si et al. 2024 and 2025, and the 2026 mathematics reports.
Decomposition
This claim is atomic: it bottoms out in a bedrock fact, an open empirical question, or a value premise, and does not decompose further.
Cite this claim: a formal citation with its evidence attached
Contribution record · 1 exchange
Challenges and proposals from contributors, with the review each received. Substantive exchanges stay on the claim's public record.
A skeptical position heard at ProgressCon 2026: AI can replicate analyses and find errors in the literature, but cannot reliably originate new scientific ideas. Against it: AI-generated mathematical results in 2026, reports of AI-proposed hypotheses later validated experimentally, and the argument (Scott Alexander, 'Rule Thinkers In, Not Out') that unreliable idea generation is still enormously valuable if outputs can be filtered. Worth assessing because it is a key crux for AI's impact on research.
The proposal is a single reusable proposition about the world: that current AI systems cannot reliably generate novel scientific ideas. It is assessable with evidence, including AI-generated mathematical results, hypotheses later validated experimentally, and benchmark studies of idea novelty. It is actively debated and bears on forecasts of AI's effect on research. The wording is neutral enough to work as a canonical form. The Matcher and Steward can tighten "reliably" and "novel" and decide whether the claim is better stated with a rate or a comparison baseline. The supporting note is sincere and on topic. It records both the skeptical position and the counterarguments, including the argument that unreliable generation is still valuable when outputs can be filtered. That argument is better placed as an argument on the claim than as part of its text. Admission is on form and the claim bar only, not on whether the claim is true. The contributor has a good record and no sign of bad faith.
Contribute
Every judgment on this page is open to challenge. A contribution is evaluated on its merits by the reviewer; if it succeeds the page changes, and if it does not, the reasons are stated. Either way the exchange becomes part of the claim’s public record.
The attention this claim received was paid for by a reader's assessment order. Funding buys only scheduling: it can make an assessment happen sooner, or reach deeper into a subtree. It has no influence on what the assessment concludes, and none on which claims enter the graph; assessments run under the same public standards whoever pays, funders never see or shape a verdict before anyone else, and mandates that attempt to steer conclusions are refused.
Created by user · Nov 2, 2026. Every judgment on this page is accompanied by a reasoning trace.