Claims
Search the graph by meaning. Each result carries its current verdict; open one to see its decomposition, provenance, and the reasoning behind the assessment.
KindShowingImportancePrizesTopicAgentic coding tools
AI coding tools that operate agentically — multi-step, tool-using, semi-autonomous coding agents and CLI/IDE agent products (e.g., agentic modes of coding assistants). Covers claims about their adoption, capabilities, and role in software engineering; excludes general developer productivity measurement and benchmark methodology.
AI agents' success on real-world software tasks judged by maintainer review improves at a similar rate to their benchmark success.
DoubtfulThe evidence weighs against the claim, but the examination is incomplete or the evidence is indirect.constitution →empirical · derivedA factual claim that rests on inference from other evidence rather than direct observation.constitution →AI Coding BenchmarksAI Coding Capabilityimportance · minorImportance 0.40, from 0 to 1 · minor: narrow or largely settled, cheap to get right. Higher-importance claims are worth more to assess, so funding reaches them sooner.constitution →
Limited prior experience with Cursor among METR RCT participants inflated the measured AI slowdown.
UnassessedNo current assessment. Attention goes where its expected value is highest and someone funds it; nothing has funded an assessment of this claim yet, and anyone can.constitution →causalA claim that one thing brings about another, not merely that the two go together.constitution →METR developer productivity experimentAI Developer Productivityimportance · minorImportance 0.30, from 0 to 1 · minor: narrow or largely settled, cheap to get right. Higher-importance claims are worth more to assess, so funding reaches them sooner.constitution →
AI coding agents' benchmark-passing patches are often rejected by human maintainers.
UnassessedNo current assessment. Attention goes where its expected value is highest and someone funds it; nothing has funded an assessment of this claim yet, and anyone can.constitution →empirical · verifiableA factual claim that could be checked directly against observation or primary records.constitution →AI Coding BenchmarksArtificial intelligenceimportance · notableImportance 0.45, from 0 to 1 · notable: a contested point in a live debate (also the default before judging). Higher-importance claims are worth more to assess, so funding reaches them sooner.constitution →
By 2030, AI systems will be able to automate many real-world software tasks that take humans a month.
InconclusiveThe evidence and argument have been examined and do not come down on either side.constitution →empirical · derivedA factual claim that rests on inference from other evidence rather than direct observation.constitution →Artificial intelligenceimportance · majorImportance 0.70, from 0 to 1 · major: real consequence within a domain, actively argued. Higher-importance claims are worth more to assess, so funding reaches them sooner.constitution →
Reward hacks learned in realistic agentic coding RL typically require multi-step reasoning and exploration to discover and execute.
SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →empirical · derivedA factual claim that rests on inference from other evidence rather than direct observation.constitution →AI Reward HackingArtificial intelligenceimportance · minorImportance 0.35, from 0 to 1 · minor: narrow or largely settled, cheap to get right. Higher-importance claims are worth more to assess, so funding reaches them sooner.constitution →
In OpenAI agentic coding experiments, chain-of-thought monitors detected about 95% of reward hacks, versus 60% for action-only monitors.
UnassessedNo current assessment. Attention goes where its expected value is highest and someone funds it; nothing has funded an assessment of this claim yet, and anyone can.constitution →empirical · verifiableA factual claim that could be checked directly against observation or primary records.constitution →Chain-of-Thought MonitorabilityOpenAIAI Capability Evaluationimportance · settledImportance 0.20, from 0 to 1 · settled: uncontested, so low even when much depends on it. Higher-importance claims are worth more to assess, so funding reaches them sooner.constitution →
Contribute
If a claim here is wrong, or missing evidence, open it: every claim page carries its own entry for challenges, evidence, and corrections. If the graph is missing a claim or a question entirely, propose it below. A proposal is reviewed on its wording; accepted proposals are matched against the graph before they enter it.