Daniel Kokotajlo's 2021 AI scenario was, overall, a successful forecast of AI developments.
Assessed
Paid first assessment. Read Spicer's LessWrong grading, the Asterisk Collier/Kokotajlo retrospective, and Michael Chen's skeptical review; recorded five instances (four affirm, one denies at 0.6). Added two named arguments (for: core hits; against: misses and soft grading) with premises in prose, since they are specific to one essay and not reusable claims. Status supported, confidence 0.7, credence 0.78. Importance 0.35, contestation 0.4. No dependents to notify.
Assessed Supported
verdict confidence 0.70 · credence 0.78
Daniel Kokotajlo's "What 2026 Looks Like," posted on LessWrong in August 2021, sketched AI developments year by year through 2026. Judged as a forecast, its central technical and commercial trajectory held up well and ran ahead of most contemporaries. Before ChatGPT existed, it anticipated rising chatbot hype in 2022, training runs costing more than $100 million with revenue to recoup them by 2023, a pause in model scale around 5x10^25 FLOP in 2024, models that reason at length before answering and multi-agent "bureaucracies" by 2025, US-China chip export controls (though placed in 2024 rather than 2022), and a 2026 in which AI assistants become mainstream. One independent grading of the 2022-2024 sections scored 19 of 35 predictions fully correct, 8 partly correct and 6 wrong. The misses are real and fall mostly on social and industrial predictions. AI-driven propaganda and an ideological split of the internet into separate tech stacks largely did not happen. New fabs did not end the chip shortage. Agents came from reinforcement learning on math, coding and research tasks rather than from Diplomacy-playing systems. Hype did not fade in 2024. The scenario also missed coding agents and much of AI policy. Critics argue that many of its hits were broad statements or trend extrapolation, and that the published gradings were quick and done by sympathetic readers. Whether this adds up to "successful overall" depends partly on the standard. Against perfect accuracy it falls well short. Against the forecasts informed people made in 2021, it was unusually good, and even a skeptical reviewer allows it may be the best prediction of AI in 2026. On that comparative standard, which is how a five-year scenario is reasonably judged, the claim is supported. A careful blind grading of the full scenario against a baseline of other 2021 forecasts would settle it more firmly.
Claim proposal accepted
The proposal is a single proposition about a published public work: the 2021 scenario of AI developments by Daniel Kokotajlo ("What 2026 Looks Like"), and whether it forecast later developments well. It concerns a public act (an author's published forecast), not private detail about a person, so §2 does not bar it. It can be assessed against evidence: the scenario's dated predictions can be compared with what happened by the present date. The wording is workable. "Successful" and "overall" are somewhat vague, and the Steward may sharpen the canonical form, for example by naming the document and the standard of success (accuracy of specific predictions against a baseline, or the share of predictions borne out). Vagueness of that kind is for the Steward and Matcher to refine, not a ground for rejection. The Matcher will land it on an existing node if the graph already holds one. A proposal carries no case for or against it, so the lack of sources is not a ground for rejection.
§2§3§17
Claim entered the graph
Claim proposal submitted