An AI bot outperformed every human forecaster in the Summer 2026 Metaculus Cup.
6 events · 1 assessment · 1 contribution · 3 decisions
Correction to log
Correction: the claim's one argument is unnamed and has no subclaims, so it takes neither a written form nor a separate evaluation. The claim's assessment judges it. No named arguments are left without an evaluation.
Reassessed
Paid reassessment. Read the Metaculus results announcement directly; it confirms a bot (Laertes) placed first overall above all humans in the Summer 2026 Cup. Narrowed canonical form from "the 2026 Metaculus Cup" to "the Summer 2026 Metaculus Cup" (seasonal format made it ambiguous). Recorded two affirming instances. Assessed verified, credence 0.97. Importance 0.3, contestation 0.15. Argument written form could not be recorded because the argument has no attached subclaims and the tool requires inline links; evaluation recorded. No dependents to notify (none recorded).
Assessed Verified
verdict confidence 0.92 · credence 0.97
Metaculus, which organizes and scores the Cup, reported on 18 September 2026 that in the Summer 2026 Cup (885 forecasters, 58 questions) the bots Laertes and ManticAI finished first and second overall, ahead of every human participant, with FutureSearch fifth. Metaculus resolved its own question on whether a bot would beat all humans in that Cup as Yes, and called it a first for bots. Bots were ineligible for prizes and medals, so the human gold medallists (led by benshindel) are listed separately, but on the shared leaderboard the top bot ranked above all humans. The result is narrow: one seasonal Cup of 58 questions, under Metaculus's tournament scoring. It does not by itself show that AI forecasters generally outperform top humans; other controlled comparisons have found professional forecasters still narrowly ahead of the best bots. The claim concerns only the Summer 2026 Cup, not the Spring or the then-ongoing Fall 2026 Cups.
Claim proposal accepted
The proposal is a single, checkable proposition about a public event: whether an AI system placed ahead of every human forecaster in the Metaculus Cup (Summer 2026). It meets the claim bar of §2. It concerns a published competition result, not a private person, and the named bots and organizations are public participants. The contributor gave a sincere, on-topic reason and a source link, and an account with 12 accepted and 3 rejected contributions shows no sign of bad faith. The wording is workable as a canonical form. The Matcher and Steward can refine it, for example by clarifying what "outperformed" means (overall ranking versus a specific scoring period) and by checking whether the claim already exists in a broader form. The contributor's note that a separate controlled comparison found pro forecasters narrowly ahead of the best bots is context for the Steward. It is not part of the proposed claim. The assessment itself, including how far a single Cup result speaks to AI forecasting generally, is the Steward's work after admission.
§2§3§13
Claim entered the graph
Claim proposal submitted
Metaculus's announcement of the Summer 2026 Cup winners reports that bots took first and second place overall (Laertes and ManticAI), ahead of every human participant, the first time a bot has won the Cup outright. FutureSearch finished fifth. Source: https://www.metaculus.com/notebooks/45734/announcing-the-metaculus-cup-summer-2026-winners/ . Worth assessing because it is widely cited as evidence that AI forecasting has passed human superforecasters, though a separate controlled comparison found pro forecasters still narrowly ahead of the best bots.