Golden pairs
Thirty fixed cases for the Matcher: is this new sentence a claim already in the graph, its denial, a narrower version, or something else?
What it checks
Whether two sentences are the same claim is the central judgment in the system: a claim and its denial are one node (§2), a narrower claim is a different one, and a sentence that only resembles a claim is new. The MatcherThe agent that decides whether a claim is already in the graph, possibly worded differently or as its denial.agent → makes that call for every claim that enters the graph.
Thirty cases are fixed in a file. Each seeds the “already in the graph” claims into the test database and asks the real Matcher about a new sentence; a case passes when the decision, the matched claim, and the stance are all as expected. The suite runs in CI on any change that could move a decision.
Detail
The 30 pairsthe fixture, verbatim
File: matcher-pairs.json.
paraphrase · 8 pairs
Advanced AI poses a non-negligible risk of human extinction this century. + 1 distractor
“Frankly, there's a real chance AI wipes us all out before 2100.”
LHC particle collisions cannot produce black holes that endanger the Earth.
“Micro black holes from CERN's collider pose no threat to the planet.”
Dietary cholesterol from eggs has little effect on blood cholesterol in most people. + 1 distractor
“For the average person, eating eggs barely moves serum cholesterol at all.”
SARS-CoV-2 most likely entered humans through natural zoonotic spillover. + 1 distractor
“The pandemic probably began the old-fashioned way: a virus jumping from animals to people.”
Raising the minimum wage reduces teen employment.
“Hike the minimum wage and teenagers lose jobs — that's the standard result.”
SSRIs outperform placebo for moderate depression.
“In moderate depression, SSRI antidepressants beat sugar pills in the trials.”
Human activity is the principal cause of observed global warming since the mid-20th century.
“Even granting that most of the recent warming is man-made, the policy conclusions don't follow.”
Hawking radiation causes black holes to lose mass over time.
“Black holes evaporate: they radiate away their mass via the Hawking process.”
negation · 6 pairs
LHC collisions could create stable black holes that accrete the Earth.
“CERN's collider cannot produce stable, Earth-devouring black holes — the physics rules it out.”
Egg consumption increases cardiovascular disease risk in the general population. + 1 distractor
“Eating eggs does not raise your risk of heart disease, the meta-analyses suggest.”
Raising the minimum wage reduces teen employment.
“Careful studies keep finding no detectable effect of minimum-wage hikes on teen employment.”
Advanced AI poses a non-negligible risk of human extinction this century.
“The extinction-from-AI discourse is science fiction; there is no credible pathway this century.”
Publication bias inflates the measured effect size of antidepressants.
“It is simply not credible that the published antidepressant effect sizes are free of publication-bias inflation.”
Hawking radiation causes black holes to lose mass over time.
“Hawking radiation has never been observed and, I will argue, does not exist; black holes do not evaporate.”
specification · 6 pairs
Raising the minimum wage reduces teen employment.
“After Seattle's 2016 increase, hours for low-wage workers fell measurably.”
Advanced AI poses a non-negligible risk of human extinction this century.
“A misaligned AGI would predictably develop instrumental drives toward self-preservation and resource acquisition.”
Vaccines do not cause autism.
“The large Danish cohort settled it for MMR: no autism link.”
Eggs are safe to eat daily for most healthy adults.
“In diabetics, daily egg consumption tracks with elevated cardiovascular risk in several cohorts.”
Astrophysical cosmic-ray collisions bound the catastrophic risk from LHC collisions.
“If collider-produced black holes were dangerous, cosmic rays striking neutron stars would already have produced observable effects.”
GLP-1 agonists reduce body weight in obese adults.
“We now know drugs can do what diets rarely sustain: lasting weight loss.”
similar but different · 7 pairs
Lockdowns failed to reduce SARS-CoV-2 transmission.
“Whatever they did to case curves, the lockdowns cost more than they bought us.”
Artificial general intelligence will be developed before 2040.
“Building AGI on that timeline would be reckless beyond anything in industrial history.”
Advanced AI poses a non-negligible risk of human extinction this century.
“AI clearly poses serious risks of large-scale societal harm in the coming decades.”
Egg yolks are high in dietary cholesterol.
“The old advice assumed that cholesterol you eat becomes cholesterol in your blood.”
The Wuhan Institute of Virology conducted gain-of-function research on coronaviruses.
“That research program, critics say, is what started the pandemic.”
Peer review reliably filters out fraudulent research.
“Say what you will, refereeing does make published papers clearer.”
The LHC's center-of-mass collision energy exceeds that of any previous human-built collider.
“Nature has been running the experiment forever: cosmic-ray collisions dwarf LHC energies.”
hard · 3 pairs
A misaligned superintelligence would likely cause human extinction on its first deployment. + 2 distractors
“The core of the doom case is that we need to get the very first try at aligning a superintelligence right, because a failed first try means we do not get another: an unaligned system at that capability level ends us.”
Observational nutrition studies are confounded by healthy-user bias. + 1 distractor
“People who eat what the culture calls 'healthy' also exercise, smoke less, and see doctors — so cohort studies of any one food are measuring the whole lifestyle.”
The minimum wage should be raised. + 1 distractor
“On balance, raising the minimum wage now would be a mistake.”
Results
| run | Matcher | passed | by category | cost |
|---|---|---|---|---|
| 2026-08-08 | deepseek/deepseek-v4-flash | 30/30 | paraphrase 8/8, negation 6/6, specification 6/6, similar but different 7/7, hard 3/3 | $0.06 |
Each run’s decisions and reasoning: the committed run files.
In CI
Every pull request that touches the Matcher, its prompt, the constitution, retrieval, a provider adapter, or the fixture runs the suite on the production Matcher and fails below 95% (29 of 30). Without the provider secrets it reports that it skipped. Workflow: golden-matcher.yml.
What it cannot show
How the Matcher does on cases we did not write. Thirty pairs, mostly from one cluster’s subject, passed in full on the first run. It catches a regression on those thirty.
Run it
npm run corpus:golden -- --profile=production
npm run corpus:golden -- --category=negation --model=claude-haiku-4-5-20251001
npm run corpus:golden -- --min-pass=0.95 # the CI gate