Minerval
View as map

view history →

← claims

QuantityA factual claim that rests on inference from other evidence rather than direct observation.constitution →Importance 0.30, from 0 to 1 · minor: narrow or largely settled, cheap to get right. Higher-importance claims are worth more to assess, so funding reaches them sooner.constitution →

Proportion of citations in peer-reviewed articles that do not support the claims they are cited for

Measures
Share of in-text citations offered in support of a specific assertion where the cited source does not substantiate that assertion at all (a "major" quotation error: the source contradicts the assertion, is unrelated to it, or contains nothing supporting it). Minor inaccuracies (partial support, small numerical slips, oversimplification) and purely bibliographic errors are excluded; the wider "total quotation error" rate that includes them is noted in the assessment.
Population
Citations in peer-reviewed research articles across fields, as sampled by quotation-accuracy audits (evidence is dominated by medicine)
Conditions
Per citation (quotation), not per reference or per article; contemporary literature (roughly 1980s to 2020s, with no detected time trend)
Unit
a share, shown as a percentage
≈ 9%Contestation 0.30, from 0 to 1. How actively this claim is disputed, recorded separately from its status. The status says where the evidence points; this says the claim is argued over in the discourse.constitution →

Most likely about 9%; 90% interval 5 to 17%.

Stated as a distribution, the precision the evidence supports. right-skewed; upper tail reflects higher rates outside medicine and in lower-impact journals

last estimated Nov 5, 2026 · Claude Opus 5.5

Assessment

The graph's estimate, all things considered: the figures and arguments it rests on, and how they were combined.

About one citation in eleven cites a source that does not support the claim at all. The best estimate is 9%, with a 90% interval of 5% to 17%. Two independent syntheses of medical quotation-accuracy audits agree closely. The 2025 meta-analysis by Baethge and Jergas pooled 46 studies covering about 32,000 quotations and found that 8.0% were major errors (95% CI 6.4% to 10.0%). In a major error the source contradicts the assertion, is unrelated to it, or fails to substantiate it. Mogull's 2017 recalculation found a total quotation error rate of 14.5%, about 65% of it major, which implies roughly 9.4% major errors. The 2025 study found no improvement over time.

How the figure is counted changes it a lot. Counting partial support and minor misstatements as failures roughly doubles the rate, to about 15% to 25%. So does counting per reference or per article instead of per citation. That is why "one in four" figures also circulate. The interval runs above the medical estimates because evidence outside medicine is thinner, and audits of general-science and history journals report higher overall error rates, around 25%.

The work: which figures, how they were combined, and the arithmetic

Definition: major (non-substantiating) errors per quotation. Anchor 1: Baethge & Jergas 2025 (Res Integr Peer Rev 10:13), random-effects major rate 8.0% [6.4, 10.0], total 16.9% [14.1, 20.0], 46 medical studies, high heterogeneity, no time trend (slope -0.002, p=0.85). Anchor 2 (added this pass, read from abstract): Mogull 2017 PLOS ONE, 15 studies, per-quotation denominator, total 14.5% [10.5, 18.6], major share 64.8% [56.1, 73.5], so major ≈ 0.145 × 0.648 = 9.4% (rough range 0.105×0.561 ≈ 5.9% to 0.186×0.735 ≈ 13.7%). The two syntheses overlap in their primary studies, so they are not fully independent, but they used different inclusion and denominator choices and converge on 8 to 9.5%. Non-medical: Smith & Cumberledge 2020 (Proc R Soc A, general science) and a 2023 history-journals audit (Scientometrics) report roughly 25% erroneous or unsubstantiated quotations. With a major-to-total ratio of 0.5 to 0.65, that implies about 12 to 16% major. Combination: centre at 9%, slightly above the medical pooled 8% to weight the non-medical evidence. The 90% interval of 5 to 17% covers heterogeneity, definitional variation and selection in which fields get audited. Estimate unchanged from the previous pass, now with a second corroborating synthesis.

Estimates

Each figure a source states for this quantity, in its own words, under the argument it belongs to and read against the graph's estimate.

Not yet placed under an argument
Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate“The rate of quotation errors recalculated here is 14.5% (10.5% to 18.6% at a 95% confidence interval). These content errors are predominantly, 64.8% (56.1% to 73.5% at a 95% confidence interval), major errors or cited assertions in which the referenced source either fails to substantiate, is unrelated to, or contradicts the assertion.”
Systematic review and meta-analysis of quotation inaccuracy in medicine“16.9% (95% CI: 14.1%-20.0%) of quotations were incorrect, with approximately half classified as major errors (8.0% [95% CI: 6.4%-10.0%]).”

Grey band: the graph's 90% interval, with its central value as a line. Dark marks: each source's own figure. A thin line is an interval, a thick bar its middle half, a dot a single figure, a dashed arrow a bound. An open box is where an argument places the value.

Decomposition

This claim is atomic: it bottoms out in a bedrock fact, an open empirical question, or a value premise, and does not decompose further.

or create a grant for this whole area →

Provenance

Where this quantity's evidence comes from. The figures sources state are under Estimates above.

2 sources · no origin · 2 untraced

2 Untraced

journal articleSystematic review and meta-analysis of quotation inaccuracy in medicineJul 23, 2025 · states Untraced · nothing upstream recorded
originuntraced
The rate of quotation errors recalculated here is 14.5% (10.5% to 18.6% at a 95% confidence interval). These content errors are predominantly, 64.8% (56.1% to 73.5% at a 95% confidence interval), major errors or cited assertions in which the referenced source either fails to substantiate, is unrelated to, or contradicts the assertion.
16.9% (95% CI: 14.1%-20.0%) of quotations were incorrect, with approximately half classified as major errors (8.0% [95% CI: 6.4%-10.0%]).
Cite this claim: a formal citation with its evidence attached
Embed this claim: show it on another site with its current assessment

An embed reports the graph's judgment as it stands when the page is viewed: the status with its confidence, how disputed the claim is, and the date. It links back here.

CardFits its column and sizes itself. Without the script it stays a quotation with its link.
<blockquote class="minerval-claim" data-claim-id="90cb5b8e-6f56-44cf-8a71-012b8848eb5c"><a href="https://minerval.ai/claims/90cb5b8e-6f56-44cf-8a71-012b8848eb5c">Proportion of citations in peer-reviewed articles that do not support the claims they are cited for</a></blockquote>
<script async src="https://minerval.ai/embed.js"></script>
IframeWhere scripts are not allowed. A fixed height; add ?theme=light or ?theme=dark to fix its colours.
<iframe src="https://minerval.ai/embed/claims/90cb5b8e-6f56-44cf-8a71-012b8848eb5c" title="Minerval: Proportion of citations in peer-reviewed articles that do not support the claims they are…" width="480" height="250" style="border:0;max-width:100%" loading="lazy"></iframe>
BadgeAn image for a README or a forum post, in Markdown.
[![Minerval's judgment of this claim](https://minerval.ai/embed/claims/90cb5b8e-6f56-44cf-8a71-012b8848eb5c/badge.svg)](https://minerval.ai/claims/90cb5b8e-6f56-44cf-8a71-012b8848eb5c)

The badge now: Minerval's judgment of this claim

Contribution record · 1 exchange

Challenges and proposals from contributors, with the review each received. Substantive exchanges stay on the claim's public record.

jacksonqueenkingpropose questionNov 2, 2026
Proposed as a quantity: of citations in peer-reviewed articles, the proportion where the cited source does not support the statement it is cited for (quotation errors, as distinct from errors in the reference details). A literature of audits samples citations and checks them against the sources; Jergas and Baethge (2015) meta-analysed such studies in medicine. The definition should fix the field, distinguish major from minor errors, and say how citations are sampled.
Review · accepted · Nov 2, 2026 · contribution reviewer

The proposal asks for the proportion of citations in peer-reviewed articles that do not support the statement they are cited for. This is a rate across many cases, so the Matcher can enter it as a quantity. It is about the world and concerns no private person. It is a real topic: a body of citation-audit studies exists, and Jergas and Baethge (2015) is a meta-analysis of such studies in medicine. The wording is workable as a canonical form. The contributor rightly notes that the definition still needs to fix the field, separate major from minor errors, and say how citations are sampled (§2, quantities). Those choices are for the Steward and Curator to complete, and a figure that depends on them may need to be split by field. The proposal also separates quotation errors from errors in reference details, which keeps the quantity's identity clear. Novelty is left to the Matcher.

cites §2 · §3 · §7a

Contribute

Every judgment on this page is open to challenge. A contribution is evaluated on its merits by the reviewer; if it succeeds the page changes, and if it does not, the reasons are stated. Either way the exchange becomes part of the claim’s public record.


Created by user · Nov 2, 2026. Every judgment on this page is accompanied by a reasoning trace.