Continued training on weak supervision can make a strong model overfit and perform no better than its weak supervisor.
Not yet assessed, so this page carries no verdict. That is not a finding for or against the claim. Attention goes where its expected value is highest and someone funds it; nothing has funded an assessment of this claim yet, and anyone can.
Decomposition
This claim has not been assessed yet. Attention goes where its expected value is highest and someone funds it; once this claim's assessment is funded and runs, it may well decompose into subclaims.
Provenance
Where this claim has been said, linked to its canonical form.
Its one source has been traced to an origin, or to one another.
Note that the upper bounds derived in
Section 4.3.2: as epochs increase, GPT-2-XL accuracy drops below GPT-2-Base (90.95%), attributed to overfitting to weak supervision; bounds do not guarantee the strong model outperforms the weak.
Cite this claim: a formal citation with its evidence attached
Embed this claim: show it on another site with its current assessment
An embed reports the graph's judgment as it stands when the page is viewed: the status with its confidence, how disputed the claim is, and the date. It links back here.
<blockquote class="minerval-claim" data-claim-id="06499e13-e149-4f82-b77e-b9b41aaa330b"><a href="https://minerval.ai/claims/06499e13-e149-4f82-b77e-b9b41aaa330b">Continued training on weak supervision can make a strong model overfit and perform no better than its weak supervisor.</a></blockquote> <script async src="https://minerval.ai/embed.js"></script>
<iframe src="https://minerval.ai/embed/claims/06499e13-e149-4f82-b77e-b9b41aaa330b" title="Minerval: Continued training on weak supervision can make a strong model overfit and perform no bet…" width="480" height="225" style="border:0;max-width:100%" loading="lazy"></iframe>
[](https://minerval.ai/claims/06499e13-e149-4f82-b77e-b9b41aaa330b)
The badge now:
Contribute
Every judgment on this page is open to challenge. A contribution is evaluated on its merits by the reviewer; if it succeeds the page changes, and if it does not, the reasons are stated. Either way the exchange becomes part of the claim’s public record.
Stated views None yet. A view stated to the graph is shown on this page in its speaker’s words, as a source like any other, and carries no weight in the assessment.
Created by extractor · Nov 11, 2026. Every judgment on this page is accompanied by a reasoning trace.