Cross-domain track record of exceeded risk bounds
The argument
Because linked claim, linked claim, and linked claim, formal risk analyses in three independent, well-instrumented domains have produced claimed bounds that realized failure rates then exceeded, in the spaceflight case by roughly three orders of magnitude. Given that these were among the most heavily resourced risk analyses of their eras, the pattern generalizes: complex risk analyses have historically exhibited error rates above their claimed bounds.
Does it work?
Not yet evaluated.
Premises
- UnassessedNo current assessment. Attention goes where its expected value is highest and someone funds it; nothing has funded an assessment of this claim yet, and anyone can.constitution →Pre-Challenger official estimates of Space Shuttle failure risk were far below the realized failure rate
- SupportedThe evidence favors the claim, but the examination is incomplete or the evidence is indirect.constitution →Nuclear probabilistic risk assessments predicted core-damage frequencies well below the observed historical accident rate
- UnassessedNo current assessment. Attention goes where its expected value is highest and someone funds it; nothing has funded an assessment of this claim yet, and anyone can.constitution →Bank value-at-risk models understated the frequency of extreme losses before the 2008 financial crisis
Where it is made
Passages where sources make, criticize or mention this argument. They record where it appears, not how strong it is, and none has precedence over another.
No source is recorded as making it.
Earlier ratings
- Jul 29, 2026
Granting the premises, the inference from three independent domains to a historical pattern is reasonable but not airtight, since three salient cases are a selected rather than systematic sample. The strongest premise is the pre-Challenger Shuttle estimate exceeded by about three orders of magnitude, which is well documented; the nuclear case is now assessed as supported, with observed core-damage rates exceeding published predictions by an order of magnitude or more even after reference-class objections are weighed; the value-at-risk case is well documented but concerns models already known to be fragile. The argument supports the claim read as a recurring pattern, not as a universal property of risk analysis.
- Jul 19, 2026
Granting the premises, the inference from three independent domains to a historical pattern is reasonable but not airtight, since three salient cases are a selected rather than systematic sample. The strongest premise is the pre-Challenger Shuttle estimate exceeded by about three orders of magnitude, which is well documented; the nuclear case carries real weight but depends on contestable reference-class choices, and the value-at-risk case is well documented but concerns models already known to be fragile. The argument supports the claim read as a recurring pattern, not as a universal property of risk analysis.
- Jul 19, 2026
Granting the premises, the inference from three independent domains to a historical pattern is reasonable but not airtight, since three salient cases are a selected rather than systematic sample. The strongest premise is linked claim, where the gap between claimed and realized risk is about three orders of magnitude and well documented; linked claim carries real weight but depends on contestable reference-class choices, and linked claim is well documented but concerns models known to be fragile. The argument supports the claim read as a recurring pattern, not as a universal property of risk analysis.