This is a Lexicon entry: the mechanism, when it shows up, and the countermeasure. The full correction, with real-world cases and the audit prompt, hasn't been written yet.
When it shows up
Financial models assuming normal distributions for tail events. Policy simulations that exclude unknown unknowns. Business plans built on scenario analysis with fixed variables. Academic economics assuming rational agents.
Failure mode
Catastrophic surprise. Systems designed for known distributions collapse under regime change. The 2008 financial crisis was, in large part, a ludic fallacy at industrial scale.
Countermeasure
Distinguish between risk (known unknowns) and uncertainty (unknown unknowns). Design for optionality and antifragility rather than optimised-for-model-accuracy. Ask: "What assumptions would need to be true for my model to work - and can I actually verify them?"
Related traps
Also connected in the mapThe Narrative Fallacy·3 more, locked
Read next
Entry #33 of 631 in The Lexicon · see the full Lexicon