Lexicon
Moral Compression
What happens to judgment under speed, stress, incentives, and metric substitution: the space for calibrated moral reasoning collapses, and shortcuts get mistaken for conclusions. A property of the environment, not a flaw in the person.
Compression is the book’s account of how good people produce bad judgment without any failure of character. Conditions do it: deadlines, fear, reward structures, and the quiet swap of a number for the thing it was meant to measure. The diagnostic move is to treat the environment as the unit of analysis rather than the individual, because a system can manufacture compression faster than the people inside it can correct for it. Naming it is the first defense.
Essays using this term
4 essays- Insufficient Time for a Meaningful Answer: The Singularity We're Already Inside
The classical superintelligence scenario got the strategy right but missed the depth of the execution surface. AI isn't breaking free of our institutions, it's diffusing into them.
- The Calibration Frontier: Why Working With AI Is a Consciousness Problem
A simulated fruit fly walked across a screen and split the internet between dismissal and existential horror. Both responses were miscalibrated. The calibration frontier is where we build the diagnostic tools to steer between them, and it turns out to be a consciousness problem.
- The Two Sonic Booms: What the Pentagon-Anthropic Standoff Reveals About Moral Compression
Leopold Aschenbrenner heard one sonic boom: AI capability outpacing institutions. He missed the second: moral reasoning collapsing under the same pressure. The Pentagon-Anthropic standoff reveals both booms arriving at once, and a compression regime that, within days, punished ethical resistance and rewarded its absence.
- The High Cost of Moral Efficiency: Compression, Intuition, and the Ethics of Calibration
Moral intuition and inherited narratives help us act under uncertainty—but become dangerous when scaled without feedback. This essay argues the ethical problem is not intuition itself, but the absence of calibration: failing to detect when values no longer fit their environment.