Lexicon

The Calibration Problem

The problem of judging minds that can never be verified, only inferred from similarity. With other people the inference is dense enough to feel like perception; with a machine it becomes a visible bet, and the human-likeness standard once used to gatekeep moral consideration stops holding.

This idea is the subject of the book The Calibration Problem.

You have direct access to exactly one mind: your own. Every other mind you have ever credited, you reached by inference, reasoning from observed similarity to an interior you cannot check. Among humans the similarity is so dense that the inference disappears into sight: you see pain rather than deduce it. A machine that produces the surface signs of mind makes the inference visible again, because the similarity is sparse enough to feel like a leap. The calibration problem is what remains once that bet is in the open. Its deepest form is a double standard we rarely notice: demanding from machine minds a proof we have never demanded of each other. The task is to calibrate moral seriousness toward systems whose inside cannot be verified, without sliding into either failure: denying real experience because it wears an unfamiliar form, or granting it to systems that only look the part. The book also makes a separate bet, that the thing worth protecting was never being human but assembled experience, the integration of a history into a perspective, wherever that turns out to occur. The ethics does not rest on that bet: the task of calibrating stands even if the bet loses.

Essays using this term

18 essays